Main Menu

Research & Integration


WP2: Evaluation, Integration and Standards
WP3: Visual Content Indexing
WP4: Content Description for Audio, Speech and Text
WP5: Multimodal Processing and Interaction
WP6: Machine Learning and Computation Applied to Multimedia
WP7: Dissemination towards Industry

Logo IST
Home arrow News arrow Previous news arrow Objectives

WP2: EIS (Evaluation, Integration and Standards) 

The principal objective of this workpackage is to co-ordinate activities that facilitate within and between research workpackage collaboration. This principal objective can be divided into several specific objectives that are placed into 3 groups: evaluation, standards and computation.

Evaluation (or benchmarking)
  • The collection of a large test database of copyright-free multimedia data (video, sound, etc.) and video surveillance data, which will be placed at the disposal of members of the network for use in development and testing.
  • The manual annotation of some of the data in the test database (location of scene changes, contents of a scene, behaviour of persons, etc.). This will allow objective evaluation of automatic algorithms.
  • The organization of evaluation campaigns through which network members can compare the performance of their systems on the standard test data.


  • Selection of a Standard for the Metadata representation.
  • Analyses of open-source native XML databases.
  • Development of tools for the extraction of standardized Metadata informations.
  • Development of an Infrastructure for MultiMedia Metadata Management based on Semantic Web technology.


  • To make available software for free use between network members.
  • To publish resources on computational methods, such as software repositories and tutorial material.