|
|
![]() |
||||
Multimedia trackObjectiveThe main objective of the INEX 2005 multimedia track is to provide an evaluation platform/forum for structured document retrieval systems that do not only include text in the retrieval process. Many structured document collections today also contain other types of media, such as images, speech, and video. To include these media types into the retrieval process and to produce a meaningful ranking is far from trivial. Using the structure of the document as a semantic/logical backbone for the retrieval of multimedia document fragments will allow us to investigate this problem from a new perspective. In the first year of the multimedia track, we plan to provide an evaluation platform for the retrieval of multimedia structured document fragments, similar to the methodology used for the INEX Ad Hoc track. Besides that we want to open a discussion forum where the participating groups can exchange their ideas on different aspects of the multimedia XML retrieval task, so that in the coming years the multimedia track can evolve in a mature discipline of its own. The main concern for the multimedia track is to find a suitable document collection, i.e. one that is based on XML and has a rich multimedia character . At current two candidates are being examined. More information, including a preliminary schedule for the multimedia track will be published in the near future. | |
Schedule |
|
| June 21: | Distribution of collection. |
| June 27: | Topic definition guidelines (As Ad Hoc+ MM constraints). |
| July 15: | Candidate topic submission deadline. |
| July 22: | Distribution of topics to participants. |
| Aug 30: | Submission deadline of search results. |
| Sept 15: | Distribution of merged results to participants for relevance assessments. |
| Oct 7: | Submission deadline for relevance assessments. |
| Oct 21: | Distribution of XML test collection and evaluation scores to participants. |
| Nov 13: | Submission of papers for the workshop pre-proceedings. |
OrganisersRoelof van Zwolroelof@cs.uu.nl Gabriella Kazai gabs@dcs.qmul.ac.uk Mounia Lalmas mounia@dcs.qmul.ac.uk | |