Home
  Register
  Participants
  Tracks
  Adhoc
  ° Collection
  ° Topics
  ° Submissions
  ° Assessments
  ° Results
  Document mining
  Multimedia
  ° Topics
  ° Submissions
  ° Assessments
  ° Results
  Heterogeneous
Collection
  Entity Ranking
  ° Topics
  Link the wiki
  ° Topics
  ° Submissions
  ° Results
  Book search
  ° Topics
  ° Submissions
  Workshop
  News
  Organizers
  Schedule

Organisers

 

Link the Wiki track

Link-the-Wiki: At INEX we are using the Wikipedia collection - about 5 GBytes consisting of 660,000 documents, in XML format. The document set is extensively hyperlinked. The Link-the-Wiki task aims at evaluating the state of the art in automated discovery of document hyperlinks. The objective of the task is to provide an evaluation forum and a set of standard tasks and corresponding achievable results. We aim to create a reusable resource for evaluating and comparing different state of the art systems and approaches to automated link discovery. More specifically, given a new orphan wikipedia document, the task is to analyse the text and recommend a set of incoming and outgoing links from/to anchor text in the existing collection. Going beyond traditional text document analysis, in the context of INEX we aim to operate at the XML element level. This means that anchor text or anchor elements will link not only to a related document, but to a specific XML element within, or to the best entry point for starting to read the referenced material from.


This file contains the evaluation software: ltwEval


Schedule

June 15: Submission deadline for candidate topics.
Aug 05: Distribution of final set of topics/queries to participants along with detailed information on the formatting requirements of the search results.
Nov 05: Submission deadline of search results.
Nov 12: Distribution of evaluation scores to participants
Shlomo Geva
Faculty of Information Technology
Queensland University of Technology
126 Margaret Street
GPO Box 2434
Brisbane, Q 4001
Australia
Email: s.geva@qut.edu.au

Andrew Trotman
Department of Computer Science
University of Otago
Dunedin
New Zealand
Email:andrew@cs.otago.ac.nz