INEX+DBPEDIA: a corpus for semantic search evaluation

  • Authors:
  • Jose R. Perez-Aguera;Javier Arroyo;Jane Greenberg;Joaquin Perez-Iglesias;Victor Fresno

  • Affiliations:
  • University of North Carolina, Chapel Hill, NC, USA;UCM, Madrid, Spain;University of North Carolina, Chapel Hill, USA;UNED, Madrid, Spain;UNED, Madrid, Spain

  • Venue:
  • Proceedings of the 19th international conference on World wide web
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a new collection based on DBpedia and INEX for evaluating semantic search performance. The proposed corpus is used to calculate the impact of considering document's structure on the retrieval performance of the Lucene and BM25 ranking functions. Results show that BM25 outperforms Lucene in all the considered metrics and that there is room for future improvements, which may be obtained using a hybrid approach combining both semantic technology and information retrieval ranking functions.