The FIRE 2008 Evaluation Exercise

  • Authors:
  • Prasenjit Majumder;Mandar Mitra;Dipasree Pal;Ayan Bandyopadhyay;Samaresh Maiti;Sukomal Pal;Deboshree Modak;Sucharita Sanyal

  • Affiliations:
  • Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute;Indian Statistical Institute

  • Venue:
  • ACM Transactions on Asian Language Information Processing (TALIP)
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

The aim of the Forum for Information Retrieval Evaluation (FIRE) is to create an evaluation framework in the spirit of TREC (Text REtrieval Conference), CLEF (Cross-Language Evaluation Forum), and NTCIR (NII Test Collection for IR Systems), for Indian language Information Retrieval. The first evaluation exercise conducted by FIRE was completed in 2008. This article describes the test collections used at FIRE 2008, summarizes the approaches adopted by various participants, discusses the limitations of the datasets, and outlines the tasks planned for the next iteration of FIRE.