Overview of the ImageCLEF 2007 Object Retrieval Task

  • Authors:
  • Thomas Deselaers;Allan Hanbury;Ville Viitaniemi;András Benczúr;Mátyás Brendel;Bálint Daróczy;Hugo Jair Escalante Balderas;Theo Gevers;Carlos Arturo Hernández Gracidas;Steven C. Hoi;Jorma Laaksonen;Mingjing Li;Heidy Marisol Marín Castro;Hermann Ney;Xiaoguang Rui;Nicu Sebe;Julian Stöttinger;Lei Wu

  • Affiliations:
  • Computer Science Department, RWTH Aachen University, Germany;Pattern Recognition and Image Processing Group (PRIP), Institute of Computer-Aided Automation, Vienna University of Technology, Austria;Adaptive Informatics Research Centre, Helsinki University of Technology, Finland;Data Mining and Web search Research Group, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Budapest, Hungary;Data Mining and Web search Research Group, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Budapest, Hungary;Data Mining and Web search Research Group, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Budapest, Hungary;TIA Research Group, Computer Science Department, National Institute of Astrophysics, Optics and Electronics, Tonantzintla, Mexico;Intelligent Systems Lab Amsterdam, University of Amsterdam, The Netherlands;TIA Research Group, Computer Science Department, National Institute of Astrophysics, Optics and Electronics, Tonantzintla, Mexico;School of Computer Engineering, Nanyang Technological University, Singapore;Adaptive Informatics Research Centre, Helsinki University of Technology, Finland;Microsoft Research Asia, Beijing, China;TIA Research Group, Computer Science Department, National Institute of Astrophysics, Optics and Electronics, Tonantzintla, Mexico;Computer Science Department, RWTH Aachen University, Germany;Microsoft Research Asia, Beijing, China;Intelligent Systems Lab Amsterdam, University of Amsterdam, The Netherlands;Pattern Recognition and Image Processing Group (PRIP), Institute of Computer-Aided Automation, Vienna University of Technology, Austria;Microsoft Research Asia, Beijing, China

  • Venue:
  • Advances in Multilingual and Multimodal Information Retrieval
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe the object retrieval task of ImageCLEF 2007, give an overview of the methods of the participating groups, and present and discuss the results.The task was based on the widely used PASCAL object recognition data to train object recognition methods and on the IAPR TC-12 benchmark dataset from which images of objects of the ten different classes bicycles, buses, cars, motorbikes, cats, cows, dogs, horses, sheep, and persons had to be retrieved.Seven international groups participated using a wide variety of methods. The results of the evaluation show that the task was very challenging and that different methods for relevance assessment can have a strong influence on the results of an evaluation.