Assessing the Filtering and Browsing Utility of Automatic Semantic Concepts for Multimedia Retrieval

  • Authors:
  • Michael G. Christel;Milind R. Naphade;Apostol (Paul) Natsev;Jelena Tesic

  • Affiliations:
  • Carnegie Mellon University;IBM Thomas J. Watson Research Center, NY;IBM Thomas J. Watson Research Center, NY;IBM Thomas J. Watson Research Center, NY

  • Venue:
  • CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The contributions of automatic semantic concept classifiers for interactive filtering (classifiers in conjunction with query rankings) and browsing (classifiers in lieu of query rankings) are tested against three test corpora: an amateur photo collection, documentary video, and news video. Results show that current classifiers offer browsing utility twice as good as having no classifier at all, and that continuous improvements in the classifiers produce comparable improvements in the browsing utility. For filtering a wellordered set of results (e.g., a set retrieved from text search), concept classifiers need greater accuracy: current classifiers showed worse performance than not filtering at all, even when the classifiers' accuracy is nearly doubled. Results are consistent for all test corpora. Hence, automatic semantic concepts can offer significant utility for browsing at current levels of accuracy, but the requirement is much higher for filtering a well-ordered set of results, where extreme accuracy is necessary before benefits are seen.