A synergistic approach to efficient interactive video retrieval

  • Authors:
  • Andreas Girgensohn;John Adcock;Matthew Cooper;Lynn Wilcox

  • Affiliations:
  • FX Palo Alto Laboratory, Palo Alto, CA;FX Palo Alto Laboratory, Palo Alto, CA;FX Palo Alto Laboratory, Palo Alto, CA;FX Palo Alto Laboratory, Palo Alto, CA

  • Venue:
  • INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

A video database can contain a large number of videos ranging from several minutes to several hours in length. Typically, it is not sufficient to search just for relevant videos, because the task still remains to find the relevant clip, typically less than one minute of length, within the video. This makes it impor tant to direct the users attention to the most promising material and to indicate what material they already investigated. Based on this premise, we created a video search system with a powerful and flexible user interface that incorporates dynamic visualizations of the underlying multimedia objects. The system employes an automatic story segmentation, combines text and visual search, and displays search results in ranked sets of story keyframe collages. By adapting the keyframe collages based on query relevance and indicating which portions of the video have already been explored, we enable users to quickly find relevant sec tions. We tested our system as part of the NIST TRECVID interactive search evaluation, and found that our user interface enabled users to find more relevant results within the allotted time than other systems employing more sophisticated analysis techniques but less helpful user interfaces.