A new passage ranking algorithm for video question answering

  • Authors:

  • Yu-Chieh Wu;Yue-Shi Lee;Jie-Chi Yang;Show-Jane Yen

  • Affiliations:

  • Department of Computer Science and Information Engineering, National Central University;Department of Computer Science and Information Engineering, Ming Chuan University, Taoyuan, Taiwan, R.O.C.;Graduate Institute of Network Learning Technology, National Central University, Jhongli City, Taoyuan County, Taiwan, R.O.C.;Department of Computer Science and Information Engineering, Ming Chuan University, Taoyuan, Taiwan, R.O.C.

  • Venue:
  • PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Developing a question answering (Q/A) system involves in integrating abundant linguistic resources such as syntactic parsers, named entity recognizers which are not only impose time cost but also unavailable in other languages. Ranking-based approaches take the advantage of both efficiency and multilingual portability but most of them bias to high frequent words. In this paper, we propose a new passage ranking algorithm for extending textQ/A toward videoQ/A based on searching lexical information in videos. This method takes both N-gram match and word density into account and finds the optimal match sequence using dynamic programming techniques. Besides, it is very efficient to handle real time tasks for online video question answering. We evaluated our method with 150 actual user's questions on the 45GB video collections. Nevertheless, four well-known but multilingual portable ranking approaches were adopted to compare. Experimental results show that our method outperforms the second best approach with relatively 25.64% MRR score.