BVideoQA: Online English-Chinese bilingual video question answering

  • Authors:

  • Yue-Shi Lee;Yu-Chieh Wu;Jie-Chi Yang

  • Affiliations:

  • Department of Computer Science and Information Engineering, Ming Chuan University, Gwei Shan District, Taoyuan 333, Taiwan;Department of Computer Science and Information Engineering, National Central University, Jhongli City, Taoyuan County 32001, Taiwan;Graduate Institute of Network Learning Technology, National Central University, Jhongli City, Taoyuan County 32001, Taiwan

  • Venue:
  • Journal of the American Society for Information Science and Technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article presents a bilingual video question answering (QA) system, namely BVideoQA, which allows users to retrieve Chinese videos through English or Chinese natural language questions. Our method first extracts an optimal one-to-one string pattern matching according to the proposed dense and long N-gram match. On the basis of the matched string patterns, it gives a passage score based on our term-weighting scheme. The main contributions of this approach to multimedia information retrieval literatures include: (a) development of a truly bilingual video QA system, (b) presentation of a robust bilingual passage retrieval algorithm to handle no-word-boundary languages such as Chinese and Japanese, (c) development of a large-scale bilingual video QA corpus for system evaluation, and (d) comparisons of seven top-performing retrieval methods under the fair conditions. The experimental studies indicate that our method is superior to other existing approaches in terms of precision and main rank reciprocal rates. When ported to English, encouraging empirical results also are obtained. Our method is very important to Asian-like languages since the development of a word tokenizer is optional. © 2009 Wiley Periodicals, Inc.