Introduction to algorithms
On stochastic feature and model compensation approaches to robust speech recognition
Speech Communication - Special issue on robust speech recognition
The anatomy of a large-scale hypertextual Web search engine
WWW7 Proceedings of the seventh international conference on World Wide Web 7
Document expansion for speech retrieval
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Complementary video and audio analysis for broadcast news archives
Communications of the ACM
Introduction to Modern Information Retrieval
Introduction to Modern Information Retrieval
Name-It: Naming and Detecting Faces in News Videos
IEEE MultiMedia
Collages as dynamic summaries for news video
Proceedings of the tenth ACM international conference on Multimedia
Learning pattern rules for Chinese named entity extraction
Eighteenth national conference on Artificial intelligence
Structured use of external knowledge for event-based open domain question answering
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
TextTiling: segmenting text into multi-paragraph subtopic passages
Computational Linguistics
Using corpus statistics and WordNet relations for sense identification
Computational Linguistics - Special issue on word sense disambiguation
Extracting key semantic terms from Chinese speech query for web searches
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
A method for open-vocabulary speech-driven text retrieval
EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
The Cambridge University spoken document retrieval system
ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 01
Information fusion for spoken document retrieval
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 04
Speechbot: an experimental speech-based search engine formultimedia content on the web
IEEE Transactions on Multimedia
Question answering on lecture videos: a multifaceted approach
Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries
The fusion of audio-visual features and external knowledge for event detection in team sports video
Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
Learning query-class dependent weights in automatic video retrieval
Proceedings of the 12th annual ACM international conference on Multimedia
Joint visual-text modeling for automatic retrieval of multimedia documents
Proceedings of the 13th annual ACM international conference on Multimedia
METIS: a flexible foundation for the unified management of multimedia assets
Multimedia Tools and Applications
A review of text and image retrieval approaches for broadcast news video
Information Retrieval
The use of topic evolution to help users browse and find answers in news video corpus
Proceedings of the 15th international conference on Multimedia
Video summarisation: A conceptual framework and survey of the state of the art
Journal of Visual Communication and Image Representation
Question-driven segmentation of lecture speech text: Towards intelligent e-learning systems
Journal of the American Society for Information Science and Technology
A weighted string pattern matching-based passage ranking algorithm for video question answering
Expert Systems with Applications: An International Journal
Natural language querying for video databases
Information Sciences: an International Journal
Photo-based question answering
MM '08 Proceedings of the 16th ACM international conference on Multimedia
BVideoQA: Online English-Chinese bilingual video question answering
Journal of the American Society for Information Science and Technology
Video reference: question answering on YouTube
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Similarity retrieval of videos by using 3D C-string knowledge representation
Journal of Visual Communication and Image Representation
News video retrieval by learning multimodal semantic information
VISUAL'07 Proceedings of the 9th international conference on Advances in visual information systems
ICDM'10 Proceedings of the 10th industrial conference on Advances in data mining: applications and theoretical aspects
Versatile question answering systems: seeing in synthesis
International Journal of Intelligent Information and Database Systems
Webpage-based and video summarization-based learning platform for online multimedia learning
Edutainment'11 Proceedings of the 6th international conference on E-learning and games, edutainment technologies
Beyond search: Event-driven summarization for web videos
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
trackThem: exploring a large-scale news video archive by tracking human relations
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Hot event detection and summarization by graph modeling and matching
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Web-based semantic analysis of chinese news video
PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
A new passage ranking algorithm for video question answering
PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
Spoken Content Retrieval: A Survey of Techniques and Technologies
Foundations and Trends in Information Retrieval
Snap-and-ask: answering multimodal question by naming visual instance
Proceedings of the 20th ACM international conference on Multimedia
Information Sciences: an International Journal
Hi-index | 0.00 |
When querying a news video archive, the users are interested in retrieving precise answers in the form of a summary that best answers the query. However, current video retrieval systems, including the search engines on the web, are designed to retrieve documents instead of precise answers. This research explores the use of question answering (QA) techniques to support personalized news video retrieval. Users interact with our system, VideoQA, using short natural language questions with implicit constraints on contents, context, duration, and genre of expected videos. VideoQA returns short precise news video summaries as answers. The main contributions of this research are: (a) the extension of QA technology to support QA in news video; and (b) the use of multi-modal features, including visual, audio, textual, and external resources, to help correct speech recognition errors and to perform precise question answering. The system has been tested on 7 days of news video and has been found to be effective.