A natural language approach to content-based video indexing and retrieval for interactive e-learning

Authors:
Dongsong Zhang;J. F. Nunamaker
Affiliations:
Dept. of Inf. Syst., Univ. of Maryland-Baltimore County, Baltimore, MD, USA;-
Venue:
IEEE Transactions on Multimedia
Year:
2004

Citing 0
Cited 15

A Natural Language-Based Interface for Querying a Video Database

IEEE MultiMedia
Multimedia and human-in-the-loop: interaction as content enrichment

Proceedings of the international workshop on Human-centered multimedia
Incorporating feature hierarchy and boosting to achieve more effective classifier training and concept-oriented video summarization and skimming

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Question-driven segmentation of lecture speech text: Towards intelligent e-learning systems

Journal of the American Society for Information Science and Technology
A weighted string pattern matching-based passage ranking algorithm for video question answering

Expert Systems with Applications: An International Journal
Natural language querying for video databases

Information Sciences: an International Journal
An empirical investigation of virtual Interaction in supporting learning

ACM SIGMIS Database
BVideoQA: Online English-Chinese bilingual video question answering

Journal of the American Society for Information Science and Technology
Case-Based Collective Inference for Maritime Object Classification

ICCBR '09 Proceedings of the 8th International Conference on Case-Based Reasoning: Case-Based Reasoning Research and Development
Multimodal Interaction for Mobile Learning

UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
A web-based lecture scene playback system using digital picture-card show with structured learning assistance function

International Journal of Web and Grid Services
Multimodal technology for municipal inspections: an evaluation framework

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: applications and services
Question type classification using a part-of-speech hierarchy

AIS'11 Proceedings of the Second international conference on Autonomous and intelligent systems
A new passage ranking algorithm for video question answering

PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
A comprehensive review of significant researches on content based indexing and retrieval of visual information

Frontiers of Computer Science: Selected Publications from Chinese Universities

Quantified Score

Hi-index	0.00

Visualization

Abstract

As a powerful and expressive nontextual media that can capture and present information, instructional videos are extensively used in e-learning (Web-based distance learning). Since each video may cover many subjects, it is critical for an e-learning environment to have content-based video searching capabilities to meet diverse individual learning needs. In this paper, we present an interactive multimedia-based e-learning environment that enables users to interact with it to obtain knowledge in the form of logically segmented video clips. We propose a natural language approach to content-based video indexing and retrieval to identify appropriate video clips that can address users' needs. The method integrates natural language processing, named entity extraction, frame-based indexing, and information retrieval techniques to explore knowledge-on-demand in a video-based interactive e-learning environment. A preliminary evaluation shows that precision and recall of this approach are better than those of the traditional keyword based approach.