Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
Emergent Semantics through Interaction in Image Databases
IEEE Transactions on Knowledge and Data Engineering
IEEE Intelligent Systems
Mining Semantic Networks for Knowledge Discovery
ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
| Hi-index | 0.00 |
In this paper we present a novel approach for retrieval of thematic video content from mixed media. Based on the principles of conceptual blending, information from different media is mined for emergent structures from mixed media. We have built a system, called OntoMedia, to test the efficacy of this approach over traditional methods for media retrieval. The system employs an ontology as a unified indexing scheme for associated text documents for the mixed media content. By applying graph theoretic path finding operations to the ontology to process queries for video content, we show that the system is able to synchronize information from multiple media sources and retrieve semantically related content across media types. A trial experiment was carried out using mixed media courseware from the Singapore-MIT Alliance (SMA) distance education course. Results showed that information retrieval along a path performs significantly better than keyword-based and ontology-focused searches.