A marking based interface for collaborative writing
UIST '93 Proceedings of the 6th annual ACM symposium on User interface software and technology
Modeling Content for Semantic-Level Querying of Multimedia
Multimedia Tools and Applications
IEEE MultiMedia
Using New Learning Technologies with Multimedia
IEEE MultiMedia
The "Authoring on the Fly" system for automated recording and replay of (tele)presentations
Multimedia Systems - Special issue: Multimedia authoring and presentation techniques
Design of a Web-Based Synchronized Multimedia Lecture System for Distance Education
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
Multiple Media Correlation: Theory and Applications
Multiple Media Correlation: Theory and Applications
The audio notebook: paper and pen interaction with structured speech
The audio notebook: paper and pen interaction with structured speech
Thematic alignment of recorded speech with documents
Proceedings of the 2003 ACM symposium on Document engineering
Lessons learned from eClass: Assessing automated capture and access in the classroom
ACM Transactions on Computer-Human Interaction (TOCHI)
A Marking-Based Synchronized Multimedia Tutoring System for Composition Studies
ICALT '05 Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies
A media synchronization survey: reference model, specification, and case studies
IEEE Journal on Selected Areas in Communications
SADPI '07 Proceedings of the 2007 international workshop on Semantically aware document processing and indexing
Inkteractors: interacting with digital ink
Proceedings of the 2008 ACM symposium on Applied computing
Watch-and-comment as a paradigm toward ubiquitous interactive video editing
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Ubiquitous Interactive Video Editing Via Multimodal Annotations
EUROITV '08 Proceedings of the 6th European conference on Changing Television Environments
Integrating corrections into digital ink playback
MM '09 Proceedings of the 17th ACM international conference on Multimedia
| Hi-index | 0.00 |
This paper is devoted to explore media correlation and media synchronization in a composite multimedia document, the so-called navigated hypermedia document in our language learning system, to facilitate the multimedia authoring, presentation, and access. Two levels of media correlation in temporal, spatial, and content domains are investigated: syntactic level correlation and semantic level correlation. We devise a capturing mechanism to record all the media streams and relations between them, including voice and event streams, for replaying the lecturing in a form as close as possible to the original classroom experience. The syntactic level correlation is based on specific timestamps of the media stream and used to reconstruct the recorded lecture for synchronized presentation. Furthermore, to integrate media objects with specific segments within the media stream, some computed synchronization processes are required to discover semantic content of the media. The proposed computed synchronization techniques, including speech-event binding process for temporal domain, tele-pointer (i.e. cursor) movement interpolation and adaptable handwriting presentation for spatial domain, and erasing handling for content domain, will be addressed. Experimental results show that in the speech-event binding process 74% of speech access entries for accessible visualized events are found. The acceptable rate of human perception on tele-pointer movement is higher than 85% if time interval is selected carefully. Finally, the accuracy of erasing handling for content removing is about 71%.