Teaching and learning as multimedia authoring: the classroom 2000 project
MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Passive capture and structuring of lectures
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Auto-summarization of audio-video presentations
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Video Surveillance of Interactions
VS '99 Proceedings of the Second IEEE Workshop on Visual Surveillance
Segmentation of Lecture Videos Based on Text: A Method Combining Multiple Linguistic Features
HICSS '04 Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 1 - Volume 1
Analysis and Visualization of Index Words from Audio Transcripts of Instructional Videos
ISMSE '04 Proceedings of the IEEE Sixth International Symposium on Multimedia Software Engineering
Augmented segmentation and visualization for presentation videos
Proceedings of the 13th annual ACM international conference on Multimedia
Analysis and interface for instructional video
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Selection and ranking of text from highly imperfect transcripts for retrieval of video content
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
A highly efficient system for automatic face region detection in MPEG video
IEEE Transactions on Circuits and Systems for Video Technology
Evaluation of video browser features and user interaction with VAST MM
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Keyframe-less integration of semantic information in a video player interface
Proceedings of the seventh european conference on European interactive television conference
Foundations and Trends in Information Retrieval
IEEE Transactions on Multimedia - Special issue on integration of context and content
Audio-based classification of speaker characteristics
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
TalkMiner: a lecture webcast search engine
Proceedings of the international conference on Multimedia
VastMM-Tag: a semantic tagging browser for unstructured videos
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Selecting the best faces to index presentation videos
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Analysis, indexing and visualization of presentation videos
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Arm gesture variations during presentations are correlated with conjunctions indicating contrast
Proceedings of the 2012 ACM workshop on User experience in e-learning and augmented technologies in education
Upper body gestures in lecture videos: indexing and correlating to pedagogical significance
Proceedings of the 20th ACM international conference on Multimedia
Narrative theme navigation for sitcoms supported by fan-generated scripts
Multimedia Tools and Applications
Multimedia Tools and Applications
Hi-index | 0.00 |
In the domain of candidly captured student presentation videos, we examine and evaluate approaches for multi-modal analysis and indexing of audio and video. We apply visual segmentation techniques on unedited video to determine likely changes of topics. Speaker segmentation methods are employed to determine individual student appearances, which are linked to extracted headshots to create a visual speaker index. Videos are augmented with time-aligned filtered keywords and phrases from highly inaccurate speech transcripts. Our experimental user interface, the VAST MM Browser (Video Audio Structure Text Multi Media Browser), combines streaming videos, visual, and textual indices for browsing and searching. We evaluate the UI and methods in a large engineering design course. We report on observations and statistics collected over 4 semesters and 598 student participants. Results suggest that our video indexing and retrieval approach is effective, and that our continuous improvements are reflecting in an increase in precision and recall of user study tasks.