The ICSI RT07s Speaker Diarization System
Multimodal Technologies for Perception of Humans
Foundations and Trends in Information Retrieval
Joke-o-mat: browsing sitcoms punchline by punchline
MM '09 Proceedings of the 17th ACM international conference on Multimedia
ISM '09 Proceedings of the 2009 11th IEEE International Symposium on Multimedia
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
A fully automated content-based video search engine supporting spatiotemporal queries
IEEE Transactions on Circuits and Systems for Video Technology
3rd international workshop on automated information extraction in media production
Proceedings of the international conference on Multimedia
Narrative theme navigation for sitcoms supported by fan-generated scripts
Multimedia Tools and Applications
Hi-index | 0.00 |
The following article presents a novel method to generate indexing information for the navigation of TV content and presents an implementation that extends the Joke-O-Mat sitcom navigation system, presented in [1]. The extended system enhances Joke-o-mat's capability to browse a sitcom by scene, punchline, dialog segment, and actor with word-level keyword search. The indexing is performed based on the alignment of the multimedia content with closed captions and "found" fan-generated scripts processed with speech and speaker recognition systems. This significantly reduces the amount of manual intervention required for training new episodes, and the final narrative-theme segmentation has proven indistinguishable from expert annotation. This article describes the new Joke-o-mat system, discusses problems with using fan-generated data, and presents results on episodes from the sitcom Seinfeld, showing segmentation accuracy and user satisfaction as determined by a human-subject study.