Linking multimedia presentations with their symbolic source documents: algorithm and applications

Authors:
Berna Erol;Jonathan J. Hull;Dar-Shyang Lee
Affiliations:
RICOH Innovations Inc., California Research Center, Menlo Park, CA;RICOH Innovations Inc., California Research Center, Menlo Park, CA;RICOH Innovations Inc., California Research Center, Menlo Park, CA
Venue:
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Year:
2003

Citing 10
Cited 5

Passive capture and structuring of lectures

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Jabberwocky: you don't have to be a rocket scientist to change slides for a hydrogen combustion lecture

Proceedings of the 5th international conference on Intelligent user interfaces
Linking by interacting: a paradigm for authoring hypertext

HYPERTEXT '00 Proceedings of the eleventh ACM on Hypertext and hypermedia
Automatically linking multimedia meeting documents by image matching

HYPERTEXT '00 Proceedings of the eleventh ACM on Hypertext and hypermedia
Room with a Rear View: Meeting Capture in a Multimedia Conference Room

IEEE MultiMedia
Portable meeting recorder

Proceedings of the tenth ACM international conference on Multimedia
Meeting Capture in a Media Enriched Conference Room

CoBuild '99 Proceedings of the Second International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture
The "Authoring on the Fly" system for automated recording and replay of (tele)presentations

Multimedia Systems - Special issue: Multimedia authoring and presentation techniques
Automated Capture, Integration, and Visualization of Multiple Media Streams

ICMCS '98 Proceedings of the IEEE International Conference on Multimedia Computing and Systems
The audio notebook: paper and pen interaction with structured speech

The audio notebook: paper and pen interaction with structured speech

Office blogger

Proceedings of the 13th annual ACM international conference on Multimedia
Matching slides to presentation videos using SIFT and scene background matching

MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
DocMIR: An automatic document-based indexing system for meeting retrieval

Multimedia Tools and Applications
Structuring low-quality videotaped lectures for cross-reference browsing by video text analysis

Pattern Recognition
Handheld-card-based telecommunications using handwritten keywords

WBE '08 Proceedings of the Seventh IASTED International Conference on Web-based Education

Quantified Score

Hi-index	0.00

Visualization

Abstract

An algorithm is presented that automatically matches images of presentation slides to the symbolic source file (e.g., PowerPoint™ or Acrobat™) from which they were generated. The images are captured either by tapping the video output from a laptop connected to a projector or by taking a picture of what's displayed on the screen in a conference room. The matching algorithm extracts features from the image data, including OCR output, edges, projection profiles, and layout and determines the symbolic file that contains the most similar collection of features. This algorithm enables several unique applications for enhancing a meeting in real-time and accessing the audio and video that were recorded while a presentation was being given. These applications include the simultaneous translation of presentation slides during a meeting, linking video clips inside a PowerPoint file that show how each slide was described by the presenter, and retrieving presentation recordings using digital camera images as queries.