Jabberwocky: you don't have to be a rocket scientist to change slides for a hydrogen combustion lecture

Authors:
David Franklin;Shannon Bradshaw;Kristian Hammond
Affiliations:
Intelligent Information Laboratory, Northwestern University;Intelligent Information Laboratory, Northwestern University;Intelligent Information Laboratory, Northwestern University
Venue:
Proceedings of the 5th international conference on Intelligent user interfaces
Year:
2000

Citing 3
Cited 5

Design principles for intelligent environments

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Cooperating with people: the intelligent classroom

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Inferring informational goals from free-text queries: a Bayesian approach

UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence

Plan-based interfaces: keeping track of user tasks and acting to cooperate

Proceedings of the 7th international conference on Intelligent user interfaces
The interactive chef: a task-sensitive assistant

Proceedings of the 7th international conference on Intelligent user interfaces
Linking multimedia presentations with their symbolic source documents: algorithm and applications

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Visual signature based identification of Low-resolution document images

Proceedings of the 2004 ACM symposium on Document engineering
The multimodal presentation dashboard

NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

In designing Jabberwocky—a speech-based interface to Microsoft PowerPoint—we have tried to go beyond simple commands like “Next slide, please” and make a tool that aids speakers as they present and even learns as they rehearse their presentations. Jabberwocky looks at the contents of the slides, extracting key words and phrases and associating them with their places in the presentation. By listening for these phrases (and synonymous phrases derived using syntactic rules) Jabberwocky is able to follow along with the presentation, switching slides at the appropriate moments. In this paper, we discuss the implementation of this system—a component of our Intelligent Classroom project—and look at how we are using it.