Passive capture and structuring of lectures
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
Building Tablet PC Applications with Cdrom
Building Tablet PC Applications with Cdrom
Cross-media correlation: a case study of navigated hypermedia documents
Proceedings of the tenth ACM international conference on Multimedia
Semantic exploration of lecture videos
Proceedings of the tenth ACM international conference on Multimedia
Reflowing digital ink annotations
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Discerning Structure from Freeform Handwritten Notes
ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 1
Shared interactive video for teleconferencing
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Speech and sketching for multimodal design
Proceedings of the 9th international conference on Intelligent user interfaces
Experiences with a tablet PC based lecture presentation system in computer science courses
Proceedings of the 35th SIGCSE technical symposium on Computer science education
Using pen-based computers across the computer science curriculum
Proceedings of the 35th SIGCSE technical symposium on Computer science education
A study of digital ink in lecture presentation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 10th international conference on Intelligent user interfaces
Documenting the pen-based interaction
WebMedia '05 Proceedings of the 11th Brazilian Symposium on Multimedia and the web
Human-centered collaborative interaction
Proceedings of the 1st ACM international workshop on Human-centered multimedia
Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations
Proceedings of the 8th international conference on Multimodal interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Cross-domain matching for automatic tag extraction across redundant handwriting and speech events
Proceedings of the 2007 workshop on Tagging, mining and retrieval of human related activity information
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
MultiPresenter: a presentation system for (very) large display surfaces
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Integrating corrections into digital ink playback
MM '09 Proceedings of the 17th ACM international conference on Multimedia
A study of diagrammatic ink in lecture
Computers and Graphics
Observational study on teaching artifacts created using tablet PC
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Design of human-centric adaptive multimodal interfaces
International Journal of Human-Computer Studies
Improving document retrieval using special characteristics of lecture recording documents
Proceedings of the Third Symposium on Information and Communication Technology
Hi-index | 0.00 |
In this paper, we report on an empirical exploration of digital ink and speech usage in lecture presentation. We studied the video archives of five Master's level Computer Science courses to understand how instructors use ink and speech together while lecturing, and to evaluate techniques for analyzing digital ink. Our interest in understanding how ink and speech are used together is to inform the development of future tools for supporting classroom presentation, distance education, and viewing of archived lectures. We want to make it easier to interact with electronic materials and to extract information from them. We want to provide an empirical basis for addressing challenging problems such as automatically generating full text transcripts of lectures, matching speaker audio with slide content, and recognizing the meaning of the instructor's ink. Our results include an evaluation of handwritten word recognition in the lecture domain, an approach for associating attentional marks with content, an analysis of linkage between speech and ink, and an application of recognition techniques to infer speaker actions.