Multimedia Learning
Active Multimodal Presentations, an Overview
ICALT '05 Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies
Developing Active Multimodal Presentations
ICALT '05 Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies
An interactive support tool to convey the intended message in asynchronous presentations
Proceedings of the International Conference on Advances in Computer Enterntainment Technology
| Hi-index | 0.00 |
This paper presents a methodology for analyzing gestures within Active Multimodal Presentations (AMP) which are designed to produce coherently integrated communications within educational contexts. The methodology is focused on a semantic integration of the visual, verbal and gestural modalities. We identify three representational forms - a time based transcript, that is extracted from presentations to produce a speech mark-up; a concept based semantic analysis of the content; and a representation of gestures which distinguishes visual depictions of their icons, their trajectories, referents, and functions that link the verbal and visual modalities of the presentations. Our experiments are showing the utility of the analyses giving guidelines that can aid the design of AMPs within educational contexts.