QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Natural language with integrated deictic and graphic gestures
Readings in intelligent user interfaces
Designing storytelling technologies to encouraging collaboration between young children
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Physical programming: designing tools for children to create physical interactive environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Storytelling systems: constructing the innerface of the interface
CT '97 Proceedings of the 2nd International Conference on Cognitive Technology (CT '97)
Using eye movements to determine referents in a spoken dialogue system
Proceedings of the 2001 workshop on Perceptive user interfaces
A Gaze and Speech Multimodal Interface
ICDCSW '04 Proceedings of the 24th International Conference on Distributed Computing Systems Workshops - W7: EC (ICDCSW'04) - Volume 7
Context based multimodal fusion
Proceedings of the 6th international conference on Multimodal interfaces
A multimodal 3D storytelling system for Chinese children
Edutainment'07 Proceedings of the 2nd international conference on Technologies for e-learning and digital entertainment
| Hi-index | 0.00 |
Storytelling by a child, as a training activity, influences significantly a child's linguistic abilities, logic and thought process, imagination, and creativity. There presently exist many software-based storytelling applications. However, most are deemed incompatible or not suitable to Chinese children. Due to the limited vocabulary of pre-school and lower-level grade school children, speech-based and pen-based input models are considered the most effective way of input. But now there is not an effective multimodal mode to solve the problem for children's storytelling systems. In this paper, we propose a multimodal fusion framework that utilizes pen and speech techniques to incorporate both context information and linguistic attributes of the Chinese language into the design. Based on the proposed framework, we formulated specific methods of integration, and developed a prototype for our proposed system.