A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A multimodal syntax-directed graph editor
Structure-based editors and environments
Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Ten myths of multimodal interaction
Communications of the ACM
Hi-index | 0.01 |
Multimodal integration is an important problem of multimodal user interface research. After briefly surveying research on multimodal integration, this paper introduced a natural language processing method to resolve the problem of integration. It introduced the unification operation on complex feature set and extended this operation in order to represent the information from input modalities and implement multimodal integration.