Programming in Prolog (2nd ed.)
Programming in Prolog (2nd ed.)
Using a knowledge base to drive an expert system interface with a natural language component
Expert systems: the user interface
Designing the user interface (videotape)
Designing the user interface (videotape)
Synergistic use of direct manipulation and natural language
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User and discourse models for multimodal communication
Intelligent user interfaces
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Towards a Computational Theory of Definite Anaphora Comprehension in English Discourse
Towards a Computational Theory of Definite Anaphora Comprehension in English Discourse
Combining deictic gestures and natural language for referent identification
COLING '86 Proceedings of the 11th coference on Computational linguistics
COLING '92 Proceedings of the 14th conference on Computational linguistics - Volume 2
Multi-Modal-Method: a design method for building multi-modal systems
COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
Resolution of referring expressions in a Korean multimodal dialogue system
ACM Transactions on Asian Language Information Processing (TALIP)
Usability framework for the design and evaluation of multimodal interaction
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
Integrating multimodal cues using grammar based models
UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
| Hi-index | 0.00 |
This paper describes the first reported grammatical framework for a multimodal interface. Although multimodal interfaces offer the promise of a flexible and user friendly means of human-computer interaction, no study has yet appeared on formal grammatical frameworks for them. We have developed Multi-Modal Definite Clause Grammar (MM-DCG), an extension of Definite Clause Grammar. The major features of MM-DCG include capability to handle an arbitrary number of modes and temporal information in grammar rules. Further, we have developed MM-DCG translator to transfer rules in MM-DCG into Prolog predicates.