Drawing pictures with natural language and direct manipulation

Authors:
Mayumi Hiyoshi;Hideo Shimazu
Affiliations:
Information Technology Research Laboratories, NEC Corporation, Miyamae Kawasaki, Japan;Information Technology Research Laboratories, NEC Corporation, Miyamae Kawasaki, Japan
Venue:
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 2
Year:
1994

Citing 3
Cited 2

Synergistic use of direct manipulation and natural language

CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User and discourse models for multimodal communication

Intelligent user interfaces
“Put-that-there”: Voice and gesture at the graphics interface

SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques

Multi-Modal-Method: a design method for building multi-modal systems

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
Combining modality theory and context models

PIT'06 Proceedings of the 2006 international tutorial and research conference on Perception and Interactive Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

A multimodal user interface allows users to communicate with computers using multiple modalities, such as a mouse, a keyboard or voice, in various combined ways. This paper discusses a multimodal drawing tool, whereby the user can use a mouse, a keyboard and voice effectively. Also, it describes an interpretation method, by which the system integrates voice inputs and pointing inputs using context.