Active and passive gestures: problems with the resolution of deictic and elliptic expressions in a multimodal system

Authors:
Michael Streit
Affiliations:
Siemens AG c/o German Research Center for Artificial Intelligence, Stuhlsatzenhausweg, Saarbrücken
Venue:
ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
Year:
1997

Citing 1
Cited 2

Automatic referent resolution of deictic and anaphoric expressions

Computational Linguistics

Ecological Interfaces: Extending the Pointing Paradigm by Visual Context

CONTEXT '99 Proceedings of the Second International and Interdisciplinary Conference on Modeling and Using Context
Why Are Multimodal Systems so Difficult to Build? - About the Difference between Deictic Gestures and Direct Manipulation

CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper deals with aspects of the resolution of deictic and elliptic expressions that are related to gestures. It discusses different approaches to distinguish between deictic pointing and manipulative gestures. We compare two strategies of combining natural multimodal communication with direct manipulation. The first approach uses click free mouse gestures for deictic pointing, while manipulative gestures are performed by using mouse button events as is usual in graphic interfaces. The second approach uses a touchscreen as gestural input device.