The Ecological Approach to Multimodal System Design

Authors:
Antonella De Angeli;Frederic Wolff;Laurent Romary;Walter Gerbino
Affiliations:
-;-;-;-
Venue:
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Year:
1999

Citing 3
Cited 0

Intelligent multimedia interfaces

Intelligent multimedia interfaces
Integration and synchronization of input modes during multimodal human-computer interaction

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Visual display, pointing, and natural language: the power of multimodal interaction

AVI '98 Proceedings of the working conference on Advanced visual interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

Following the ecological approach to visual perception, this paper presents a framework that emphasizes the role of vision on referring actions. In particular, affordances are utilized to explain gestures variability in a multimodal human-computer interaction. Such a proposal is consistent with empirical findings obtained in different simulation studies showing how referring gestures are determined by the mutuality of information coming from the target and the set of movements available to the speaker. A prototype that follows anthropomorphic perceptual principles to analyze gestures has been developed and tested in preliminary computational validations.