Speech and gestures for graphic image manipulation
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Two-handed gesture in multi-modal natural dialog
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
From a Typology of Gestures to a Procedure for Gesture Production
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Interpretation of Shape-Related Iconic Gestures in Virtual Environments
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Meaningful Gestures for Human Computer Interaction: Beyond Hand Postures
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Form: an experiment in the annotation of the kinetics of gesture
Form: an experiment in the annotation of the kinetics of gesture
User-defined gestures for surface computing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
In search of a natural gesture
XRDS: Crossroads, The ACM Magazine for Students - The Future of Interaction
The recognition and comprehension of hand gestures: a review and research agenda
ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
Vision-based hand-gesture applications
Communications of the ACM
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Waving to a touch interface: descriptive field study of a multipurpose multimodal public display
Proceedings of the 2nd ACM International Symposium on Pervasive Displays
Hi-index | 0.00 |
This paper explores how na?ve observers recognize and interpret transitive actions (actions involving manipulation of objects) without accompanying speech, in order to derive guidelines for the design of gesture interpretation systems. Semi-structured interviews with 11 observers, interpreting 106 video clips of transitive actions elicited unstaged from 16 participants, reveal that people are generally able to interpret the transitive action as well as characteristics of the object manipulated despite individual variations in how people naturally gesture. In particular, people focus primarily on hand movement and hand shape to correctly interpret object characteristics, and on manner of movement of arms and/or final location of hands to interpret the goal of the transitive action (e.g., arrange objects vs. clear objects). These findings provide insights on aspects of gestures one can focus on to inform and guide the design of gesture interpretation models for interfaces that allow for individual variations in natural gesture production.