Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces

Authors:
Sukeshini A. Grandhi;Gina Joue;Irene Mittelberg
Affiliations:
HUMTEC, RWTH Aachen University, Aachen , Germany;HUMTEC, RWTH Aachen University, Aachen , Germany;HUMTEC, RWTH Aachen University, Aachen , Germany
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2011

Citing 6
Cited 13

Attention and visual feedback: the bimanual frame of reference

Proceedings of the 1997 symposium on Interactive 3D graphics
Where the action is: the foundations of embodied interaction

Where the action is: the foundations of embodied interaction
FEATURE: What robotics can learn from HCI

interactions - Pencils before pixels: a primer in hand-generated sketching
Designing Gestural Interfaces: Touchscreens and Interactive Devices

Designing Gestural Interfaces: Touchscreens and Interactive Devices
User-defined gestures for surface computing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
In search of a natural gesture

XRDS: Crossroads, The ACM Magazine for Students - The Future of Interaction

Prototyping a gestural interface for selecting and buying goods in a public environment

Proceedings of the International Working Conference on Advanced Visual Interfaces
To move or to remove?: a human-centric approach to understanding gesture interpretation

Proceedings of the Designing Interactive Systems Conference
The role of physical controllers in motion video gaming

Proceedings of the Designing Interactive Systems Conference
Applying new interaction paradigms to the education of children with special educational needs

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part I
Fishing or a Z?: investigating the effects of error on mimetic and alphabet device-based gesture interaction

Proceedings of the 14th ACM international conference on Multimodal interaction
Don't open that door: designing gestural interactions for interactive narratives

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
The challenges and potential of end-user gesture customization

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Trigger shift: participatory design of an augmented theatrical performance with young people

Proceedings of the 9th ACM Conference on Creativity & Cognition
How we gesture towards machines: an exploratory study of user perceptions of gestural interaction

CHI '13 Extended Abstracts on Human Factors in Computing Systems
Exploring motion-based touchless games for autistic children's learning

Proceedings of the 12th International Conference on Interaction Design and Children
Towards more natural digital content manipulation via user freehand gestural interaction in a living room

Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Touchless gestural interaction with small displays: a case study

Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI
Magnet-Based Around Device Interaction for Playful Music Composition and Gaming

International Journal of Mobile Human Computer Interaction

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper explores how interaction with systems using touchless gestures can be made intuitive and natural. Analysis of 912 video clips of gesture production from a user study of 16 subjects communicating transitive actions (manipulation of objects with or without external tools) indicated that 1) dynamic pantomimic gestures where imagined tool/object is explicitly held are performed more intuitively and easily than gestures where a body part is used to represent the tool/object or compared to static hand poses and 2) gesturing while communicating the transitive action as how the user habitually performs the action (pantomimic action) is perceived to be easier and more natural than gesturing while communicating it as an instruction. These findings provide guidelines for the characteristics of gestures and user mental models one must consciously be concerned with when designing and implementing gesture vocabularies of touchless interaction.