Embodied interactions with audio-tactile virtual objects in AHNE

Authors:
Koray Tahiroğlu;Johan Kildal;Teemu Ahmaniemi;Simon Overstall;Valtteri Wikström
Affiliations:
School of Arts, Design and Architecture, Aalto University, Aalto, Finland;Nokia Group, Nokia Research Center, Finland;Nokia Group, Nokia Research Center, Finland;School of Arts, Design and Architecture, Aalto University, Aalto, Finland;School of Arts, Design and Architecture, Aalto University, Aalto, Finland
Venue:
HAID'12 Proceedings of the 7th international conference on Haptic and Audio Interaction Design
Year:
2012

Citing 6
Cited 1

Recent Advances in Augmented Reality

IEEE Computer Graphics and Applications
Map navigation with mobile devices: virtual versus physical movement with and without visual context

Proceedings of the 9th international conference on Multimodal interfaces
HEMP-hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis

International Journal of Human-Computer Studies
3D-press: haptic illusion of compliance when pressing on a rigid surface

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Perceived physicality in audio-enhanced force input

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
AHNE: a novel interface for spatial interaction

CHI '12 Extended Abstracts on Human Factors in Computing Systems

User experience and usage scenarios of audio-tactile interaction with virtual objects in a physical environment

Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

Interactive virtual environments are often focused on visual representation. This study introduces embodied and eyes-free interaction with audio-haptic navigation environment (AHNE) in a 3-dimensional space. AHNE is based on an optical tracking algorithm that makes use of Microsoft-Kinect and virtual objects are presented by dynamic audio-tactile cues. Users are allowed to grab and move the targets, enabled by a sensor located in a glove. To evaluate AHNE with users, an experiment was conducted. Users' comments indicated that sound cues elicited physical and visual experiences. Our findings suggest that AHNE could be a novel and fun interface to everyday resources in the environment such as a home audio system in the living room or a shopping list by fridge.