Multimodal kinect-supported interaction for visually impaired users

Authors:
Richard Gross;Ulrich Bockholt;Ernst W. Biersack;Arjan Kuijper
Affiliations:
Graphical-Interactive Systems Group, TU Darmstadt, Darmstadt, Germany;Fraunhofer IGD, Darmstadt, Germany;Eurécom, Sophia Antipolis, France;Graphical-Interactive Systems Group, TU Darmstadt, Darmstadt, Germany,Fraunhofer IGD, Darmstadt, Germany
Venue:
UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: design methods, tools, and interaction techniques for eInclusion - Volume Part I
Year:
2013

Citing 11
Cited 0

Improving the usability of speech-based interfaces for blind users

Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
Skinput: appropriating the body as an input surface

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Accessible Multimodal Media Center Application for Blind and Partially Sighted People
Evaluating natural interaction techniques in video games

3DUI '10 Proceedings of the 2010 IEEE Symposium on 3D User Interfaces
Blind navigation with a wearable range camera and vibrotactile helmet

MM '11 Proceedings of the 19th ACM international conference on Multimedia
On-body interaction: armed and dangerous

Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
Real-time sensory substitution to enable players who are blind to play video games using whole body gestures

Proceedings of the 6th International Conference on Foundations of Digital Games
Full-body motion-based game interaction for older adults

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Performance measurements for the Microsoft Kinect skeleton

VR '12 Proceedings of the 2012 IEEE Virtual Reality
Visual Support System for Selecting Reactive Elements in Intelligent Environments

CW '12 Proceedings of the 2012 International Conference on Cyberworlds
Fusing Real-Time Depth Imaging with High Precision Pose Estimation by a Measurement Arm

CW '12 Proceedings of the 2012 International Conference on Cyberworlds

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses Kreader, a proof-of-concept for a new interface for blind or visually impaired users to have text read to them. We use the Kinect device to track the users body. All feedback is presented with auditory cues, while a minimal visual interface can be turned on optionally. Interface elements are organized in a list manner and placed ego-centric, in relation to the user's body. Moving around in the room does not change the element's location. Hence visually impaired users can utilize their "body-sense" to find elements. Two test sessions were used to evaluate Kreader. We think the results are encouraging and provide a solid foundation for future research into such an interface, that can be navigated by sighted and visually impaired users.