CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users

Authors:
Huiying Shen;Owen Edwards;Joshua Miele;James M. Coughlan
Affiliations:
The Smith-Kettlewell Eye Research Institute, San Francisco, CA;The Smith-Kettlewell Eye Research Institute, San Francisco, CA;The Smith-Kettlewell Eye Research Institute, San Francisco, CA;The Smith-Kettlewell Eye Research Institute, San Francisco, CA
Venue:
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
Year:
2013

Citing 3
Cited 0

Going Places with "KnowWare": Virtual Reality Maps for Blind People

ICCHP '02 Proceedings of the 8th International Conference on Computers Helping People with Special Needs
Computer Vision: Algorithms and Applications

Computer Vision: Algorithms and Applications
Access lens: a gesture-based screen reader for real-world documents

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

CamIO (short for "Camera Input-Output") is a novel camera system designed to make physical objects (such as documents, maps, devices and 3D models) fully accessible to blind and visually impaired persons, by providing real-time audio feedback in response to the location on an object that the user is pointing to. The project will have wide ranging impact on access to graphics, tactile literacy, STEM education, independent travel and wayfinding, access to devices, and other applications to increase the independent functioning of blind, low vision and deaf-blind individuals. We describe our preliminary results with a prototype CamIO system consisting of the Microsoft Kinect camera connected to a laptop computer. An experiment with a blind user demonstrates the feasibility of the system, which issues Text-to-Speech (TTS) annotations whenever the user's fingers approach any pre-defined "hotspot" regions on the object.