An interactive braille-recognition system for the visually impaired based on a portable camera

Authors:
Yoshiyuki Mihara;Akihiro Sugimoto;Etsuya Shibayama;Shin Takahashi
Affiliations:
Tokyo Institute of Technology;National Institute of Informatics;Tokyo Institute of Technology;University of Tsukuba
Venue:
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Year:
2005

Citing 2
Cited 1

Wearable interfaces for orientation and wayfinding

Assets '00 Proceedings of the fourth international ACM conference on Assistive technologies
Design and development of an indoor navigation and object identification system for the blind

Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility

Low-cost portable text recognition and speech synthesis with generic laptop computer, digital camera and software

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

We develop an interactive Braille-recognition system using a portable camera for visually impaired persons who cannot read Braille. Our system helps them to find and then push a desired button, as is necessary when using an elevator or a ticket vending machine, for example. It is natural to think that the information provided, in Braille, with specific buttons is sufficient for successful operation in using an elevator or a ticket vending machine. Most visually impaired persons, however, cannot read Braille. To push a desired button, the user needs to hear only the word or letter associated with the specific Braille character so that s/he can correctly relate the buttons to Braille characters. If the user is informed of all the Braille characters in front of her/him, s/he will be unable to relate the buttons to Braille characters. In our system, the user interactively specifies the location of a particular Braille character to be read by using hand gestures. The system recognizes the user's gestures and reads the desired Braille aloud. In our preliminary experiment, six blindfolded subjects were all able to interact with our system, and recognized the meaning of the buttons that s/he identified.