Improving computer vision-based indoor wayfinding for blind persons with context information

  • Authors:

  • YingLi Tian;Chucai Yi;Aries Arditi

  • Affiliations:

  • Electrical Engineering Department, The City College and Graduate Center, City University of New York, New York, NY;Electrical Engineering Department, The City College and Graduate Center, City University of New York, New York, NY;Arlene R Gordon Research Institute, Lighthouse International, New York, NY

  • Venue:
  • ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

There are more than 161 million visually impaired people in the world today, of which 37 million are blind. Camera-based computer vision systems have the potential to assist blind persons to independently access unfamiliar buildings. Signs with text play a very important role in identification of bathrooms, exits, office doors, and elevators. In this paper, we present an effective and robust method of text extraction and recognition to improve computer vision-based indoor wayfinding. First, we extract regions containing text information from indoor signage with multiple colors and complex background and then identify text characters in the extracted regions by using the features of size, aspect ratio and nested edge boundaries. Based on the consistence of distances between two neighboring characters in a text string, the identified text characters have been normalized before they are recognized by using off-the-shelf optical character recognition (OCR) software products and output as speech for blind users.