Visual perception substitution by the auditory sense

Authors:
Brian David Cano Martínez;Osslan Osiris Vergara Villegas;Vianey Guadalupe Cruz Sánchez;Humberto De Jesús Ochoa Domínguez;Leticia Ortega Maynez
Affiliations:
Universidad Autónoma de Ciudad Juárez, Departamento de Ingeniería Industrial y Manufactura, Ciudad Juárez, Chihuahua, México;Universidad Autónoma de Ciudad Juárez, Departamento de Ingeniería Industrial y Manufactura, Ciudad Juárez, Chihuahua, México;Universidad Autónoma de Ciudad Juárez, Departamento de Ingeniería Eléctrica y Computación, Ciudad Juárez, Chihuahua, México;Universidad Autónoma de Ciudad Juárez, Departamento de Ingeniería Eléctrica y Computación, Ciudad Juárez, Chihuahua, México;Universidad Autónoma de Ciudad Juárez, Departamento de Ingeniería Eléctrica y Computación, Ciudad Juárez, Chihuahua, México
Venue:
ICCSA'11 Proceedings of the 2011 international conference on Computational science and its applications - Volume Part II
Year:
2011

Citing 4
Cited 0

Mobility interfaces for the visually impaired: what's missing?

Proceedings of the 8th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI
Preserving visual information in low resolution images during navigation of visually impaired

Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
On the use of the auditory pathway to represent image scenes in real-time

Neurocomputing
Interactive sonification of complex data

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the methodology to develop a sensory substitution system. We deal with the absence of visual inputs in humans, and we substitute the blindness by the auditory sense. Visual to auditory substitution involves delivering information about the visual world using auditory signals. The system allows the transformation of digital images captured from a web cam into sound patterns, using a novel scanning method from the center to the left and right side of the image. We define a robust correspondence between the image features and the sound features. The results provided by the system seems high enough to address many practical situations that normally require the sense of sight. Navigation experiments with blind people, have demonstrated the ability of the system to offer a permanent sensory substitution device in the future.