Eye tracking in coloured image scenes represented by ambisonic fields of musical instrument sounds

Authors:
Guido Bologna;Michel Vinckenbosch
Affiliations:
Laboratoire d'Informatique Industrielle, University of Applied Science HES-SO, Geneva, Switzerland;Laboratoire d'Informatique Industrielle, University of Applied Science HES-SO, Geneva, Switzerland
Venue:
IWINAC'05 Proceedings of the First international conference on Mechanisms, Symbols, and Models Underlying Cognition: interplay between natural and artificial computation - Volume Part I
Year:
2005

Citing 1
Cited 7

3-D sound for virtual reality and multimedia

3-D sound for virtual reality and multimedia

Transforming 3D coloured pixels into musical instrument notes for vision substitution applications

Journal on Image and Video Processing
Image and video processing for visually handicapped people

Journal on Image and Video Processing
Identifying Major Components of Pictures by Audio Encoding of Colours

IWINAC '07 Proceedings of the 2nd international work-conference on Nature Inspired Problem-Solving Methods in Knowledge Engineering: Interplay Between Natural and Artificial Computation, Part II
On the use of the auditory pathway to represent image scenes in real-time

Neurocomputing
See ColOr: Seeing Colours with an Orchestra

Human Machine Interaction
Blind Navigation along a Sinuous Path by Means of the See ColOr Interface

IWINAC '09 Proceedings of the 3rd International Work-Conference on The Interplay Between Natural and Artificial Computation: Part II: Bioinspired Applications in Artificial and Natural Computation
Toward local and global perception modules for vision substitution

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present our recent project on visual substitution by Ambisonic 3D-sound fields. Ideally, our system should be used by blind or visually impaired subjects having already seen. The original idea behind our targeted prototype is the use of an eye tracker and musical instrument sounds encoding coloured pixels. The role of the eye tracker is to activate the process of attention inherent in the vision and to restore by simulation the mechanisms of central and peripheral vision. Moreover, we advocate the view that cerebral areas devoted to the integration of information will play a role by rebuilding a global image of the environment. Finally, the role of colour itself is to help subjects distinguishing coloured objects or perceiving textures, such as sky, walls, grass and trees, etc ...