A Computational Approach to Edge Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence
Hybrid Approach to Sonification of Color Images
ICCIT '08 Proceedings of the 2008 Third International Conference on Convergence and Hybrid Information Technology - Volume 02
Timbremap: enabling the visually-impaired to use maps on touch-enabled devices
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
VizWiz: nearly real-time answers to visual questions
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Cognitive load and usability analysis of R-MAP for the people who are blind or visual impaired
Proceedings of the 29th ACM international conference on Design of communication
Audemes at work: Investigating features of non-speech sounds to maximize content recognition
International Journal of Human-Computer Studies
Sonification of images for the visually impaired using a multi-level approach
Proceedings of the 4th Augmented Human International Conference
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
| Hi-index | 0.00 |
We propose a framework to aid a visually impaired user to recognize objects in an image by sonifying image edge features and distance-to-edge maps. Visually impaired people usually touch objects to recognize their shape. However, it is difficult to recognize objects printed on flat surfaces or objects that can only be viewed from a distance, solely with our haptic senses. Our ultimate goal is to aid a visually impaired user to recognize basic object shapes, by transposing them to aural information. Our proposed method provides two types of image sonification: (1) local edge gradient sonification and (2) sonification of the distance to the closest image edge. Our method was implemented on a touch-panel mobile device, which allows the user to aurally explore image context by sliding his finger across the image on the touch screen. Preliminary experiments show that the combination of local edge gradient sonification and distance-to-edge sonification are effective for understanding basic line drawings. Furthermore, our tests show a significant improvement in image understanding with the introduction of proper user training.