Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
An iterative image registration technique with an application to stereo vision
IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
Low cost blur image detection and estimation for mobile devices
ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3
VizWiz: nearly real-time answers to visual questions
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
EasySnap: real-time audio feedback for blind photography
UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Anti-blur feedback for visually impaired users of smartphone cameras
Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
An assisted photography method for street scenes
WACV '11 Proceedings of the 2011 IEEE Workshop on Applications of Computer Vision (WACV)
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Helping visually impaired users properly aim a camera
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Investigating the appropriateness of social network question asking as a resource for blind users
Proceedings of the 2013 conference on Computer supported cooperative work
Visual challenges in the everyday lives of blind people
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Accessible photo album: enhancing the photo sharing experience for people with visual impairment
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.00 |
Computer vision and human-powered services can provide blind people access to visual information in the world around them, but their efficacy is dependent on high-quality photo inputs. Blind people often have difficulty capturing the information necessary for these applications to work because they cannot see what they are taking a picture of. In this paper, we present Scan Search, a mobile application that offers a new way for blind people to take high-quality photos to support recognition tasks. To support realtime scanning of objects, we developed a key frame extraction algorithm that automatically retrieves high-quality frames from continuous camera video stream of mobile phones. Those key frames are streamed to a cloud-based recognition engine that identifies the most significant object inside the picture. This way, blind users can scan for objects of interest and hear potential results in real time. We also present a study exploring the tradeoffs in how many photos are sent, and conduct a user study with 8 blind participants that compares Scan Search with a standard photo-snapping interface. Our results show that Scan Search allows users to capture objects of interest more efficiently and is preferred by users to the standard interface.