Access lens: a gesture-based screen reader for real-world documents

Authors:
Shaun K. Kane;Brian Frey;Jacob O. Wobbrock
Affiliations:
University of Maryland, Baltimore County, Baltimore, Maryland, USA;University of Maryland, Baltimore County, Baltimore, Maryland, USA;University of Washington, Seattle, Washington, USA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2013

Citing 7
Cited 1

Interacting with paper on the DigitalDesk

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Bonfire: a nomadic system for hybrid laptop-tabletop interaction

Proceedings of the 22nd annual ACM symposium on User interface software and technology
VizWiz: nearly real-time answers to visual questions

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
EasySnap: real-time audio feedback for blind photography

UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Access overlays: improving non-visual access to large touch screens for blind users

Proceedings of the 24th annual ACM symposium on User interface software and technology
EyeRing: a finger-worn assistant

CHI '12 Extended Abstracts on Human Factors in Computing Systems

CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users

Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

Quantified Score

Hi-index	0.01

Visualization

Abstract

Gesture-based touch screen user interfaces, when designed to be accessible to blind users, can be an effective mode of interaction for those users. However, current accessible touch screen interaction techniques suffer from one serious limitation: they are only usable on devices that have been explicitly designed to support them. Access Lens is a new interaction method that uses computer vision-based gesture tracking to enable blind people to use accessible gestures on paper documents and other physical objects, such as product packages, device screens, and home appliances. This paper describes the development of Access Lens hardware and software, the iterative design of Access Lens in collaboration with blind computer users, and opportunities for future development.