Blind and visually impaired people studying computer science and mathematics
Journal of Microcomputer Applications - Special issue on computers for handicapped people
SpeechSkimmer: interactively skimming recorded speech
UIST '93 Proceedings of the 6th annual ACM symposium on User interface software and technology
LATEX (2nd ed.): a document preparation system: user's guide and reference manual
LATEX (2nd ed.): a document preparation system: user's guide and reference manual
Nonvisual presentation of graphical user interfaces: contrasting two approaches
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Screen Reader/2—programmed access to the GUI
ICCHP '94 Proceedings of the 4th international conference on Computers for handicapped persons
ICCHP '94 Proceedings of the 4th international conference on Computers for handicapped persons
Reading and pointing—new interaction methods for Braille displays
Extra-ordinary human-computer interaction
Audio system for technical readings
Audio system for technical readings
Speech Synthesis: Technology for Disabled People
Speech Synthesis: Technology for Disabled People
The TeXbook
Assets '98 Proceedings of the third international ACM conference on Assistive technologies
The Effective Combination of Haptic and Auditory Textural Information
Proceedings of the First International Workshop on Haptic Human-Computer Interaction
Multimodal geographic information systems: adding haptic and auditory display
Journal of the American Society for Information Science and Technology
Rendering tables in audio: the interaction of structure and reading styles
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Evaluation of a non-visual molecule browser
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
MathPlayer: web-based math accessibility
Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
W4A '06 Proceedings of the 2006 international cross-disciplinary workshop on Web accessibility (W4A): Building the mobile web: rediscovering accessibility?
Lambda:: a multimodal approach to making mathematics accessible to blind students
Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Dual educational electronic textbooks: the starlight platform
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
MathPlayer v2.1: web-based math accessibility
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Introduction to this special issue on multimodal interfaces
Human-Computer Interaction
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
A Flexible Design for Accessible Spoken Math
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
Interactive Sonification of Curve Shape and Curvature Data
HAID '09 Proceedings of the 4th International Conference on Haptic and Audio Interaction Design
Using accessible math textbooks with students who have learning disabilities
Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
The use of non-speech sounds in non-visual interfaces to the MS-Windows GUI for blind computer users
ICAD'98 Proceedings of the 1998 international conference on Auditory Display
Curve shape and curvature perception through interactive sonification
ACM Transactions on Applied Perception (TAP)
Hi-index | 0.00 |
Mathematics relies on visual forms of communication and is thus largely inaccessible to people who cannot communicate in this manner because of visual disabilities. This article outlines the Mathtalk project, which addressed this problem by using computers to produce multimodal renderings of mathematical information. This example is unusual in that it is essential to use multiple modalities because of the nature and the difficulty of the application. In addition, the emphasis is on nonvisual (and hence novel) modalities. Crucial to designing a usable auditory interface to algebra notation is an understanding of the differences between visual and listening reading, particularly those aspects that make the former active and the latter passive. A discussion of these differences yields the twin themes of compensation for lack of external memory and provision of control over information flow. These themes were addressed by: the introduction of prosody to convey algebraic structure in synthetically spoken expressions; the provision of structure-based browsing functions; and the use of a prosody-based musical glance based on algebra earcons. The addition of prosody, when compared to a traditional method of presenting spoken algebra, was experimentally shown to increase the recovery of algebraic structure, enhance the retention of content, and reduce mental workload. These three factors can be said to compensate for the lack of an adequate external memory. Evaluations showed that the browsing functions and associated command language gave the fast and accurate control over information flow that is necessary for active reading. The algebra earcon was experimentally shown to convey the presence, location, and size of algebraic constructs within an expression in a manner that might be used as a rapid glance. Finally, an evaluation of the integrated components showed that the design principles derived from the Mathtalk program can give a more usable, active reading of algebra notation than that possible with traditional methods.