A novel multimodal interface for improving visually impaired people’s web accessibility

Authors:
Wai Yu;Ravi Kuber;Emma Murphy;Philip Strain;Graham McAllister
Affiliations:
Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK;Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK;Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK;Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK;Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK
Venue:
Virtual Reality
Year:
2006

Citing 0
Cited 14

Developing an assistive haptic framework for improving non-visual access to the web

ACM SIGACCESS Accessibility and Computing
Towards developing assistive haptic feedback for visually impaired internet users

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A grid-based extension to an assistive multimodal interface

CHI '07 Extended Abstracts on Human Factors in Computing Systems
The design and evaluation of an assistive multimodal interface

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2
Recognizing shapes and gestures using sound as feedback

CHI '10 Extended Abstracts on Human Factors in Computing Systems
A non-visual approach to improving collaboration between blind and sighted internet users

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: applications and services
Evaluation of Haptic HTML Mappings Derived from a Novel Methodology

ACM Transactions on Accessible Computing (TACCESS)
Identifying the effectiveness of using three different haptic devices for providing non-visual access to the web

Interacting with Computers
A semiotic approach to the design of non-speech sounds

HAID'06 Proceedings of the First international conference on Haptic and Audio Interaction Design
Developing multimodal web interfaces by encapsulating their content and functionality within a multimodal shell

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
A framework for the development of haptic-enhanced web applications

ICWE'12 Proceedings of the 12th international conference on Web Engineering
Designing interactive content with blind users for a perceptual supplementation system

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
Proxy Service to Contextualize Web Browsing for the Visually Impaired

Proceedings of International Conference on Information Integration and Web-based Applications & Services
A tangible information explorer using vibratory touch screen

Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a novel interface designed to help blind and visually impaired people to explore and navigate on the Web. In contrast to traditionally used assistive tools, such as screen readers and magnifiers, the new interface employs a combination of both audio and haptic features to provide spatial and navigational information to users. The haptic features are presented via a low-cost force feedback mouse allowing blind people to interact with the Web, in a similar fashion to their sighted counterparts. The audio provides navigational and textual information through the use of non-speech sounds and synthesised speech. Interacting with the multimodal interface offers a novel experience to target users, especially to those with total blindness. A series of experiments have been conducted to ascertain the usability of the interface and compare its performance to that of a traditional screen reader. Results have shown the advantages that the new multimodal interface offers blind and visually impaired people. This includes the enhanced perception of the spatial layout of Web pages, and navigation towards elements on a page. Certain issues regarding the design of the haptic and audio features raised in the evaluation are discussed and presented in terms of recommendations for future work.