Longitudinal study of people learning to use continuous voice-based cursor control

Authors:
Susumu Harada;Jacob O. Wobbrock;Jonathan Malkin;Jeff A. Bilmes;James A. Landay
Affiliations:
University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA;University of Washington, Seattle, WA, USA
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2009

Citing 12
Cited 11

Beyond Fitts' law: models for trajectory-based HCI tasks

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Voice as sound: using non-verbal voice input for interactive control

Proceedings of the 14th annual ACM symposium on User interface software and technology
Physical disabilities and computing technologies: an analysis of impairments

The human-computer interaction handbook
Speech-based cursor control: a study of grid-based solutions

Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Acoustic control of mouse pointer

Universal Access in the Information Society
The vocal joystick:: evaluation of voice-based cursor control techniques

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick: a voice-based human-computer interface for individuals with motor impairments

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Voicedraw: a hands-free voice-driven drawing application for people with motor impairments

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
VoicePen: augmenting pen input with simultaneous non-linguisitic vocalization

Proceedings of the 9th international conference on Multimodal interfaces
The VoiceBot: a voice controlled robot arm

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative longitudinal study of non-verbal mouse pointer

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II

The VoiceBot: a voice controlled robot arm

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An approach based on multiple text input modes for interactive digital TV applications

Proceedings of the 28th ACM International Conference on Design of Communication
The Vocal Joystick Engine v1.0

Computer Speech and Language
On the audio representation of radial direction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Voice games: investigation into the use of non-speech voice input for making computer games more accessible

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I
Mining patterns from longitudinal studies

ADMA'11 Proceedings of the 7th international conference on Advanced Data Mining and Applications - Volume Part II
Programming by voice: a hands-free approach for motorically challenged children

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Directing robot motions with paralinguistic information

Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Automation of VUIto GUI mapping

CHI '13 Extended Abstracts on Human Factors in Computing Systems
Voice augmented manipulation: using paralinguistic information to manipulate mobile devices

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
How someone with a neuromuscular disease experiences operating a PC (and how to successfully counteract that)

Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

Quantified Score

Hi-index	0.01

Visualization

Abstract

We conducted a 2.5 week longitudinal study with five motor impaired (MI) and four non-impaired (NMI) participants, in which they learned to use the Vocal Joystick, a voice-based user interface control system. We found that the participants were able to learn the mapping between the vowel sounds and directions used by the Vocal Joystick, and showed marked improvement in their target acquisition performance. At the end of the ten session period, the NMI group reached the same level of performance as the previously measured "expert" Vocal Joystick performance, and the MI group was able to reach 70% of that level. Two of the MI participants were also able to approach the performance of their preferred device, a touchpad. We report on a number of issues that can inform the development of further enhancements in the realm of voice-driven computer control.