Speech-based cursor control: a study of grid-based solutions

Authors:
Liwei Dai;Rich Goldman;Andrew Sears;Jeremy Lozier
Affiliations:
UMBC, Baltimore, MD;UMBC, Baltimore, MD;UMBC, Baltimore, MD;University of Southern Maine, Portland, ME
Venue:
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Year:
2003

Citing 10
Cited 17

SUITEKeys: a speech understanding interface for the motor-control challenged

Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Taming recognition errors with a multimodal interface

Communications of the ACM
A study of blind drawing practice: creating graphical information without the visual channel

Assets '00 Proceedings of the fourth international ACM conference on Assistive technologies
A comparison of voice controlled and mouse controlled web browsing

Assets '00 Proceedings of the fourth international ACM conference on Assistive technologies
Multimodal error correction for speech user interfaces

ACM Transactions on Computer-Human Interaction (TOCHI)
The integrated communication 2 draw (IC2D): a drawing program for the visually impaired

CHI '99 Extended Abstracts on Human Factors in Computing Systems
Sketching images eyes-free: a grid-based dynamic drawing tool for the blind

Proceedings of the fifth international ACM conference on Assistive technologies
Speech-based cursor control

Proceedings of the fifth international ACM conference on Assistive technologies
Multimodal interactive maps: designing for human performance

Human-Computer Interaction
Hands-free, speech-based navigation during dictation: difficulties, consequences, and solutions

Human-Computer Interaction

The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Dynamically adapting GUIs to diverse input devices

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick:: evaluation of voice-based cursor control techniques

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Non-speech input and speech recognition for real-time control of computer games

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Voicedraw: a hands-free voice-driven drawing application for people with motor impairments

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Mixed-initiative dialog management for speech-based interaction with graphical user interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sudoku access: a sudoku game for people with motor disabilities

Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Longitudinal study of people learning to use continuous voice-based cursor control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Compensate the Speech Recognition Delays for Accurate Speech-Based Cursor Position Control

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Speech-Based Navigation: Improving Grid-Based Solutions

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
A comparative longitudinal study of non-verbal mouse pointer

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Design and evaluation of a non-verbal voice-controlled cursor for point-and-click tasks

Proceedings of the 4th International Convention on Rehabilitation Engineering & Assistive Technology
The Vocal Joystick Engine v1.0

Computer Speech and Language
Automation of VUIto GUI mapping

CHI '13 Extended Abstracts on Human Factors in Computing Systems
Voice augmented manipulation: using paralinguistic information to manipulate mobile devices

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Desktop access with non-verbal sound input

i-CREATe '11 Proceedings of the 5th International Conference on Rehabilitation Engineering & Assistive Technology
WebSight: the use of the grid-based interface to convey layout of web-pages in a non-visual environment

UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: user and context diversity - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

Speech recognition can be a powerful tool for use in human-computer interaction. Many researchers are investigating the use of speech recognition systems for dictation-based activities, resulting in dramatic improvements in recent years. However, this same experimentation has confirmed that recognition errors and the delays inherent with speech recognition result in unacceptably long task completion times and error rates for cursor control tasks. This study explores the potential of a speech-controlled grid-based cursor control mechanism. An experiment evaluated two alternative grid-based solutions, both using 3-3 grids. One provided a single cursor in the middle of the grid. The second allows users to select a target using any of nine cursors. The results confirm that the nine-cursor solution allowed users to select targets of varying size, distance and direction significantly faster than the one-cursor solution. Overall results are encouraging when compared to earlier evaluations of other speech-based cursor control solutions.