The Vocal Joystick Engine v1.0

Authors:
Jonathan Malkin;Xiao Li;Susumu Harada;James Landay;Jeff Bilmes
Affiliations:
Department of Electrical Engineering, Campus Box 352500, University of Washington, Seattle, WA 98125, USA;Department of Electrical Engineering, Campus Box 352500, University of Washington, Seattle, WA 98125, USA;DUB Group and Department of Computer Science and Engineering, Paul Allen Center, University of Washington, Seattle, WA 98195, USA;DUB Group and Department of Computer Science and Engineering, Paul Allen Center, University of Washington, Seattle, WA 98195, USA;Department of Electrical Engineering, Campus Box 352500, University of Washington, Seattle, WA 98125, USA
Venue:
Computer Speech and Language
Year:
2011

Citing 15
Cited 2

Powermice and user performance

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Optimizing matrix multiply using PHiPAC: a portable, high-performance, ANSI C coding methodology

ICS '97 Proceedings of the 11th international conference on Supercomputing
Voice as sound: using non-verbal voice input for interactive control

Proceedings of the 14th annual ACM symposium on User interface software and technology
A Voice Device with an Application-Adapted Protocol for Microsoft Windows

ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
Speech-based cursor control: a study of grid-based solutions

Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Noise robustness in automatic speech recognition

Noise robustness in automatic speech recognition
The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick:: evaluation of voice-based cursor control techniques

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick: a voice-based human-computer interface for individuals with motor impairments

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Voicedraw: a hands-free voice-driven drawing application for people with motor impairments

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Demo of VJ-Voicebot: control of robotic arm with the Vocal Joystick

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Regularized adaptation: theory, algorithms and applications

Regularized adaptation: theory, algorithms and applications
The VoiceBot: a voice controlled robot arm

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Longitudinal study of people learning to use continuous voice-based cursor control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multi-layer ratio Semi-Definite Classifiers

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing

On the audio representation of radial direction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Voice games: investigation into the use of non-speech voice input for making computer games more accessible

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present the Vocal Joystick engine, a real-time software library which can be used to map non-linguistic vocalizations into realizable continuous control signals. The system is designed to strike a balance between low latency and accurate recognition while simultaneously taking advantage of the rich complexity of sounds producible by the human vocal tract. By developing a modular, cross-platform library, we aim to provide a robust but simple means of incorporating such controls into any application, thereby producing a new form of accessible technology. This is demonstrated by the various applications that so far have used the Vocal Joystick engine. Unlike previous discussions of parts of the Vocal Joystick, this paper presents a detailed view of the inner workings of the current version of the engine.