Voice as sound: using non-verbal voice input for interactive control

Authors:
Takeo Igarashi;John F. Hughes
Affiliations:
Brown University, Providence, RI;Brown University, Providence, RI
Venue:
Proceedings of the 14th annual ACM symposium on User interface software and technology
Year:
2001

Citing 4
Cited 52

Speed-dependent automatic zooming for browsing large documents

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Responding to subtle, fleeting changes in the user's internal state

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An Intelligent Interface for Keyboard and Mouse Control -- Providing Full Access to PC Functionality via Speech

Proceedings of the Fourteenth International Florida Artificial Intelligence Research Society Conference
Prosodic word boundary detection using statistical modeling of moraic fundamental frequency contours and its use for continuous speech recognition

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 01

Interaction techniques using prosodic features of speech and audio localization

Proceedings of the 10th international conference on Intelligent user interfaces
The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Supporting interspecies social awareness: using peripheral displays for distributed pack awareness

Proceedings of the 18th annual ACM symposium on User interface software and technology
The vocal joystick:: evaluation of voice-based cursor control techniques

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Non-speech input and speech recognition for real-time control of computer games

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
The vocal joystick: a voice-based human-computer interface for individuals with motor impairments

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Longitudinal study of continuous non-speech operated mouse pointer

CHI '07 Extended Abstracts on Human Factors in Computing Systems
Striking a c[h]ord: vocal interaction in assistive technologies, games, and more

CHI '07 Extended Abstracts on Human Factors in Computing Systems
The drive to create: an investigation of tools to support disabled artists

Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition
Blui: low-cost localized blowable user interfaces

Proceedings of the 20th annual ACM symposium on User interface software and technology
Voicedraw: a hands-free voice-driven drawing application for people with motor impairments

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
VoicePen: augmenting pen input with simultaneous non-linguisitic vocalization

Proceedings of the 9th international conference on Multimodal interfaces
Musical interaction in computer games

Future Play '07 Proceedings of the 2007 conference on Future Play
Audio interaction in computer mediated games

International Journal of Computer Games Technology
Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data

ACM Transactions on Computer-Human Interaction (TOCHI)
Lean and zoom: proximity-aware user interface and content magnification

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Mixed-initiative dialog management for speech-based interaction with graphical user interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Vocal interaction

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Vocal control of a radio-controlled car

ACM SIGACCESS Accessibility and Computing
Design of installation with interactive UAVs

ACE '08 Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology
Voice art: a novel mode for creating visual art

Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat
The VoiceBot: a voice controlled robot arm

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Longitudinal study of people learning to use continuous voice-based cursor control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Voice art: investigating paralinguistic voice as a mode of interaction to create visual art

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2
Pitch in non-verbal vocal input

ACM SIGACCESS Accessibility and Computing
Multi-modal Interface in Multi-Display Environment for Multi-users

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Compensate the Speech Recognition Delays for Accurate Speech-Based Cursor Position Control

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Designing Interactive Blimps as Puppets

ICEC '09 Proceedings of the 8th International Conference on Entertainment Computing
Target acquisition by a hands-free wireless tilt mouse

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
A comparative longitudinal study of non-verbal mouse pointer

INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
A system for hybrid vision- and sound-based interaction with distal and proximal targets on wall-sized, high-resolution tiled displays

HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction
Investigating Grid-Based Navigation: The Impact of Physical Disability

ACM Transactions on Accessible Computing (TACCESS)
Blinkbot: look at, blink and move

UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Design and evaluation of a non-verbal voice-controlled cursor for point-and-click tasks

Proceedings of the 4th International Convention on Rehabilitation Engineering & Assistive Technology
Understanding formal description of pitch-based input

HCSE'10 Proceedings of the Third international conference on Human-centred software engineering
The Vocal Joystick Engine v1.0

Computer Speech and Language
Motionbeam: a metaphor for character interaction with handheld projectors

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHANTI: predictive text entry using non-verbal vocal input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Voice games: investigation into the use of non-speech voice input for making computer games more accessible

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I
A tongue input device for creating conversations

Proceedings of the 24th annual ACM symposium on User interface software and technology
Humsher: a predictive keyboard operated by humming

The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Explicative document reading controlled by non-speech audio gestures

TSD'06 Proceedings of the 9th international conference on Text, Speech and Dialogue
AmbientBrowser: web browser in everyday life

Ambient Intelligence in Everyday Life
Emerging Input Technologies for Always-Available Mobile Interaction

Foundations and Trends in Human-Computer Interaction
PalmRC: imaginary palm-based remote control for eyes-free television interaction

Proceedings of the 10th European conference on Interactive tv and video
A set of recommendations for the control of IPTV-systems via smart phones based on the understanding of users practices and needs

Proceedings of the 10th European conference on Interactive tv and video
Measuring performance of a predictive keyboard operated by humming

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part II
Directing robot motions with paralinguistic information

Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Voice augmented manipulation: using paralinguistic information to manipulate mobile devices

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Desktop access with non-verbal sound input

i-CREATe '11 Proceedings of the 5th International Conference on Rehabilitation Engineering & Assistive Technology
Hierarchical route maps for efficient navigation

Proceedings of the 19th international conference on Intelligent User Interfaces
On the role of auditory feedback in robot-assisted movement training after stroke: review of the literature

Computational Intelligence and Neuroscience

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe the use of non-verbal features in voice for direct control of interactive applications. Traditional speech recognition interfaces are based on an indirect, conversational model. First the user gives a direction and then the system performs certain operation. Our goal is to achieve more direct, immediate interaction like using a button or joystick by using lower-level features of voice such as pitch and volume. We are developing several prototype interaction techniques based on this idea, such as "control by continuous voice", "rate-based parameter control by pitch," and "discrete parameter control by tonguing." We have implemented several prototype systems, and they suggest that voice-as-sound techniques can enhance traditional voice recognition approach.