A gesture-based concept for speech movement control in articulatory speech synthesis

Authors:
Bernd J. Kröger;Peter Birkholz
Affiliations:
Department of Phoniatrics, Pedaudiology and Communication Disorders, University Hospital Aachen and Aachen University, Aachen, Germany;Institute for Computer Science, University of Rostock, Rostock, Germany
Venue:
COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Year:
2007

Citing 4
Cited 7

Laws for lips

Speech Communication
Speech motor control: acoustic goals, saturation effects, auditory feedback and internal models

Speech Communication - Special issue on speech production: models and data
Motor primitive and sequence self-organization in a hierarchical recurrent neural network

Neural Networks - 2004 Special issue: New developments in self-organizing systems
Simulation of Losses Due to Turbulence in the Time-Varying Vocal System

IEEE Transactions on Audio, Speech, and Language Processing

The Organization of a Neurocomputational Control Model for Articulatory Speech Synthesis

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Articulatory Synthesis of Speech and Singing: State of the Art and Suggestions for Future Research

Multimodal Signals: Cognitive and Algorithmic Issues
Towards a neurocomputational model of speech production and perception

Speech Communication
Categorical perception of consonants and vowels: evidence from a neurophonetic model of speech production and perception

Proceedings of the Third COST 2102 international training school conference on Toward autonomous, adaptive, and context-aware multimodal interfaces: theoretical and practical issues
Audiovisual tools for phonetic and articulatory visualization in computer-aided pronunciation training

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Gesture duration and articulator velocity in plosive-vowel-transitions

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
The neurophonetic model of speech processing ACT: structure, knowledge acquisition, and function modes

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

An articulatory speech synthesizer comprising a three-dimensional vocal tract model and a gesture-based concept for control of articulatory movements is introduced and discussed in this paper. A modular learning concept based on speech perception is outlined for the creation of gestural control rules. The learning concept includes on sensory feedback information for articulatory states produced by the model itself, and auditory and visual information of speech items produced by external speakers. The complete model (control module and synthesizer) is capable of producing high-quality synthetic speech signals and introduces a scheme for the natural speech production and speech perception processes.