Audiovisual tools for phonetic and articulatory visualization in computer-aided pronunciation training

Authors:
Bernd J. Kröger;Peter Birkholz;Rüdiger Hoffmann;Helen Meng
Affiliations:
Department of Phoniatrics, Pedaudiology, and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Aachen, Germany;Department of Phoniatrics, Pedaudiology, and Communication Disorders, University Hospital Aachen and RWTH Aachen University, Aachen, Germany;Department of Acoustics and Speech Communication, Dresden University of Technology, Dresden, Germany;Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong (CUHK), Shatin, NT, Hong Kong SAR of China
Venue:
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Year:
2009

Citing 4
Cited 0

A computer-animated tutor for spoken and written language learning

Proceedings of the 5th international conference on Multimodal interfaces
Towards a neurocomputational model of speech production and perception

Speech Communication
A gesture-based concept for speech movement control in articulatory speech synthesis

COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Pronunciation learning and foreign accent reduction by an audiovisual feedback system

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper reviews interactive methods for improving the phonetic competence of subjects in the case of second language learning as well as in the case of speech therapy for subjects suffering from hearing-impairments or articulation disorders. As an example our audiovisual feedback software “SpeechTrainer” for improving the pronunciation quality of Standard German by visually highlighting acoustics-related and articulation-related sound features will be introduced here. Results from literature on training methods as well as the results concerning our own software indicate that audiovisual tools for phonetic and articulatory visualization are beneficial for computer-aided pronunciation training environments.