Dynamic programming method for temporal registration of three-dimensional tongue surface motion from multiple utterances

Authors:
Changsheng Yang;Maureen Stone
Affiliations:
Symantec Corporation, 525 Butler Farm Road, Suite 106, Hampton, VA;Department of Oral and Craniofacial Biological Sciences, Department of Orthodontics, University of Maryland Dental School, 666 W. Baltimore St., 5-A-12, Baltimore, MD
Venue:
Speech Communication
Year:
2002

Citing 1
Cited 1

Fundamentals of speech recognition

Fundamentals of speech recognition

Temporal alignment of time varying MRI datasets for high resolution medical visualization

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

This study proposes a new method to reconstruct three-dimensional (3D) tongue surface motion during speech using only a few sections of the tongue measured with ultrasound imaging. Reconstruction of static 3D tongue surfaces has been reported. This is the first report for reconstruction of 3D tongue surface motion using ultrasound imaging. To temporally align data from multiple scan locations, a dynamic programming (DP) algorithm was used to line up the tokens collected from different repetitions by using the acoustic signals recorded simultaneously with the ultrasound images. Reconstruction error was evaluated by using a pseudo-motion measurement of known 3D tongue shapes. The average error was 0.39 mm, which was within the ultrasound measurement error, of 0.5 mm.