An imaging system correlating lip shapes with tongue contact patterns for speech pathology research

Authors:
D. J. Lee;Daniel Bates;Christopher Dromey;Xiaoqian Xu;Sameer Antani
Affiliations:
Dept. of Electrical and Comp. Eng., Brigham Young University, Provo, Utah;Dept. of Electrical and Comp. Eng., Brigham Young University, Provo, Utah;Dept. of Audiology and Speech-Language Pathology, Brigham Young University;Dept. of Electrical and Comp. Eng., Brigham Young University, Provo, Utah;National Library of Medicine, Bethesda, Maryland
Venue:
CBMS'03 Proceedings of the 16th IEEE conference on Computer-based medical systems
Year:
2003

Citing 6
Cited 0

An Efficiently Computable Metric for Comparing Polygonal Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape Description and Search for Similar Objects in Image Databases

State-of-the-Art in Content-Based Image and Video Retrieval [Dagstuhl Seminar, 5-10 December 1999]
Audio-Visual Interaction in Multimedia Communication

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1 - Volume 1
Lip Detection and Tracking

ICIAP '01 Proceedings of the 11th International Conference on Image Analysis and Processing
Automatic lipreading to enhance speech recognition (speech reading)

Automatic lipreading to enhance speech recognition (speech reading)
A new optimization procedure for extracting the point-based lip contour using active shape model

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this research, an imaging system was built to work with a newly developed electronic device to help people produce sounds correctly. The system consists of two parts, the internal tongue contact pattern data collection and the external lip shape information analysis. The tongue position information was gathered using the palatometer, an innovative tongue contact pattern-tracking device invented by Dr. Samuel Fletcher. The lip shape information was collected by processing images taken from people articulating different sounds. We developed an efficient color image segmentation technique to extract lip contour points andform a closed curve for shape analysis. The geometry invariant turn function vs. normalized length was then calculated for the lip shape for each sound and compared against the turn function of the lips in a resting position to quantify their variations from this reference. Both internal (vocal tract) and external (visible lip shape) information was collected for each of the speech sounds. The lip shape information extracted from the images was then correlated with tongue position information. The test results showed that this imaging system can be used to quantify the lip shape information and its relations with the tongue position and is a potentially useful tool for speech pathology research.