Some experiments in audio-visual speech processing

Authors:
G. Chollet;R. Landais;T. Hueber;H. Bredin;C. Mokbel;P. Perrot;L. Zouari
Affiliations:
CNRS LTCI/TSI Paris, Paris Cedex 13, France;CNRS LTCI/TSI Paris, Paris Cedex 13, France;CNRS LTCI/TSI Paris, Paris Cedex 13, France and Laboratoire d'Electronique, ESPCI, Paris, France;CNRS LTCI/TSI Paris, Paris Cedex 13, France;University of Balamand, Tripoli, Lebanon;CNRS LTCI/TSI Paris, Paris Cedex 13, France and Institut de Recherche Criminelle de la Gendarmerie Nationale, Rosny sous bois, France;CNRS LTCI/TSI Paris, Paris Cedex 13, France
Venue:
NOLISP'07 Proceedings of the 2007 international conference on Advances in nonlinear speech processing
Year:
2007

Citing 19
Cited 1

Vector quantization and signal compression

Vector quantization and signal compression
Matrix computations (3rd ed.)

Matrix computations (3rd ed.)
On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Detecting Faces in Images: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
A direct method for stereo correspondence based on singular value decomposition

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Robust Real-Time Face Detection

International Journal of Computer Vision
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A Performance Evaluation of Local Descriptors

IEEE Transactions on Pattern Analysis and Machine Intelligence
A tissue-conductive acoustic sensor applied in speech recognition for privacy

Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies
Handbook of Multibiometrics (International Series on Biometrics)

Handbook of Multibiometrics (International Series on Biometrics)
On the Use of SIFT Features for Face Authentication

CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Scale-space filtering

IJCAI'83 Proceedings of the Eighth international joint conference on Artificial intelligence - Volume 2
A generative framework for real time object detection and classification

Computer Vision and Image Understanding - Special issue on eye detection and tracking
The BANCA database and evaluation protocol

AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Multiple face detection at different resolutions for perceptual user interfaces

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I
Visual model structures and synchrony constraints for audio-visual speech recognition

IEEE Transactions on Audio, Speech, and Language Processing
Audio-visual speech modeling for continuous speech recognition

IEEE Transactions on Multimedia
Statistical multimodal integration for audio-visual speech processing

IEEE Transactions on Neural Networks

Multimodal Human Machine Interactions in Virtual and Augmented Reality

Multimodal Signals: Cognitive and Algorithmic Issues

Quantified Score

Hi-index	0.00

Visualization

Abstract

Natural speech is produced by the vocal organs of a particular talker. The acoustic features of the speech signal must therefore be correlated with the movements of the articulators (lips, jaw, tongue, velum, ...). For instance, hearing impaired people (and not only them) improve their understanding of speech by lip reading. This chapter is an overview of audiovisual speech processing with emphasis on some experiments concerning recognition, speaker verification, indexing and corpus based synthesis from tongue and lips movements.