Integration of face detection and user identification with visual speech recognition

Authors:
Alaa Sagheer;Saleh Aly
Affiliations:
Center for Artificial Intelligence and Robotics (CAIRO), Egypt,Department of Mathematics, Faculty of Science, Aswan University, Aswan, Egypt;Center for Artificial Intelligence and Robotics (CAIRO), Egypt,Department of Electrical Engineering, Faculty of Engineering, Aswan University, Egypt
Venue:
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V
Year:
2012

Citing 14
Cited 0

Speechreading using probabilistic models

Computer Vision and Image Understanding - Special issue on physics-based modeling and reasoning in computer vision
Extraction of Visual Features for Lipreading

IEEE Transactions on Pattern Analysis and Machine Intelligence
Self-Organizing Maps

Self-Organizing Maps
Robust Real-Time Face Detection

International Journal of Computer Vision
On-Road Vehicle Detection: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multimodal speaker/speech recognition using lip motion, lip texture and audio

Signal Processing - Special section: Multimodal human-computer interfaces
Audio-visual speech processing: progress and challenges

VisHCI '06 Proceedings of the HCSNet workshop on Use of vision in human-computer interaction - Volume 56
Top 10 algorithms in data mining

Knowledge and Information Systems
Service personalization for assistive living in a mobile ambient healthcare-networked environment

Personal and Ubiquitous Computing
Real-time lip reading system for isolated Korean word recognition

Pattern Recognition
Lip reading of hearing impaired persons using HMM

Expert Systems with Applications: An International Journal
Visual model structures and synchrony constraints for audio-visual speech recognition

IEEE Transactions on Audio, Speech, and Language Processing
Audio-visual speech modeling for continuous speech recognition

IEEE Transactions on Multimedia
The condensed nearest neighbor rule (Corresp.)

IEEE Transactions on Information Theory

Quantified Score

Hi-index	0.00

Visualization

Abstract

The use of visual features to help acoustic speech recognition (ASR) is an appropriate tool to enhance ASR. In this paper, we propose a novel system integrates face detection, user identification and visual speech recognition. Here we use the self organizing map to achieve visual features extraction. Then, the extracted features are recognized using K-nearest neighbor classifier. Experimental results, using a database includes Arabic digits, show that the proposed system is promising and effectively comparable with other reported systems.