Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow
IEEE Transactions on Pattern Analysis and Machine Intelligence
Person Identification Using Multiple Cues
IEEE Transactions on Pattern Analysis and Machine Intelligence
Acoustic-labial Speaker Verification
AVBPA '97 Proceedings of the First International Conference on Audio- and Video-Based Biometric Person Authentication
Evaluating Liveness by Face Images and the Structure Tensor
AUTOID '05 Proceedings of the Fourth IEEE Workshop on Automatic Identification Advanced Technologies
Person Verification by Lip-Motion
CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
Audio-visual person authentication using lip-motion from orientation maps
Pattern Recognition Letters
Video based face recognition using multiple classifiers
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
A review of speech-based bimodal recognition
IEEE Transactions on Multimedia
Speaker and digit recognition by audio-visual lip biometrics
ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
| Hi-index | 0.00 |
This paper presents a speaker-independent audio-visual digit recognition system that utilizes speech and visual lip signals. The extracted visual features are based on line-motion estimation obtained from video sequences with low resolution (128 × 128 pixels) to increase the robustness of audio recognition. The core experiments investigate lip motion biometrics as stand-alone as well as merged modality in speech recognition system. It uses Support Vector Machines, showing favourable experimental results with digit recognition featuring 83% to 100% on the XM2VTS database depending on the amount of available visual information.