Speaker and digit recognition by audio-visual lip biometrics

  • Authors:
  • Maycel Isaac Faraj;Josef Bigun

  • Affiliations:
  • School of Information Science, Halmstad University, Halmstad;School of Information Science, Halmstad University, Halmstad

  • Venue:
  • ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a new robust bi-modal audio visual digit and speaker recognition system by lip-motion and speech biometrics. To increase the robustness of digit and speaker recognition, we have proposed a method using speaker lip motion information extracted from video sequences with low resolution (128 ×128 pixels). In this paper we investigate a biometric system for digit recognition and speaker identification based using line-motion estimation with speech information and Support Vector Machines. The acoustic and visual features are fused at the feature level showing favourable results with digit recognition being 83% to 100% and speaker recognition 100% on the XM2VTS database.