Audio-visual multimodal fusion for biometric person authentication and liveness verification

Authors:
Girija Chetty;Michael Wagner
Affiliations:
Human Computer Communication Laboratory, School of Information Sciences and Engineering, University of Canberra, Australia;Human Computer Communication Laboratory, School of Information Sciences and Engineering, University of Canberra, Australia
Venue:
MMUI '05 Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop - Volume 57
Year:
2006

Citing 5
Cited 4

Quantitative association of vocal-tract and facial behavior

Speech Communication - Special issue on auditory-visual speech processing
Hybrid Biometric Person Authentication Using Face and Voice Features

AVBPA '01 Proceedings of the Third International Conference on Audio- and Video-Based Biometric Person Authentication
Information fusion in biometrics

Pattern Recognition Letters - Special issue: Audio- and video-based biometric person authentication (AVBPA 2001)
Fast features for face authentication under illumination direction changes

Pattern Recognition Letters
Improving a GMM speaker verification system by phonetic weighting

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 01

Multi-stream Fusion for Speaker Classification

Speaker Classification I
Multimodal biometrics: state of the art in fusion techniques

International Journal of Biometrics
Biometric person authentication with liveness detection based on audio-visual fusion

International Journal of Biometrics
Efficient software attack to multimodal biometric systems and its application to face and iris fusion

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we propose a multimodal fusion framework based on novel face-voice fusion techniques for biometric person authentication and liveness verification. Checking liveness guards the system against spoof/replay attacks by ensuring that the biometric data is captured from an authorised live person. The proposed framework based on bi-modal feature fusion, cross-modal fusion as well as 3D shape and texture fusion techniques, allow a significant improvement in system performance against impostor attacks, type-1 replay attacks (still photo and prerecorded audio), and challenging type-2 replay attacks(CG animated video from a still photo and pre-recorded audio) and robustness to pose and illumination variations.