Statistical Performance Evaluation of Biometric Authentication Systems Using Random Effects Models

Authors:
Sinjini Mitra;Marios Savvides;Anthony Brockwell
Affiliations:
-;IEEE;IEEE
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2007

Citing 11
Cited 2

Discrete-time signal processing

Discrete-time signal processing
Inference in model-based cluster analysis

Statistics and Computing
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Biometric Recognition: Security and Privacy Concerns

IEEE Security and Privacy
The CMU Pose, Illumination, and Expression (PIE) Database

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Efficient Design of Advanced Correlation Filters for Robust Distortion-Tolerant Face Recognition

AVSS '03 Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance
Repeated Measures GLMM Estimation of Subject-Related and False Positive Threshold Effects on Human Face Verification Performance

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
Gaussian Mixture Models Based on the Frequency Spectra for Human Identification and Illumination Classification

AUTOID '05 Proceedings of the Fourth IEEE Workshop on Automatic Identification Advanced Technologies
Models of large population recognition performance

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
How features of the human face affect recognition: a statistical comparison of three face recognition algorithms

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Facial asymmetry: a new robust biometric in the frequency domain

ICIAR'05 Proceedings of the Second international conference on Image Analysis and Recognition

Factors that influence algorithm performance in the Face Recognition Grand Challenge

Computer Vision and Image Understanding
A novel statistical model to evaluate the performance of EBGM based face recognition

PerMIn'12 Proceedings of the First Indo-Japan conference on Perception and Machine Intelligence

Quantified Score

Hi-index	0.14

Visualization

Abstract

As biometric authentication systems become more prevalent, it is becoming increasingly important to evaluate their performance. This paper introduces a novel statistical method of performance evaluation for these systems. Given a database of authentication results from an existing system, the method uses a hierarchical random effects model, along with Bayesian inference techniques yielding posterior predictive distributions, to predict performance in terms of error rates using various explanatory variables. By incorporating explanatory variables as well as random effects, the method allows for prediction of error rates when the authentication system is applied to potentially larger and/or different groups of subjects than those originally documented in the database. We also extend the model to allow for prediction of the probability of a false alarm on a "watch-list” as a function of the list size. We consider application of our methodology to three different face authentication systems: a filter-based system, a Gaussian Mixture Model (GMM)-based system, and a system based on frequency domain representation of facial asymmetry.