Addressing missing values in kernel-based multimodal biometric fusion using neutral point substitution

  • Authors:
  • Norman Poh;David Windridge;Vadim Mottl;Alexander Tatarchuk;Andrey Eliseyev

  • Affiliations:
  • CVSSP, University of Surrey, Guildford, Surrey, UK;CVSSP, University of Surrey, Guildford, Surrey, UK;Computing Center of the Russian Academy of Sciences, Moscow, Russia;Computing Center of the Russian Academy of Sciences, Moscow, Russia;Computing Center of the Russian Academy of Sciences, Moscow, Russia

  • Venue:
  • IEEE Transactions on Information Forensics and Security
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In multimodal biometric information fusion, it is common to encounter missing modalities in which matching cannot be performed. As a result, at the match score level, this implies that scores will be missing. We address the multimodal fusion problem involving missing modalities (scores) using support vector machines (SVMs) with the neutral point substitution (NPS) method. The approach starts by processing each modality using a kernel. When a modality is missing, at the kernel level, the missing modality is substituted by one that is unbiased with regards to the classification, called a neutral point. Critically, unlike conventional missing-data substitution methods, explicit calculation of neutral points may be omitted by virtue of their implicit incorporation within the SVM training framework. Experiments based on the publicly available Biosecure DS2 multimodal (scores) data set show that the SVM-NPS approach achieves very good generalization performance compared to the sum rule fusion, especially with severe missing modalities.