Fundamentals of speech recognition
Fundamentals of speech recognition
Integrating Faces and Fingerprints for Personal Identification
IEEE Transactions on Pattern Analysis and Machine Intelligence
Gaussian Mixture Models for on-line signature verification
WBMA '03 Proceedings of the 2003 ACM SIGMM workshop on Biometrics methods and applications
Biometric User Authentication for IT Security: From Fundamentals to Handwriting (Advances in Information Security)
A tutorial on text-independent speaker verification
EURASIP Journal on Applied Signal Processing
Spoken Handwriting Verification Using Statistical Models
ICDAR '07 Proceedings of the Ninth International Conference on Document Analysis and Recognition - Volume 02
AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Securing electronic medical records using biometric authentication
AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Generation and evaluation of brute-force signature forgeries
MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Online writer verification using kanji handwriting
MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Gaussian mixture models for CHASM signature verification
MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction
Writer identification for smart meeting room systems
DAS'06 Proceedings of the 7th international conference on Document Analysis Systems
A new forgery scenario based on regaining dynamics of signature
ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
Multimodal biometrics: state of the art in fusion techniques
International Journal of Biometrics
Cancelable templates for sequence-based biometrics with application to on-line signature recognition
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans - Special issue on recent advances in biometrics
Quality-based conditional processing in multi-biometrics: application to sensor interoperability
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
A new set of features for a bimodal system based on on-line signature and speech
Digital Signal Processing
| Hi-index | 0.00 |
In this paper, we report on the development of an efficient user authentication system based on a combined acquisition of online pen and speech signals. The novelty of our approach is in the simultaneous recording of these two modalities, simply asking the user to utter what she/he is writing. The main benefit of this multimodal approach is a better accuracy at no extra costs in terms of access time or inconvenience. Another benefit comes from an increased difficulty for forgers willing to perform imitation attacks as two signals need to be reproduced. We are comparing here two potential scenarios of use. The first one is called spoken signatures where the user signs and says the content of the signature. The second scenario is based on spoken handwriting where the user is prompted to write and read the content of sentences randomly extracted from a text. Data according to these two scenarios have been recorded from a set of 70 users. In the first part of this paper, we describe the acquisition procedure, and we comment on the viability and usability of such simultaneous recordings. Our conclusions are supported by a short survey performed with the users. In the second part, we present the authentication systems that we have developed for both scenarios. More specifically, our strategy was to model independently both streams of data and to perform a fusion at the score level. Starting from a state-of-the-art-modeling algorithm based on Gaussian Mixture Models trained with an Expectation-Maximization procedure, we report on several significant improvements that are brought. As a general observation, the use of both modalities outperforms significantly the modalities used alone.