Abstract
A person authentication technique using two modalities is presented. Results from individual experts, namely face and speech recognisers, are merged by a supervisor. The visual part involves matching of a coarse grid containing Gabor phase information from face images. The acoustic part is performed by a text-dependent speaker verification system based on Hidden Markov Models, which assumes as text a spelled sequence of digits. The merging of individual decisions is accomplished by one of two different methods: a simple averaging and a more sophisticated Bayesian method. Experimental results show that even the simple method provides improvements compared to single modalities. The improvements are significant with the Bayesian method. These results show that the use of two modalities increases authentication performance at least under certain circumstances.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
E. S. Bigün. “Risk analysis of catastrophes using experts' judgements: An empirical study on risk analysis of major civil aircraft accidents in Europe”. European J. Operational research, Vol. 87, pp. 599–612, 1995.
E. S. Bigün, J. Bigün, B. Duc, H. Bigün, and S. Fischer. “Expert conciliation for multi modal person authentication systems by Bayesian statistics”. In First International Conference on Audio-and Video-based Biometric Person Authentication (AVBPA'97), Crans-Montana, Switzerland, March 12–14 1997.
J. Bigün and J. M. H. du Buf. “N-folded symmetries by complex moments in Gabor space”. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 1, pp. 80–87, January 1994.
R. Brunelli and D. Falavigna. “Person identification using multiple cues”. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 10, pp. 955–966, October 1995.
B. V. Dasarathy. Decision Fusion. IEEE Computer Society Press, 1994.
P.A. Devijver and J. Kittler. Pattern Recognition: a Statistical Approach. Prentice-Hall International, London, 1982.
B. Duc, S. Fischer, and J. Bigün. “Face authentication with sparse grid gabor information”. In 1997 International Conference on Acoustics, Speech, and Signal Processing (ICASSP'97), Munich, Germany, April 20–24 1997.
D. Genoud and G. Chollet. “Polycode a verification database”. Technical report, IDIAP, CH-1920 Martigny, 1995.
D. Genoud, G. Gravier, F. Bimbot, and G. Chollet. “Combining methods to improve the phone based speaker verification decision”. In ICSLP'96, Vol. 3, pp. 1756–1760, Philadelphia, 1996.
P. Jourlin, J. Lüttin, D. Genoud, and H. Wassner. “Acoustic-labial speaker verification”. In First International Conference on Audio-and Video-based Biometric Person Authentication (AVBPA'97), Crans-Montana, Switzerland, March 12–14 1997.
M. Lades, J. Buhmann J. C. Vorbrüggen, J. Lange, C. v.d. Malsburg, R. P. Würtz, and W. Konen. “Distortion invariant object recognition in the dynamic link architecture.”. IEEE Transactions on Computers, Vol. 42, No. 3, pp. 300–311, March 1993.
S. Pigeon and L. Vandendorpe. “The M2VTS multimodal face database”. In First International Conference on Audio-and Video-based Biometric Person Authentication (AVBPA '97), Crans-Montana, Switzerland, March 12–14 1997. (http://www.tele.ucl.ac.be/M2VTS).
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Duc, B., Maître, G., Fischer, S., Bigün, J. (1997). Person authentication by fusing face and speech information. In: Bigün, J., Chollet, G., Borgefors, G. (eds) Audio- and Video-based Biometric Person Authentication. AVBPA 1997. Lecture Notes in Computer Science, vol 1206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0016010
Download citation
DOI: https://doi.org/10.1007/BFb0016010
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62660-2
Online ISBN: 978-3-540-68425-1
eBook Packages: Springer Book Archive
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
