Multi-modal person verification system based on face profiles and speech

This paper describes a person verification system based on facial profile views and features extracted from speech. The system is comprised of two non-homogeneous classifiers whose outputs are fused after a normalization step. Experiments are reported which show that integration of the face profile and speech information results in superior performance to that of its subsystems. Additionally, the performance of the combined system in noisy conditions is shown to be more robust than the speech-based subsystem alone