Physics-based Fusion of Multispectral Data for Improved Face Recognition

A novel physics-based fusion of multispectral images within the visual spectra is proposed for the purpose of improving face recognition under constant or varying illumination. Spectral images are fused according to the physics properties of the imaging system, including illumination, spectral response of the camera, and spectral reflectance of skin. The fused image is given as a probe to the recognition software Facelttrade which compares it to a gallery of images. The identification performance of our physics-based fusion method is compared to the performance of principle component analysis and average fusion methods. The results show that the proposed fusion yields a higher identification rate. A method of illumination adjustment is proposed when the probe and gallery images are acquired under different illumination conditions. The results show that the identification rate is higher than that of unadjusted gray-level images