Mitigating effects of plastic surgery: Fusing face and ocular biometrics

The task of successfully matching face images obtained before and after plastic surgery is a challenging problem. The degree to which a face is altered depends on the type and number of plastic surgeries performed, and it is difficult to model such variations. Existing approaches use learning based methods that are either computationally expensive or rely on a set of training images. In this work, a fusion approach is proposed that combines information from the face and ocular regions to enhance recognition performance in the identification mode. The proposed approach provides the highest reported recognition performance on a publicly accessible plastic surgery database, with a rank-one accuracy of 87.4%. Compared to existing approaches, the proposed approach is not learning based and reduces computational requirements. Furthermore, a systematic study of the matching accuracies corresponding to various types of surgeries is presented.