A talking profile to distinguish identical twins

Identical twins pose a great challenge to face recognition due to high similarities in their appearances. Motivated by the psychological findings that facial motion contains identity signatures and the observation that twins may look alike but behave differently, we develop a talking profile to use the identity signatures in the facial motion to distinguish between identical twins. The talking profile for a subject is defined as a collection of multiple types of usual face motions from the video. Given two talking profiles, we compute the similarities of all same type of face motion in both profiles and then perform the classification based on those similarities. Our approach, named Exceptional Motion Reporting Model (EMRM), is unrelated with appearance, and can handle realistic facial motion in human subjects, with no restrictions of speed of motion, or video frame rate. The experimental results on a video database containing 39 pairs of twins demonstrate that identical twins can be distinguished by their talking profiles. Moreover, we also apply our approach on non-twin population on a moderate YouTube dataset, with results verifying that the talking profile can be the potential biometric.