Spatial Face Context with Gender Information for Group Photo Similarity Assessment

Spatial arrangements of people in a photo reflect how people regard themselves in a group. Comparing spatial arrangements of subjects in two group photos can help computer understand similar social semantics and events. In this paper, we incorporate gender information with spatial arrangements of subjects to assess the visual similarity between two group photos. For each group photo, detected faces are represented by a spatial face context. Then, corresponding vertices of spatial face contexts of two group photos are retrieved by graph matching. Gender information and relative face positions are applied to the graph matching results to compute the similarity score. The experimental results show that our method can identify group photos with similar genders of subjects and spatial arrangements compared to the state-of-the-art methods.