Semi-automatic photograph tagging by combining context with content-based information

This article proposes a semi-automatic technique for the annotation of people in photographs. The technique uses context and content information and is based on a weighted sum of estimators, which results in a list of the person’s contacts that are more likely to be present in a photograph. Machine learning methods, such as multivariable linear regression and slope function, are adopted to filter and weight the estimators and eigenfaces for face recognition. The article also describes the results of experiments that were performed with a collection of 4050 photographs with 365 different people, which indicate that the proposed technique outperforms techniques that adopt only context or only content using as a performance metric the H-Hit rate of correct annotations.