Ontology-based concept similarity integrating image semantic and visual information

In recent years, the concept similarity measure has received wide attention in many applications, such as ontology construction, text analysis, image retrieval, etc. Currently, the concept similarity measure depends on the information mining in various knowledge bases, like dictionaries, ontologies, image annotation labels, and search engines. However, these knowledge bases usually only contain semantic information. With the development of the Internet and the popularity of the digital imaging devices, a lot of images and related texts have appeared, which help us to further mine the concept similarity relationships. The concept similarity is the outcome of human subjective perception. In addition to analysis of semantic information, the content of image itself precisely provides the visual perception information, which also plays an important role in the access of concept similarity relationships. To integrate both image semantic and visual information, in this paper we propose an ontology concept similarity measure that simultaneously utilizes the image semantic annotations and visual features to optimize the ontology-based metrics. The experiment result on the Corel dataset demonstrates the effectiveness of our proposed method.