Multimedia ontology modeling: An approach based on MPEG-7

The MPEG-7 standard provides a description of multimedia data, however high-level semantic of multimedia data is beyond the scope of the MPEG-7 standard. As ontology is an effective tool of semantic modeling, high-level semantic of multimedia data can be modeled using ontology. In this study, we propose a multimedia ontology modeling approach based on the MPEG-7 standard. The three main features of the proposed approach are: 1) A multimedia ontology is created by combining semantic hierarchy of multimedia content and the MPGE-7 standard. 2) We pay attention on three parts of MPEG-7: MDS, Visual-Audio and Classification Schemes (CS, especially TemporalRelation CS and SpatialRelation CS). 3) We extend the proposed multimedia ontology to support spatial-temporal relation of multimedia data. We show the way of analyzing high-level semantic of multimedia data using the proposed ontology.