Multimedia description language for more intelligent networking

In general, it is very difficult for people to exploit necessary information from the immense multimedia contents over the WWW. It is still more difficult to search for desirable contents by queries in different media, for example, text queries for pictorial contents. In this case, intelligent systems facilitating cross-media translation are very helpful. Mental Image Directed Semantic Theory (MIDST) has proposed a cognitively motivated methodology for intermediate knowledge representation. This paper presents a formal language for describing multimedia contents, L_md, whose syntax and semantics are based on MIDST and its application to cross-media translation between linguistic and pictorial expressions of space and time, which serve as a good basis for more intelligent networking.