Spatiotemporal reasoning aware of human cognitive processes for language-centered intuitive human-robot interaction

The knowledge representation language Lmd has been proposed in Mental Image Directed Semantic Theory (MIDST) in order to facilitate language-centered multimedia communication between ordinary people and home robots in the daily life. The Lmd has employed the ‘tempo-logical connectives (TLCs)’ to represent both temporal and logical relations between two events, and the ‘temporal conjunctions’, a subset of TLCs, have already been applied to formulating natural event concepts, namely, event concepts represented in natural language. This paper presents the theory of TLCs extended for formalizing natural spatiotemporal knowledge in general and its application to automatic reasoning about space and time.