Human robot interaction through integrating visual auditory information with relaxation method

It is important for human and humanoid to share information with each other in everyday life in which robots are needed to coexist with humans. This paper presents an audio-visual conversation system for humanoid, which integrates vision, auditory sense and expressive acts and realizes the share of information. This system consists of acts with conversation and attention. Acts with conversation are described by conversation description programming. Acts with attention depends on auto-detection function of the attention territory, which integrates visual and auditory transaction by relaxation method. With this system, we can make a robot that is able to recognize a demonstrative pronoun by exchanging information. This fact shows that robots and humans can share information in a conversation and expansion not only by demonstrative words, but also intension of acts is expected.