Multimedia tele-operation of crane system supported by interactive adaptation interface

Communication networks have been developing rapidly. This network enables one to realize long distance communication in real time using sounds, pictures, movies, computer data, etc. We report a multimedia tele-operation of a crane system, by an interactive adaptation interface. The proposed system has “multimodal display” which provides various kinds of information such as force, visual, and acoustic information. The interactive adaptation interface can adapt the system to an operator considering his/her skill or knowledge, and psychology. The psychology can be inferred from bionic signals. We made a crane simulator based on the proposed system. We performed some operational experiments on this simulator, and confirmed effectiveness of the proposed crane operational assistance system