Remarks on multimodal nonverbal interface and its application to controlling mobile robot

This paper proposes a multimodal nonverbal interface system using bio-potential signals, such as EOG and EMG, and image processing and investigates its possibility of applying to control a mobile robot. To evaluate the feasibility and the characteristics of the multimodal nonverbal interface system, teleoperation control experiments of the robot are carried out. By comparing the experimental results with those obtained using a conventional keyboard interface, the effectiveness of the proposed interface system is confirmed.