Direct coupling of multisensor information and actions for mobile robot behavior acquisition

Many conventional methods for multisensor fusion have been based on the predefined selection. This paper proposes a method which enables a mobile robot to acquire a purposive behavior for accomplishing a given task by directly coupling multisensor information and actions through interaction between the robot and its environment. We use reinforcement-learning scheme to formalize such a coupling process. First, we define states described by combinations of various kinds of data provided by different types of sensors and motor commands to the mobile robot. Then, we acquire pairs of robot actions and states suitable for achieving the given goal by using Q-learning algorithm. As a result of learning, the goal-directed behavior is obtained and information needed for the current subtask is automatically selected among multisensor information. The validity of the method is demonstrated by computer simulations and real robot experiments