Clustering of image features based on contact and occlusion among robot body and objects

This paper presents a recognition framework for a robot without predefined knowledge on its environment. Image features (keypoints) are clustered based on statistical dependencies with respect to their motions and occlusions. Estimation of conditional probability is used to evaluate statistical dependencies among configuration of robot and features in images. Features that move depending on the configuration of the robot can be regarded as part of robot´s body. Different kinds of occlusion can happen depending on relative position of robot hand and objects. Those differences can be expressed as different structures of `dependency network´ in the proposed framework. The proposed recognition was verified by experiment using a humanoid robot equipped with camera and arm. It was first confirmed that part of the robot body was autonomously extracted without any a priori knowledge using conditional probability. In the generation of dependency network, different structures of networks were constructed depending on position of the robot hand relative to an object.