Towards real-time haptic exploration using a mobile robot as mediator

In this paper, we propose a new concept of haptic exploration using a mobile manipulation system, which combines the mobility and manipulability of the robot with haptic feedback for user interaction. The system utilizes and integrates heterogeneous robotic sensor readings to create a real-time spatial model of the environment, which in turn can be conveyed to the user to explore the haptically represented environment and spatially perceive the world without direct contact. The real-world values are transformed into an environmental model (an internal map) by the sensors, and the environmental model is used to create environmental feedback on the haptic device which interacts in the haptically augmented space. Through this multi-scale convergence of dynamic sensor data and haptic interaction, our goal is to enable real-time exploration of the world through remote interfaces without the use of predefined world models. In this paper, the system algorithms and platform are discussed, along with preliminary results to show the capabilities of the system.