Integrated interface for advanced teleoperation

The authors describe the development of a smart operator interface that simplifies update and control of the automatic features of advanced teleoperators and reduces operator workload. The robot joystick has the double function of moving the manipulator and acting as a point-and-click device on a computer screen. The interface can be equipped with knowledge of the teleoperated task and can provide automatic parameter update. A neural network model for peg-in-hole task real-time segmentation is presented as an example of this feature