Practical surgical interface using a RGB-D camera

This paper proposes an interface for controlling medical images using hand gestures. The proposed interface has two modes. One is a surgery-ready mode that a RGB-D camera captures a surgeon´s body and the interface provides hand-based interactions with medical images before beginning a surgery. The other is a surgery mode that the camera captures a patient´s body, and the surgeon can take a picture of a surgical region and control it using hand gestures during the surgery. The modes have different camera views, thus the proposed interface controls the camera´s pose by rotating pan and tilt motors attached to bottom of the camera.