Gestonurse: A multimodal robotic scrub nurse

Author

Jacob, Mithun G. ; Li, Yu-Ting ; Wachs, Juan P.

Author_Institution

Sch. of Ind. Eng., Purdue Univ., West Lafayette, IN, USA

fYear

2012

fDate

5-8 March 2012

Firstpage

153

Lastpage

154

Abstract

A novel multimodal robotic scrub nurse (RSN) system for the operating room (OR) is presented. The RSN assists the main surgeon by passing surgical instruments. Experiments were conducted to test the system with speech and gesture modalities and average instrument acquisition times were compared. Experimental results showed that 97% of the gestures were recognized correctly under changes in scale and rotation and that the multimodal system responded faster than the unimodal systems. A relationship similar in form to Fitts´s law for instrument picking accuracy is also presented.

Keywords

human-robot interaction; medical robotics; surgery; Fitts law; OR; RSN; gestonurse; gesture modalities; instrument acquisition times; instrument picking accuracy; multimodal robotic scrub nurse; operating room; speech modalities; surgical instruments; Accuracy; Algorithm design and analysis; Gesture recognition; Instruments; Robots; Speech; Speech recognition; gesture recognition; human-robot interaction; multimodal interfaces; robotic scrub nurse;

fLanguage

English

Publisher

ieee

Conference_Titel

Human-Robot Interaction (HRI), 2012 7th ACM/IEEE International Conference on

Conference_Location

Boston, MA

ISSN

2167-2121

Print_ISBN

978-1-4503-1063-5

Electronic_ISBN

2167-2121

Type

conf

Filename

6249501