A universal global rating scale for the evaluation of technical skills in the operating room

Background The ideal assessment of technical skills should be defensible and practical. The purpose of this study was to evaluate the utility of a Global Rating Scale (GRS) Assessment tool of resident operating room performance. Methods Residents were assessed in the operating room on multiple occasions during a 6-month study period using a 9-item GRS. Data were analyzed to assess scale reliability and sensitivity to year of training. Feasibility was evaluated with a post-study questionnaire. Results Seven residents had a total of 32 procedures assessed. One-way analysis of variance (ANOVA) showed that scores increased with year of training (P = .009). Reliability was excellent. (Cronbach’s α .91). The post-study survey identified feedback and faculty interaction as strengths of this tool, but time constraint was a barrier. Conclusions The GRS tool is a valid and reliable method that has the potential to be a practical, useful assessment tool of resident operating room performance.