Establishing the concurrent validity of general and technique-specific skills assessments in surgical education

Am J Surg. 2016 Jan;211(1):268-73. doi: 10.1016/j.amjsurg.2015.04.024. Epub 2015 Jul 31.

Abstract

Background: Laparoscopic surgery entails a unique skill set, but it is unclear whether it requires a specific assessment form or whether more general assessment tools can be applied. The purpose of this study was to assess the concurrent validity of 2 previously validated assessment scales. One scale designed specifically to assess laparoscopic skills and the other to assess more general surgical skills.

Methods: Postgraduate year 1-6 general surgery and urology residents (n = 33) performed a live laparoscopic cholecystectomy. Three surgeon raters scored their performance using previously validated objective structured assessment of technical skills (OSATS) and global operative assessment of laparoscopic skills rating scales.

Results: Pearson's correlation coefficient between global operative assessment of laparoscopic skills and OSATS rating scales was .975 (P = .01).

Conclusions: The near total correlation between the 2 scales questions the need for separate laparoscopic assessment tools, highlighting the real strengths of OSATS, the use of which allows for more consistent nomenclature and standardized skills assessment across surgical platforms.

Keywords: Assessment; Education; Evaluation; Laparoscopic; Surgery.

Publication types

  • Research Support, Non-U.S. Gov't
  • Validation Study

MeSH terms

  • Cholecystectomy, Laparoscopic / education*
  • Clinical Competence*
  • Education, Medical, Graduate / methods*
  • Female
  • General Surgery / education*
  • Humans
  • Male
  • Manitoba
  • Urology / education*