Changes in Perceived Supervision Quality After Introduction of Competency-Based Orthopedic Residency Training: A National 6-Year Follow-Up Study

Abstract

Objective: To evaluate the perceived quality of the learning environment, before and after introduction of competency-based postgraduate orthopedic education.

Design: From 2009 to 2014, we conducted annual surveys among Dutch orthopedic residents. The validated Dutch Residency Educational Climate Test (D-RECT, 50 items on 11 subscales) was used to assess the quality of the learning environment. Scores range from 1 (poor) to 5 (excellent).

Setting: Dynamic cohort follow-up study.

Participants: All Dutch orthopedic residents were surveyed during annual compulsory courses.

Results: Over the 6-year period, 641 responses were obtained (response rate 92%). Scores for "supervision" (95% CI for difference 0.06-0.28, p = 0.002) and "coaching and assessment" (95% CI 0.11-0.35, p < 0.001) improved significantly after introduction of competency-based training. There was no significant change in score on the other subscales of the D-RECT.

Conclusions: After the introduction of some of the core components of competency-based postgraduate orthopedic education the perceived quality of "supervision" and "coaching and assessment" improved significantly.

Keywords: Practice-Based Learning and Improvement; assessment; competency-based; orthopedic surgery; postgraduate; supervision.