A Proposed Blueprint for Operative Performance Training, Assessment, and Certification

Williams, Reed G. PhD (deceased); George, Brian C. MD; Bohnen, Jordan D. MD; Dunnington, Gary L. MD; Fryer, Jonathan P. MD; Klamen, Debra L. MD; Meyerson, Shari L. MD; Swanson, David B. PhD; Mellinger, John D. MD

Annals of Surgery: April 2021 – Volume 273 – Issue 4 – p 701-708

Abstract

 

OBJECTIVE:

The aim of this study was to propose an evidence-based blueprint for training, assessment, and certification of operative performance for surgical trainees.

 

Summary Background Data:

Operative skill is a critical aspect of surgical performance. High-quality assessment of operative skill therefore has profound implications for training, accreditation, certification, and the public trust of the profession. Current methods of operative skill assessment for surgeons rely heavily on global assessment strategies across a very broad domain of procedures. There is no mechanism to assure technical competence for individual procedures. The science and scalability of operative skill assessment has progressed significantly in recent decades, and can inform a much more meaningful strategy for competency-based assessment of operative skill than has been previously achieved.
 

METHODS:

The present article reviews the current status and science of operative skill assessment and proposes a template for competency-based assessment which could be used to update training, accreditation, and certification processes. The proposal is made in reference to general surgery but is more generally applicable to other procedural specialties.

 

RESULTS:

Streamlined, routine assessment of every procedure performed by surgical trainees is feasible and would enable a more competency-based educational paradigm. In light of the constraints imposed by both clinical volume and assessment bias, trainees should be expected to become proficient and be measured against a mastery learning standard only for the most important and highest-frequency procedures. For less frequently observed procedures, performance can be compared to a norm-referenced standard and, to provide an overall trajectory of performance, analyzed in aggregate. Key factors in implementing this approach are the number of evaluations, the number of raters, the timeliness of evaluation, and evaluation items.
 

CONCLUSIONS:

A competency-based operative skill assessment can be incorporated into surgical training, assessment, and certification. The time has come to develop a systematic approach to this issue as a means of demonstrating professional standards worthy of the public trust.

 

PMID: 33201114

 

The Society for Improving Medical Professional Learning (SIMPL) is a 501c3 nonprofit research collaborative lead by volunteers who are dedicated to working towards a continuously improving medical education system.