A SIMPL application to assess oral medicine residents’ performance and level of autonomy

Oral Surg Oral Med Oral Pathol Oral Radiol. 2018 Sep. Epub 2018 May 29.

Abstract

OBJECTIVES:

The aim of this study was to evaluate a smartphone application, SIMPL, to optimize faculty guidance and oral medicine residents’ performance, and to measure resident–faculty agreement for performance and supervision levels.

STUDY DESIGN:

The aim of this study was to evaluate a smartphone application, SIMPL, to optimize faculty guidance and oral medicine residents’ performance, and to measure resident–faculty agreement for performance and supervision levels.

RESULTS:

A total of 660 evaluations were performed by 6 residents and 6 faculty members. Senior residents received higher performance scores compared with junior residents (P for trend < .01). In terms of complexity of cases and level of supervision, there were no significant differences between juniors and seniors (P = .69 and P = .39, respectively). Residents were “practice ready” or greater than for 80% cases. Residents received meaningful autonomy for 64.8% cases. Faculty–resident concordance was 86.1% for performance (with κ of 0.77 [95% CI 66.1%–87.6%]) and 92.4% for supervision (with κ of 0.84 [95% CI 80%–88%]).

CONCLUSIONS:

SIMPL can feasibly be used for real-time assessment of residents’ performance and autonomy.

PMID: 22937360