Research by SIMPL Members

SIMPL members have contributed to the fields of assessment, psychometrics, education outcomes, and more. Click the links for abstract information.

Publications:

• A controlled study to determine measurement conditions necessary for a reliable and valid operative performance assessment: a controlled prospective observational study.
• A Proposed Blueprint for Operative Performance Training, Assessment, and Certification
• A SIMPL application to assess oral medicine residents’ performance and level of autonomy
• A template for reliable assessment of resident operative performance: assessment intervals, numbers of cases and raters.
• A theory-based model for teaching and assessing residents in the operating room.
• Achieving Surgical Competence in All Urology Residents
• Are You Thinking What I’m Thinking? Exploring Response Process Validity Evidence for a Workplace-based Assessment for Operative Feedback
• Assessment of Operative Autonomy and Readiness for Independent Practice Among Pediatric Surgery Fellows
• Association Between Entrustable Professional Activities and Milestones Evaluations: Real-time Assessments Correlate With Semiannual Reviews
• Autonomy in the Operating Room: A Multicenter Study of Gender Disparities During Surgical Training 
• Closing the Gap: Evaluation of Gender Disparities in Urology Resident Operative Autonomy and Performance
• Concordance Between Expert and Nonexpert Ratings of Condensed Video-Based Trainee Operative Performance Assessment
• Constructing Learning Curves to Benchmark Operative Performance of General Surgery Residents Against a National Cohort of Peers
• Crowd-Sourced and Attending Assessment of General Surgery Resident Operative Performance Using Global Ratings Scales
• Defining the Autonomy Gap: When Expectations Do Not Meet Reality in the Operating Room.
• Duration of faculty training needed to ensure reliable or performance ratings.
• Evaluating resident operative performance: a qualitative analysis of expert opinions.
• Evaluation of Oral and Maxillofacial Surgery Residents’ Operative Skills: Feasibility and Engagement Study Using SIMPL Software for a Mobile Phone.
• Examining the Impact of Using the SIMPL Application on Feedback in Surgical Education
• Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents.
• How do supervising surgeons evaluate guidance provided in the operating room?
• How Many Observations are Needed to Assess a Surgical Trainee’s State of Operative Competency?
• How much guidance is given in the operating room? Factors influencing faculty self-reports, resident perceptions, and faculty/resident agreement.
• Identifying and Addressing High Priority Issues in General Surgery Training and Education
• Mind the Gap: The Autonomy Perception Gap in the Operating Room by Surgical Residents and Faculty
• Natural Language Processing and Assessment of Resident Feedback Quality
• Number of Operative Performance Ratings Needed to Reliably Assess the Difficulty of Surgical Procedures
• Practice Guidelines for Operative Performance Assessments
• Quality of dictated feedback associated with SIMPL operative assessments of pediatric surgical trainees
• Readiness of US General Surgery Residents for Independent Practice.
• Refining the evaluation of operating room performance.
• Relationship of procedural numbers with meaningful procedural autonomy in general surgery residents
• Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance.
• Representativeness of Workplace-Based Operative Performance Assessments for Resident Operative Experience
• SIMPLifying Urology Residency Operative Assessments: A Pilot Study in Urology Training
• Surgical residents’ perception of competence and relevance of the clinical curriculum to future practice.
• Surgical Trainee Performance and Alignment With Surgical Program Director Expectations
• The effect of gender on operative autonomy in general surgery residents
• The Feasibility of Real-Time Intraoperative Performance Assessment With SIMPL (System for Improving and Measuring Procedural Learning): Early Experience From a Multi-institutional Trial
• The Measured Effect of Delay in Completing Operative Performance Ratings on Clarity and Detail of Ratings Assigned.
• The Quality of Operative Performance Narrative Feedback
• The reliability of resident self-evaluation of operative performance
• Trainee Autonomy in Minimally Invasive General Surgery in the United States: Establishing a National Benchmark
• Training cardiac surgeons: the Indiana University experience.
• Uniting Evidence-Based Evaluation with the ACGME Plastic Surgery Milestones: A Simple and Reliable Assessment of Resident Operative Performance.
• US general surgical trainee performance for representative global surgery procedures
• Use of the Surgical Council on Resident Education (SCORE) curriculum as a template for evaluating and planning a program’s clinical curriculum.
• Using Natural Language Processing to Automatically Assess Feedback Quality- Findings From Three Surgical Residencies
• Using smartphones for trainee performance assessment: A SIMPL case study
• Using the ACGME Milestones for Resident Self-Evaluation and Faculty Engagement
• Utilizing a Mobile Application for Evaluation of Procedural Learning in Neurosurgery
• Value and Barriers to Use of the SIMPL Tool for Resident Feedback