Back to overview

Simulation With PARTS (Phase-Augmented Research and Training Scenarios)A Structure Facilitating Research and Assessment in Simulation

Type of publication Peer-reviewed
Publikationsform Original article (peer-reviewed)
Publication date 2015
Author Schick Carl J., Weiss Mona, Kolbe Michaela, Marty Adrian, Dambach Micha, Knauth Axel, Spahn Donat R., Grote Gudela, Grande Bastian,
Project Combined technical and non-technical skills training for managing unanticipated difficult intubations
Show all

Original article (peer-reviewed)

Journal Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
Volume (Issue) 10(3)
Page(s) 178 - 187
Title of proceedings Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare
DOI 10.1097/SIH.0000000000000085


Introduction: Assessment in simulation is gaining importance, as are scenario design methods increasing opportunity for assessment. We present our approach to improving measurement in complex scenarios using PARTS [Phase-Augmented Research and Training Scenarios], essentially separating cases into clearly delineated phases. Methods: We created 7 PARTS with real-time rating instruments and tested these in 63 cases during 4 weeks of simulation. Reliability was tested by comparing real-time rating with postsimulation video-based rating using the same instrument. Validity was tested by comparing preintervention and postintervention total results, by examining the difference in improvement when focusing on the phase-specific results addressed by the intervention, and further explored by trying to demonstrate the discrete improvement expected from proficiency in the rare occurrence of leader inclusive behavior. Results: Intraclass correlations [3,1] between real-time and postsimulation ratings were 0.951 (95% confidence interval [CI], 0.794Y0.990), 1.00 (95% CI, V to V), 0.948 (95% CI, 0.783Y0.989), and 0.995 (95% CI, 0.977Y0.999) for 3 phase- specific scores and total scenario score, respectively. Paired t tests of prelecture- postlecture performance showed an improvement of 14.26% (bias-corrected and ac- celerated bootstrap [BCa] 95% CI, 4.71Y23.82; P = 0.009) for total performance but of 28.57% (BCa 95% CI, 13.84Y43.30; P = 0.002) for performance in the respective phase. The correlation of total scenario performance with leader inclusiveness was not significant (rs = 0.228; BCa 95% CI. j0.082 to 0.520; P = 0.119) but significant for specific phase performance (rs = 0.392; BCa 95% CI, 0.118Y0.632; P = 0.006). Conclusions: The PARTS allowed for improved reliability and validity of measure- ments in complex scenarios.