Publication 3 Raper
Publication 3 Raper
Background: Simulation-based medical education has been used in medical training for decades.
Rapid cycle deliberate practice (RCDP) is a novel simulation strategy that uses iterative practice and
feedback to achieve skill mastery. To date, there has been minimal evaluation of RCDP vs standard
immersive simulation (IS) for the teaching of cardiopulmonary resuscitation to graduate medical
education (GME) learners. Our primary objective was to compare the time to performance of Advanced
Cardiac Life Support (ACLS) actions between trainees who completed RCDP vs IS.
Methods: This study was a prospective, randomized, controlled curriculum evaluation. A total of 55
postgraduate year-1 internal medicine and emergency medicine residents participated in the study.
Residents were randomized to instruction by RCDP (28) or IS (27). Stress and ability were self-assessed
before and after training using an anonymous survey that incorporated five-point Likert-type questions.
We measured and compared times to initiate critical ACLS actions between the two groups during a
subsequent IS.
Results: Prior learner experience between RCDP and IS groups was similar. Times to completion of the
first pulse check, chest compression initiation, backboard placement, pad placement, initial rhythm
analysis, first defibrillation, epinephrine administration, and antiarrhythmic administration were similar
between RCDP and IS groups. However, RCDP groups took less time to complete the pulse check
between compression cycles (6.2 vs 14.2 seconds, P = 0.01). Following training, learners in the RCDP
and IS groups scored their ability to lead and their levels of anticipated stress similarly (3.43 vs 3.30,
(P = 0.77), 2.43 vs. 2.41, P = 0.98, respectively). However, RCDP groups rated their ability to participate
in resuscitation more highly (4.50 vs 3.96, P = 0.01). The RCDP groups also reported their realized stress
of participating in the event as lower than that of the IS groups (2.36 vs 2.85, P = 0.01).
Conclusion: Rapid cycle deliberate practice learners demonstrated a shorter pulse check duration,
reported lower stress levels associated with their experience, and rated their ability to participate in ACLS
care more highly than their IS-trained peers. Our results support further investigation of RCDP in other
simulation settings. [West J Emerg Med. 2024;25(2)1–8.]
facilitator underwent formal IS- and RCDP-facilitator participation. Each measure was assessed using a five-point
training prior to involvement in the study. Facilitators were Likert-type scale.
not blinded to the study objectives.
Immersive Simulation Protocol
Protocol All IS teams were provided with the same scripted pre-
In the week prior, residents were provided with a brief, which described the basic tenets of simulation and
description of the study and an electronic copy of the informed participants that they would be caring for a
informed consent document to allow for a detailed and pulseless patient. Teams were not instructed regarding the
private review. Each of the 55 participants then provided assignment of clinical roles but were allowed to self-assign as
written informed consent on the date of their scheduled they deemed appropriate. The IS teams were then activated
simulation event. Our study used five teams for each by an ESP functioning in the role of a nurse who brought the
instructional intervention. Each team was comprised of five participants to the care area and asked participants to
or six members who were randomly assigned to either RCDP evaluate an unresponsive patient.
or IS, for a total of 55 participants (28 in RCDP groups, 27 in Once outside the patient’s room, participants assumed
IS groups). While there was a fixed and limited number of care for the patient without further coaching or intervention.
available participants (IM and EM interns), we performed a The IS participants were permitted to navigate the patient’s
post-hoc power analysis to establish a basis for future work. case without interruption, while physician facilitators
With an α = 0.05, this study had 29% power to detect a large observed their actions from a simulation control room with
effect size (d = 1) for primary outcomes and 71% power to audio and visual surveillance of the simulation area. The IS
detect a medium effect size (w = 0.3) for secondary outcomes learners were allowed to navigate their case without
(G*Power 3.1.9.7). We used an online randomization interruption until the fourth pulse check or until 30 minutes
generator (https://www.randomizer.org/) to divide had elapsed, at which time facilitators initiated return of
participants into 10 teams, with five teams for each spontaneous circulation and the case was terminated. Given
instructional method. the nature of the IS educational sessions, learners did not
Due to scheduling differences, IM and EM participants have the opportunity to rotate roles. Learners then returned
were separated and completed their respective experiences on to the briefing room, and physician facilitators debriefed
different days. The IM faculty facilitated all IM resident based on observed performance according to a standardized
sessions. To minimize confounding related to the debriefing guide and until total case time reached 45 minutes.
effectiveness of the individual facilitator, the two IM faculty The guide emphasized coaching regarding resuscitation and
facilitators led both the RCDP and the IS sessions for the IM time-sensitive interventions that matched the primary
residents. The 12 EM participants completed their experience outcome measures (eg, time to identification of pulselessness,
the following week in two teams of six, one of which was time to initiation of chest compressions, etc).
assigned to RCDP and the other to IS. The EM faculty
facilitated both EM resident sessions. All faculty facilitators RCDP Simulation Protocol
were trained in implementation of RCDP and IS. This All RCDP groups were given a standard pre-brief that
training was provided by certified healthcare simulation described the basic tenets of simulation. Groups were then
instructors in our internationally accredited institutional provided with an introduction to the simulation modality
simulation center. No faculty facilitators were involved in the assigned to them. Teams were not instructed regarding the
extraction of performance data. assignment of clinical roles but were allowed to self-assign as
The same two embedded simulation participants (ESP) they deemed appropriate. The RCDP teams were activated
functioned as nurses for all sessions. The ESPs in all sessions by an ESP who brought the participants to the care area and
were registered nurses and certified healthcare simulation asked them to evaluate an unresponsive patient while
educators employed by our institutional simulation center. physician facilitators observed at the bedside. The RCDP
The ESPs were instructed to assist only with care tasks when groups rotated roles, allowing them the opportunity to direct
directly asked for specific task assistance (eg, locating care the resuscitation and receive feedback.
items) but did not trigger initiation of individual task In addition to their standardized training, all facilitators
completion or provide guidance on task performance. were provided with an RCDP coaching guide, which was
Following informed consent, learners were asked to focused on the same resuscitation and time-sensitive
complete a pre-simulation survey to establish baseline interventions as the immersive case debriefing guide.
learner characteristics. The survey queried each participant’s Facilitators provided real-time coaching and feedback based
prior level of experience as well as self-perceived ability to on the RCDP coaching guide. Cases were then restarted,
lead and participate in the care of a pulseless patient. The rewound, or resumed according to facilitator discretion.
surveys also assessed the learner’s anticipated and prior Total learner simulation and debriefing time was 45 minutes
experienced stress associated with code leadership and for each RCDP case.
Table 1. Cardiopulmonary resuscitation experience prior Table 3. Pre-simulation mean Likert-type ratings.
to simulation.
Group Median Min Max P-value
Group Median Min Max P-value Ability to Lead IS 2 1 4 0.75
Simulation IS 1 0 17 0.34 RCDP 3 1 3
Leader RCDP 2 0 6 Ability to Participate IS 3 3 5 0.59
Genuine IS 0 0 40 0.81 RCDP 4 2 5
leader RCDP 0 0 3 Stress anticipated as IS 4 3 5 0.44
Simulation IS 3 0 50 0.46 Leader RCDP 4 3 5
participant RCDP 3.5 0 15 Stress anticipated as IS 4 2 4 0.08
Genuine IS 2 0 75 0.67 Participant RCDP 3 2 5
participant RCDP 2 0 25
IS, immersive simulation; RCDP, rapid cycle deliberate practice.
IS, immersive simulation; RCDP, rapid cycle deliberate practice.
*Genuine refers to experiences in actual patient care scenarios.
(Tables 3, 4). When we compared pre- and post-training
responses regarding anticipated stress, the anticipated stress
difference: CPR mean pause duration in seconds was 6.20 vs of future resuscitation experiences dropped significantly for
14.20 seconds (P = 0.01) in RCDP vs IS groups (Table 2). both leader and participant categories following training,
regardless of instructional method.
Secondary Outcome: Ability and Stress
For stress levels and self-reported ability, learners DISCUSSION
provided ratings on a five-point Likert-type scale. We present Learners receiving RCDP instruction showed a
the mean values in Tables 3 and 4. Prior to training, RCDP significantly shortened pause duration, reduced stress, and
and IS learners rated their anticipated stress of leading and improved self-perceived CPR skills compared to IS. The
participating in CPR similarly (4.36 vs 4.00 (P = 0.44); 3.18 RCDP instruction also shortened various time-based ACLS
vs 3.00 (P = 0.08), respectively). The RCDP and IS learners metrics, although statistical significance was not reached due
also rated their pre-training ability to lead as well as to the small sample size. A reduced pause duration carries
participate in the event similarly (2.50 vs 2.37 (P = 0.75); 3.61 notable clinical significance. Pause duration is an important
vs 3.52 (P = 0.59) (Table 3). There was no significant metric of high-quality CPR and is associated with improved
difference in the anticipated stress levels of future events patient outcomes.23,24 Reduced pause duration has a
following training, whether considering the role of leader significant impact on terminating arrhythmias and increasing
(P = 0.93) or participant (P = 0.98) (Table 4). Similarly, there return of spontaneous circulation, while increased pause
was no significant difference in experienced stress as a leader duration is associated with a decrease in survival.26
between RCDP and IS learners (P = 0.93) and the overall Although there is a paucity of literature comparing RCDP
effectiveness of the experience was rated similarly between to IS in the care of an adult patient, what little data that does
groups (P = 0.09). However, RCDP learners reported lower exist demonstrates improvements in chest compression
levels of experienced stress as a participant (P = 0.01) fraction in RCDP vs IS groups.20 Many of these prior studies
IS, immersive simulation; RCDP, rapid cycle deliberate practice. Time is in seconds.
Table 4. Post-simulation mean Likert-type ratings. metrics such as pad placement or administration
antiarrhythmic showed no significant change between
Group Median Min Max P-value
groups. These actions are dependent on a variety of factors in
Ability to Lead IS 3 3 5 0.77
a team focused on CPR, and as Lemke et al suggest, they may
RCDP 3 3 4 be difficult to measure effectively.15
Ability to Participate IS 4 3 5 0.01 As previously noted, our study was underpowered, which
RCDP 4.5 4 5 played a role in the absence of statistically significant
Stress anticipated IS 3 2 5 0.93 differences for many of our outcome measures. The Likert-
as Leader scale measures were better powered, as they represented 55
RCDP 3 2 4
individual survey responses as opposed to the 10 total teams
Stress anticipated IS 2 1 3 0.98
divided in two for each instructional method. For
as Participant RCDP 2 1 4 comparison, Hunt et al studied the performance of 81
Stress experienced IS 3 3 5 0.93 individual pediatric residents who participated in the post-
as Leader RCDP 3 2 5 intervention assessment and found that RCDP improved
Stress experienced IS 3 2 4 0.01 learner confidence, but there was no control group for
as Participant RCDP 2 1 3
comparison or power calculation.13 De Castro et al used five
teams for their RCDP group and four teams for their control
Overall effectiveness IS 4 3 5 0.09
group, with an 80% power to detect a 20% difference in the
RCDP 5 4 5 primary outcome. The authors found a higher chest
IS, immersive simulation; RCDP, rapid cycle deliberate practice. compression fraction and shorter times to rhythm
identification/defibrillation in the RCDP group. However,
due to data loss they were unable to achieve the planned
power.20 Lemke et al studied the greatest number of learners,
were done in pediatrics, but the results should have clinically with 102 participants in 21 teams for their control cohort, and
similar interpretations as those completed in adults.13–16 108 participants in 20 teams for their RCDP cohort and
Hunt et al conducted the only prior study examining time- found that RCDP groups demonstrated shorter times to
based metrics as a surrogate for proficiency and found RCDP defibrillation. While no formal power calculation was
to be superior for instruction of BLS interventions in junior performed, Lemke’s work appears to be the best powered
medical students.27 Our results add to this work through the thus far.15 Future work should include more robust powering
further examination of time-based metrics and learner with larger sample sizes, which will likely require inter-
perceptions. Although limited, these results lend further institutional collaboration.
credibility to the argument that RCDP may be superior to IS Another factor contributing to our inability to detect
for ACLS training. significant differences in many time-based metrics may be the
While RCDP-trained learners in our study exhibited learner level studied. By its very nature, RCDP serves as a
trends toward other favorable ACLS metrics, there were no method to develop perfect practice. Providing the learner
other statistically significant differences. Prior work has with real-time feedback and coaching builds micro-skill
demonstrated improvement in time to defibrillation, initial development and mastery, as opposed to proficiency alone.
chest compression, and backboard placement with RCDP This study focused on PGY-1 residents for two reasons. First,
training in pediatric resuscitations.13,15,20 Our work does not in an effort to avoid confounding by variations in training,
independently support these findings; however, our trends we studied PGY-1 level learners in their first month of
are in line with existing literature. residency. Second, we excluded advanced learners due to
Time to first defibrillation suggested favorability in the concerns that their involvement would confound the
RCDP group (93 vs 150 seconds [sec]), although differences study of the junior learner through advancing the
did not reach statistical significance. This distinction is performance of the entire group. Conversely, prior work that
important, however, as the RCDP group was able perform found differences in similar categories evaluated learners
this action within the AHA’s “Get with the Guidelines” from PGY levels 1–3 or studied larger learner groups.14,15,27
recommendation of first defibrillation in less than two Therefore, true skill mastery may be more attainable
minutes. Similarly, time to first epinephrine administration in through the inclusion of more advanced learners
RCDP vs IS (131 vs 158 sec), suggests reduced time in the and may contribute to more statistically significant
RCDP group without reaching statistical significance. Both results.13,15 Conversely, the inclusion of more advanced
groups performed within the five-minute metric outline from learners may influence the entire group, leading to a
“Get with the Guidelines” recommendations. As both more uniform performance. This may limit or
groups performed well with this action, obtaining statistical reduce observable differences between
significance may prove difficult. It is unclear why other instructional methods.
Hunt et al also notes a dose response with RCDP (ie, response rate, but due to the nature of our five-point Likert-
increasing experience and repetition fosters improved type question scale, the potential for neutral bias exists.
performance and skill mastery).13 We studied the learners’ Due to the frequent interruptions associated with the
first performance, but we did not conduct additional RCDP method, RCDP participants were able to rotate
simulated experiences beyond this. Further repetition may through each role on the resuscitation team. However, IS
have expanded differences in RCDP and IS groups. groups did not have an opportunity to change roles as a part
A common goal of simulation in medical education is to of their training, and this introduces a confounder in
reduce the stress and anxiety experienced by the learner, and comparing the learner experience as well as proficiency
this is especially true for high-stakes scenarios such as the between these instructional methods.
care of a pulseless patient. However, the simulation Finally, this study focused on time to completion of
experience can be independently stressful for learners, and critical actions but did not assess the quality of those actions,
prior work has suggested that RCDP-based instruction may including factors such as chest compression fraction (CCF).
provide an overall preferred experience. This is well However, CCF has been previously studied and found to be
illustrated by the work of Chancey et al, whose learners superior in groups undergoing RCDP-based instruction as
expressed a preference for the frequent interruptions and compared to standard IS.13,20,27
improved sense of emotional security associated with RCDP
instruction.25 Chancey’s learners also reported increased CONCLUSION
confidence in their own resuscitation skills. Our results Rapid cycle deliberate practice was favored by learners for
support these findings, demonstrating an increased ACLS-based CPR instruction, improving self-perceived
confidence in ability to participate in the RCDP groups. skills and reducing pause duration. This suggests RCDP is a
Similarly, our learners reported lower stress levels valid strategy to teach residents ACLS-based CPR and
experienced during their RCDP-based simulation. supports further investigation of RCDP in other settings.
LIMITATIONS
Due to the study’s nature, blinding participants and Address for Correspondence: Jaron D. Raper, MD, University of
AQ1
facilitators was not possible. Skill retention was not assessed, Alabama at Birmingham, Department of Emergency Medicine,
and the small sample size limits generalizability. business address, Birmingham, AL zip. Email: jdraper@uabmc.edu
Additionally, while all facilitators had undergone
Conflicts of Interest: By the WestJEM article submission agreement,
standardized training in both instructional methods,
all authors are required to disclose all affiliations, funding sources
individual facilitators may have been more effective at one and financial or management relationships that could be perceived
strategy vs the other. All participating residents completed a as potential sources of bias. No author has professional or financial
standard ACLS course in the two weeks preceding the study. relationships with any companies that are relevant to this study.
Also, most of the residents had significant experience as part There are no conflicts of interest or sources of funding to declare.
of resuscitation teams (Table 1). As a result, there may have
been less of a difference in performance between the two Copyright: © 2024 Raper et al. This is an open access article
distributed in accordance with the terms of the Creative Commons
groups. Our study found RCDP was well received by our
Attribution (CC BY 4.0) License. See: http://creativecommons.org/
learners, but the data is limited by learner evaluation at licenses/by/4.0/
Kirkpatrick levels I and II. While we believe learner
perceptions in instruction are important for engagement,
future investigations should focus on objective REFERENCES
impacts and clinical performance with 1. Taniguchi D, Baernstein A, Nichol G. Cardiac arrest: a public health
patient-oriented outcomes. perspective. Emerg Med Clin North Am. 2012;30(1):1–12.
Surveys were not based on any prior survey instrument but 2. Coute RA, Nathanson BH, Mader TJ, et al. Trend analysis of disability-
were created, reviewed, and edited by the research team. The adjusted life years following adult out-of-hospital cardiac arrest in the
surveys were novel instruments, and we did not obtain United States: A study from the CARES Surveillance Group.
validity evidence prior to their use. Recall bias was
Resuscitation. 2021;163:124–129.
minimized through the implementation of surveys
3. Perkins GD and Cooke MW. Variability in cardiac arrest survival: the
immediately following instruction and performance of the
NHS Ambulance Service Quality Indicators. Emerg Med J.
learners. We were unable to eliminate the effects of social
2012;29(1):3–5.
desirability bias for our learners and suspect that learners
would tend to report improved performance regardless of 4. Cheng A, Nadkarni VM, Mancini MB, et al. American Heart Association
instructional method. However, the potential for this bias Education Science Investigators; on behalf of the American Heart
existed in both RCDP and IS groups. Sampling and non- Association Education Science and Programs Committee, Council on
response bias were not factors secondary to our 100% Cardiopulmonary, Critical Care, Perioperative and Resuscitation;
Council on Cardiovascular and Stroke Nursing; and Council on Quality controlled trial of simulation-based education. AEM Educ Train.
of Care and Outcomes Research. Resuscitation education science: 2021;5(4):e10702.
educational strategies to improve outcomes from cardiac arrest: a 16. Won SK, Doughty CB, Young AL, et al. Rapid cycle deliberate practice
scientific statement from the American Heart Association. Circulation. improves retention of pediatric resuscitation skills compared with
2018;138(6):e82–122. postsimulation debriefing. Simul Healthc. 2022;17(1):e20–7.
5. Committee on the Treatment of Cardiac Arrest: Current Status and 17. Gross TI, Abraham DG, Kumar A, et al. Rapid cycle deliberate practice
Future Directions; Board on Health Sciences Policy; Institute of (RCDP) as a method to improve airway management skills – a
Medicine. (2015). In: Graham R, McCoy MA, Schultz AM (Eds.), randomized controlled simulation study. Cureus. 2019;11(9):e5546.
Strategies to Improve Cardiac Arrest Survival: A Time to Act (first page 18. Oliveira HC, Souza LC, Leite TC, et al. Personal protective equipment in
AQ3 of chapter-last page). Washington, DC: National Academies Press (US). the coronavirus pandemic: training with rapid cycle deliberate practice.
6. Cummins RO, Thies W, Paraskos J, et al. Encouraging early Rev Bras Enferm. 2020;73Suppl 2(Suppl 2):e20200303.
English, Portuguese.
defibrillation: the American Heart Association and automated external
19. Pascoal E, Mueller V, Morais M. Rapid cycle deliberate practice versus
defibrillators. Ann Emerg Med. 1990;19(11):1245–8.
traditional simulation to improve resident performance in forceps
7. Cheng A, Magid DJ, Auerbach M, et al. Part 6: Resuscitation Education
deliveries. J Obstet Gynaecol Can. 2022;44(8):934–7.
Science: 2020 American Heart Association Guidelines for
20. de Castro LT, Coriolano AM, Burckart K, et al. Rapid-cycle deliberate
Cardiopulmonary Resuscitation and Emergency Cardiovascular Care.
practice versus after-event debriefing clinical simulation in
Circulation. 2020;142(16_suppl_2):S551–79.
cardiopulmonary resuscitation: a cluster randomized trial. Adv Simul
8. Edmondson A. Psychological safety and learning behavior in work
(Lond). 2022;7(1):43.
teams. Adm Sci Q. 1999;44(2):350–83.
21. Kirkpatrick JD and Kirkpatrick WK.Association for talent development.
9. Cook DA, Brydges R, Hamstra SJ, et al. Comparative effectiveness of
In: Kirkpatrick’s Four Levels of Training Evaluation (73-90). Alexandria,
technology-enhanced simulation versus other instructional methods. A
VA: ATD Press; 2016.
systematic review and meta-analysis. Simul Healthc. 2012;7(5):308–20.
22. Stuart A. A test for homogeneity of the marginal distributions in a
10. McGaghie WC, Issenberg SB, Petrusa ER, et al. Effect of practice on
two-way classification. Biometrika. 1955;42(3–4):412–6.
standardized learning outcomes in simulation-based medical education.
23. Crowley CP, Salciccioli JD, Kim EY. The association between ACLS
Med Educ. 2006;40(8):792–7.
guideline deviations and outcomes from in-hospital cardiac arrest.
11. Wayne DB, Butter J, Siddall VJ, et al. Simulation-based training of
Resuscitation. 2020;153:65–70.
internal medicine residents in advanced cardiac life support protocols: a
24. Bhanji F, Donoghue AJ, Wolff MS, et al. Part 14: Education: 2015
randomized trial. Teach Learn Med. 2005;17(3):210–6. American Heart Association Guidelines Update for Cardiopulmonary
12. Ericsson KA. Deliberate practice and the acquisition and maintenance of Resuscitation and Emergency Cardiovascular Care. Circulation.
expert performance in medicine and related domains. Acad Med. 2015;132(suppl 2):S561–73.
2004;79(10 Suppl):S70–81. 25. Chancey R, Sampayo E, Lemke D, et al. Learners’ experiences during
13. Hunt EA, Duval-Arnould JM, Nelson-McMillan KL, et al. Pediatric rapid cycle deliberate practice simulations: a qualitative analysis. Simul
resident resuscitation skills improve after “rapid cycle deliberate Healthc. 2019;14(1):18–28.
practice” training. Resuscitation. 2014;85(7):945–51. 26. Cheskes S, Schmicker RH, Christenson J, et al. Perishock pause: an
14. Lemke DS, Fielder EK, Hsu DC, et al. Improved team performance independent predictor of survival from out-of-hospital shockable cardiac
during pediatric resuscitations after rapid cycle deliberate practice arrest. Circulation. 2011;124(1):58–66.
compared with traditional debriefing: a pilot study. Pediatr Emerg Care. 27. Hunt EA, Duval-Arnould JM, Chime NO, et al. Integration of in-hospital
2019;35(7):480–86. cardiac arrest contextual curriculum into a basic life support course: a
15. Lemke DS, Young AL, Won SK, et al. Rapid-cycle deliberate practice randomized, controlled simulation study. Resuscitation.
improves time to defibrillation and reduces workload: a randomized 2017;114:127–32.
AQ2 Request that authors review suggested response to the question and edit it as needed.