Gene Hobbs
University of North Carolina at Chapel Hill, Pediatrics, Faculty Member
Research Interests:
The authors developed a Standardized Assessment for Evaluation of Team Skills (SAFE-TeamS) in which actors portray health care team members in simulated challenging teamwork scenarios. Participants are scored on scenario-specific ideal... more
The authors developed a Standardized Assessment for Evaluation of Team Skills (SAFE-TeamS) in which actors portray health care team members in simulated challenging teamwork scenarios. Participants are scored on scenario-specific ideal behaviors associated with assistance, conflict resolution, communication, assertion, and situation assessment. This research sought to provide evidence of the validity and feasibility of SAFE-TeamS as a tool to support the advancement of science related to team skills training. Thirty-eight medical and nursing students were assessed using SAFE-TeamS before and after team skills training. The SAFE-TeamS pretraining and posttraining scores were compared, and participants were surveyed. Generalizability analysis was used to estimate the variance in scores associated with the following: examinee, scenario, rater, pretraining/posttraining, examinee type, rater type (actor-live vs. external rater-videotape), actor team, and scenario order. The SAFE-TeamS scores reflected improvement after training and were sensitive to individual differences. Score variance due to rater was low. Variance due to scenario was moderate. Estimates of relative reliability for 2 raters and 8 scenarios ranged from 0.6 to 0.7. With fixed scenarios and raters, 2 raters and 2 scenarios, reliability is greater than 0.8. Raters believed SAFE-TeamS assessed relevant team skills. Examinees' responses were mixed. The SAFE-TeamS was sensitive to individual differences and team skill training, providing evidence for validity. It is not clear whether different scenarios measure different skills and whether the scenarios cover the necessary breadth of skills. Use of multiple scenarios will support assessment across a broader range of skills. Future research is required to determine whether assessments using SAFE-TeamS will translate to performance in clinical practice.
Research Interests:
Research Interests:
"Simulation Roulette" is a new method of... more
"Simulation Roulette" is a new method of "on-the-fly" simulation scenario creation that incorporates a game-like approach to critical scenarios and emphasizes prescenario preparation. We designed it to complement our traditional anesthesia simulation curriculum, in which residents are exposed to predefined "critical" scenarios. During typical scenarios, trainees are often given minimum preparatory information; they then start the scenario knowing only that "something bad" is going to happen. As a result, trainees often report anxiety, which can be a barrier to learning. To overcome this barrier and to augment traditional critical incident training, we developed the "Simulation Roulette" game. "Simulation Roulette" consists of premade cards that are randomly selected to create a patient, another set of premade cards to assist in selecting "complications," worksheets to guide a thorough "prebrief" discussion before the scenario, and scoresheets to facilitate the "debrief" discussion at the end. Similar to traditional scenarios, it requires coordination by a facilitator to ensure plausible scenarios and evaluation of trainee performance. Although we have not conducted formal testing, we believe that (1) incorporating an element of random chance to scenario selection, (2) using a game-like framework, and (3) emphasizing the "prebrief" portion of simulation all have the potential to decrease trainee anxiety. We present the rationale for designing such a game; examples of instructions, cards, and scoresheets; and our initial experience with implementing this game within our simulation curriculum.