A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: a pre-post study using full immersion simulation

AIMS AND OBJECTIVES: The aim of this study was to evaluate the effect of the new evidence-informed nursing assessment framework HIRAID (History, Identify Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) on the quality of patient assessment and fundamental nontechnical skills including communication, decision making, task management and situational awareness. BACKGROUND: Assessment is a core component of nursing practice and underpins clinical decisions and the safe delivery of patient care. Yet there is no universal or validated system used to teach emergency nurses how to comprehensively assess and care for patients. DESIGN: A pre-post design was used. METHODS: The performance of thirty eight emergency nurses from five Australian hospitals was evaluated before and after undertaking education in the application of the HIRAID assessment framework. Video recordings of participant performance in immersive simulations of common presentations to the emergency department were evaluated, as well as participant documentation during the simulations. Paired parametric and nonparametric tests were used to compare changes from pre to postintervention. RESULTS: From pre to postintervention, participant performance increases were observed in the percentage of patient history elements collected, critical indicators of urgency collected and reported to medical officers, and patient reassessments performed. Participants also demonstrated improvement in each of the four nontechnical skills categories: communication, decision making, task management and situational awareness. CONCLUSION: The HIRAID assessment framework improves clinical patient assessments performed by emergency nurses and has the potential to enhance patient care. RELEVANCE TO CLINICAL PRACTICE: HIRAID should be considered for integration into clinical practice to provide nurses with a systematic approach to patient assessment and potentially improve the delivery of safe patient care.

A pedagogically-supported TEL solution for learning nontechnical minimally invasive surgical skills across Europe

Residents learning nontechnical skills in Europe face two problems: (1) the difficulty to fit learning time in their overloaded schedules; and (2) the lack of standard pedagogical models for all countries. Online video-based repositories such as WeBSurg or WebOP provide ubiquitous access to surgical contents. However, their pedagogical facets have not been fully exploited and they are often seen as quick-reference repositories rather than full e-learning alternatives. We present a new pedagogically-supported Technology Enhanced Learning (TEL) solution, MISTELA, designed by surgeons, pedagogical experts and engineers. MISTELA aims at building a common European pedagogical model supported by ICT technologies and elearning. The solution proposes a pedagogical model based on a framework for pedagogically-informed design of e-learning platforms. It is composed of (1) an authoring tool for editing and augmenting videos; (2) a media asset management system; and (3) a virtual learning environment. Support of the European Association for Endoscopic Surgery (EAES) and validation of the solution, will help to determine its full potential.

Measuring multidisciplinary team effectiveness in a ward-based healthcare setting : development of the Team Functioning Assessment Tool

Nontechnical skills relating to team functioning are vital to the effective delivery of patient care and safety. In this study, we develop a reliable behavioral marker tool for assessing nontechnical skills that are critical to the success of ward-based multidisciplinary healthcare teams. The Team Functioning Assessment Tool (TFAT) was developed and refined using a literature review, focus groups, card-sorting exercise, field observations, and final questionnaire evaluation and refinement process. Results demonstrated that Clinical Planning, Executive Tasks, and Team Relations are important facets of effective multidisciplinary healthcare team functioning. The TFAT was also shown to yield acceptable inter-rater agreement.

Measuring ward-based multidisciplinary healthcare team functioning : a validation study of the Team Functioning Assessment Tool (TFAT)

The team functioning assessment tool (TFAT) has been shown to be a reliable behavioral marker tool for assessing nontechnical skills that are critical to the success of ward-based healthcare teams. This paper aims to refine and shorten the length of the TFAT to improve usability, and establish its reliability and construct validity. Psychometric testing based on 110 multidisciplinary healthcare teams demonstrated that the TFAT is a reliable and valid tool for measuring team members’ nontechnical skills in regards to Clinical Planning, Executive Tasks, and Team Functioning. Providing support for concurrent validity, high TFAT ratings were predicted by low levels of organizational constraints and high levels of group potency. There was also partial support for the negative relationships between time pressure, leadership ambiguity, and TFAT ratings. The paper provides a discussion on the applicability of the tool for assessing multidisciplinary healthcare team functioning in the context of improving team effectiveness and patient safety for ward-based hospital teams.

Can Safe Clinical Thinking be Taught?

OBJECTIVES: To determine if: (a) safe clinical decision making can be taught to undergraduate final year medical students and (b) if such students can be taught to specifically recognise illness severity from nominal clinical data. 
METHODS: 115 final year undergraduate medical students completed a 3 hour interactive Safe Thinking Workshop which focussed entirely on nontechnical skills such as potential perceptive pitfalls, attention to detail, teamwork and safe clinical decision making. The study involved students inspecting and interpreting a set of arterial blood gas results relating to a patient with acute respiratory distress, then answering a short questionnaire addressing biochemical diagnosis, clinical diagnosis and effective management. A separate question was embedded in the questionnaire to determine if astute students could determine the severity of the illness from the CO2 value provided. The study group (n = 58) completed the questionnaire immediately after the Safe Thinking Workshop, whilst the control group (n = 57) completed the questionnaire prior to the Workshop.
RESULTS: The mean total score for study students was 80.51%, with a mean total score of 63.86% for the control group (Student’s t-test; p<0.05). Correct classification of illness severity was observed in 10.35% of study students, compared with 3.51% of control students (p<0.05). 
CONCLUSION: These results suggest that safe clinical decision making and recognition of illness severity can be fostered by specific teaching in the nontechnical skill areas described above.

Metacognition in Patient Safety

OBJECTIVES: To determine if cognitive reflection has a positive influence on clinical decision making in undergraduate medical students. METHODS: 153 final year undergraduate medical students completed a 3 hour interactive Safe Thinking Workshop on nontechnical skills and patient safety, incorporating an introduction to metacognitive concepts. All students underwent augmented Cognitive Reflective Testing during the workshop. Students then inspected and interpreted a set of arterial blood gas results relating to a patient with acute respiratory distress, then answered a short questionnaire addressing biochemical diagnosis, clinical diagnosis and effective management. A separate question was embedded in the questionnaire to determine if astute students could determine the severity of the illness. The study group (n = 78) completed the questionnaire immediately after the Safe Thinking Workshop, whilst the control group (n = 75) completed the questionnaire prior to the Workshop.RESULTS: The mean total score for study students was 80.51%, with a mean total score of 57.9% for the control group (t-test; p<0.05). Correct classification of illness severity was observed in 13.2% of study students, compared with 4.1% of control students (p<0.05). CONCLUSION: These results suggest that clinical decision making and recognition of illness severity can be enhanced by specific teaching in nontechnical skills, metacognitiion and cognitive reflection.

Managing women with acute physiological deterioration: student midwives performance in a simulated setting

OBJECTIVE: Midwives' ability to manage maternal deterioration and 'failure to rescue' are of concern with questions over knowledge, clinical skills and the implications for maternal morbidity and, mortality rates. In a simulated setting our objective was to assess student midwives' ability to assess, and manage maternal deterioration using measures of knowledge, situation awareness and skill, performance. METHODS: An exploratory quantitative analysis of student performance based upon performance, ratings derived from knowledge tests and observational ratings. During 2010 thirty-five student, midwives attended a simulation laboratory completing a knowledge questionnaire and two video, recorded simulated scenarios. Patient actresses wearing a 'birthing suit' simulated deteriorating, women with post-partum and ante-partum haemorrhage (PPH and APH). Situation awareness was, measured at the end of each scenario. Applicable descriptive and inferential statistical tests were, applied to the data. FINDINGS: The mean total knowledge score was 75% (range 46-91%) with low skill performance, means for both scenarios 54% (range 39-70%). There was no difference in performance between the scenarios, however performance of key observations decreased as the women deteriorated; with significant reductions in key vital signs such as blood pressure and blood loss measurements. Situation, awareness scores were also low (54%) with awareness decreasing significantly (t(32)=2.247, p=0.032), in the second and more difficult APH scenario. CONCLUSION: Whilst knowledge levels were generally good, skills were generally poor and decreased as the women deteriorated. Such failures to apply knowledge in emergency stressful situations may be resolved by repetitive high stakes and high fidelity simulation.

A Video Analysis of Intra- and Inter-professional Leadership Behaviours Within “The Burns Suite”: Identifying Key Leadership Models

Objective Leadership is particularly important in complex highly interprofessional health care contexts involving a number of staff, some from the same specialty (intraprofessional), and others from different specialties (interprofessional). The authors recently published the concept of “The Burns Suite” (TBS) as a novel simulation tool to deliver interprofessional and teamwork training. It is unclear which leadership behaviors are the most important in an interprofessional burns resuscitation scenario, and whether they can be modeled on to current leadership theory. The purpose of this study was to perform a comprehensive video analysis of leadership behaviors within TBS. Methods A total of 3 burns resuscitation simulations within TBS were recorded. The video analysis was grounded-theory inspired. Using predefined criteria, actions/interactions deemed as leadership behaviors were identified. Using an inductive iterative process, 8 main leadership behaviors were identified. Cohen’s κ coefficient was used to measure inter-rater agreement and calculated as κ = 0.7 (substantial agreement). Each video was watched 4 times, focusing on 1 of the 4 team members per viewing (senior surgeon, senior nurse, trainee surgeon, and trainee nurse). The frequency and types of leadership behavior of each of the 4 team members were recorded. Statistical significance to assess any differences was assessed using analysis of variance, whereby a p < 0.05 was taken to be significant. Leadership behaviors were triangulated with verbal cues and actions from the videos. Results All 3 scenarios were successfully completed. The mean scenario length was 22 minutes. A total of 362 leadership behaviors were recorded from the 12 participants. The most evident leadership behaviors of all team members were adhering to guidelines (which effectively equates to following Advanced Trauma and Life Support/Emergency Management of Severe Burns resuscitation guidelines and hence “maintaining standards”), followed by making decisions. Although in terms of total frequency the senior surgeon engaged in more leadership behaviors compared with the entire team, statistically there was no significant difference between all 4 members within the 8 leadership categories. This analysis highlights that “distributed leadership” was predominant, whereby leadership was “distributed” or “shared” among team members. The leadership behaviors within TBS also seemed to fall in line with the “direction, alignment, and commitment” ontology. Conclusions Effective leadership is essential for successful functioning of work teams and accomplishment of task goals. As the resuscitation of a patient with major burns is a dynamic event, team leaders require flexibility in their leadership behaviors to effectively adapt to changing situations. Understanding leadership behaviors of different team members within an authentic simulation can identify important behaviors required to optimize nontechnical skills in a major resuscitation. Furthermore, attempting to map these behaviors on to leadership models can help further our understanding of leadership theory. Collectively this can aid the development of refined simulation scenarios for team members, and can be extrapolated into other areas of simulation-based team training and interprofessional education.