A pedagogically-supported TEL solution for learning nontechnical minimally invasive surgical skills across Europe

Residents learning nontechnical skills in Europe face two problems: (1) the difficulty to fit learning time in their overloaded schedules; and (2) the lack of standard pedagogical models for all countries. Online video-based repositories such as WeBSurg or WebOP provide ubiquitous access to surgical contents. However, their pedagogical facets have not been fully exploited and they are often seen as quick-reference repositories rather than full e-learning alternatives. We present a new pedagogically-supported Technology Enhanced Learning (TEL) solution, MISTELA, designed by surgeons, pedagogical experts and engineers. MISTELA aims at building a common European pedagogical model supported by ICT technologies and elearning. The solution proposes a pedagogical model based on a framework for pedagogically-informed design of e-learning platforms. It is composed of (1) an authoring tool for editing and augmenting videos; (2) a media asset management system; and (3) a virtual learning environment. Support of the European Association for Endoscopic Surgery (EAES) and validation of the solution, will help to determine its full potential.

Measuring multidisciplinary team effectiveness in a ward-based healthcare setting : development of the Team Functioning Assessment Tool

Nontechnical skills relating to team functioning are vital to the effective delivery of patient care and safety. In this study, we develop a reliable behavioral marker tool for assessing nontechnical skills that are critical to the success of ward-based multidisciplinary healthcare teams. The Team Functioning Assessment Tool (TFAT) was developed and refined using a literature review, focus groups, card-sorting exercise, field observations, and final questionnaire evaluation and refinement process. Results demonstrated that Clinical Planning, Executive Tasks, and Team Relations are important facets of effective multidisciplinary healthcare team functioning. The TFAT was also shown to yield acceptable inter-rater agreement.

Measuring ward-based multidisciplinary healthcare team functioning : a validation study of the Team Functioning Assessment Tool (TFAT)

The team functioning assessment tool (TFAT) has been shown to be a reliable behavioral marker tool for assessing nontechnical skills that are critical to the success of ward-based healthcare teams. This paper aims to refine and shorten the length of the TFAT to improve usability, and establish its reliability and construct validity. Psychometric testing based on 110 multidisciplinary healthcare teams demonstrated that the TFAT is a reliable and valid tool for measuring team members’ nontechnical skills in regards to Clinical Planning, Executive Tasks, and Team Functioning. Providing support for concurrent validity, high TFAT ratings were predicted by low levels of organizational constraints and high levels of group potency. There was also partial support for the negative relationships between time pressure, leadership ambiguity, and TFAT ratings. The paper provides a discussion on the applicability of the tool for assessing multidisciplinary healthcare team functioning in the context of improving team effectiveness and patient safety for ward-based hospital teams.

Can Safe Clinical Thinking be Taught?

OBJECTIVES: To determine if: (a) safe clinical decision making can be taught to undergraduate final year medical students and (b) if such students can be taught to specifically recognise illness severity from nominal clinical data. 
METHODS: 115 final year undergraduate medical students completed a 3 hour interactive Safe Thinking Workshop which focussed entirely on nontechnical skills such as potential perceptive pitfalls, attention to detail, teamwork and safe clinical decision making. The study involved students inspecting and interpreting a set of arterial blood gas results relating to a patient with acute respiratory distress, then answering a short questionnaire addressing biochemical diagnosis, clinical diagnosis and effective management. A separate question was embedded in the questionnaire to determine if astute students could determine the severity of the illness from the CO2 value provided. The study group (n = 58) completed the questionnaire immediately after the Safe Thinking Workshop, whilst the control group (n = 57) completed the questionnaire prior to the Workshop.
RESULTS: The mean total score for study students was 80.51%, with a mean total score of 63.86% for the control group (Student’s t-test; p<0.05). Correct classification of illness severity was observed in 10.35% of study students, compared with 3.51% of control students (p<0.05). 
CONCLUSION: These results suggest that safe clinical decision making and recognition of illness severity can be fostered by specific teaching in the nontechnical skill areas described above.

Metacognition in Patient Safety

OBJECTIVES: To determine if cognitive reflection has a positive influence on clinical decision making in undergraduate medical students. METHODS: 153 final year undergraduate medical students completed a 3 hour interactive Safe Thinking Workshop on nontechnical skills and patient safety, incorporating an introduction to metacognitive concepts. All students underwent augmented Cognitive Reflective Testing during the workshop. Students then inspected and interpreted a set of arterial blood gas results relating to a patient with acute respiratory distress, then answered a short questionnaire addressing biochemical diagnosis, clinical diagnosis and effective management. A separate question was embedded in the questionnaire to determine if astute students could determine the severity of the illness. The study group (n = 78) completed the questionnaire immediately after the Safe Thinking Workshop, whilst the control group (n = 75) completed the questionnaire prior to the Workshop.RESULTS: The mean total score for study students was 80.51%, with a mean total score of 57.9% for the control group (t-test; p<0.05). Correct classification of illness severity was observed in 13.2% of study students, compared with 4.1% of control students (p<0.05). CONCLUSION: These results suggest that clinical decision making and recognition of illness severity can be enhanced by specific teaching in nontechnical skills, metacognitiion and cognitive reflection.

A Video Analysis of Intra- and Inter-professional Leadership Behaviours Within “The Burns Suite”: Identifying Key Leadership Models

Objective Leadership is particularly important in complex highly interprofessional health care contexts involving a number of staff, some from the same specialty (intraprofessional), and others from different specialties (interprofessional). The authors recently published the concept of “The Burns Suite” (TBS) as a novel simulation tool to deliver interprofessional and teamwork training. It is unclear which leadership behaviors are the most important in an interprofessional burns resuscitation scenario, and whether they can be modeled on to current leadership theory. The purpose of this study was to perform a comprehensive video analysis of leadership behaviors within TBS. Methods A total of 3 burns resuscitation simulations within TBS were recorded. The video analysis was grounded-theory inspired. Using predefined criteria, actions/interactions deemed as leadership behaviors were identified. Using an inductive iterative process, 8 main leadership behaviors were identified. Cohen’s κ coefficient was used to measure inter-rater agreement and calculated as κ = 0.7 (substantial agreement). Each video was watched 4 times, focusing on 1 of the 4 team members per viewing (senior surgeon, senior nurse, trainee surgeon, and trainee nurse). The frequency and types of leadership behavior of each of the 4 team members were recorded. Statistical significance to assess any differences was assessed using analysis of variance, whereby a p < 0.05 was taken to be significant. Leadership behaviors were triangulated with verbal cues and actions from the videos. Results All 3 scenarios were successfully completed. The mean scenario length was 22 minutes. A total of 362 leadership behaviors were recorded from the 12 participants. The most evident leadership behaviors of all team members were adhering to guidelines (which effectively equates to following Advanced Trauma and Life Support/Emergency Management of Severe Burns resuscitation guidelines and hence “maintaining standards”), followed by making decisions. Although in terms of total frequency the senior surgeon engaged in more leadership behaviors compared with the entire team, statistically there was no significant difference between all 4 members within the 8 leadership categories. This analysis highlights that “distributed leadership” was predominant, whereby leadership was “distributed” or “shared” among team members. The leadership behaviors within TBS also seemed to fall in line with the “direction, alignment, and commitment” ontology. Conclusions Effective leadership is essential for successful functioning of work teams and accomplishment of task goals. As the resuscitation of a patient with major burns is a dynamic event, team leaders require flexibility in their leadership behaviors to effectively adapt to changing situations. Understanding leadership behaviors of different team members within an authentic simulation can identify important behaviors required to optimize nontechnical skills in a major resuscitation. Furthermore, attempting to map these behaviors on to leadership models can help further our understanding of leadership theory. Collectively this can aid the development of refined simulation scenarios for team members, and can be extrapolated into other areas of simulation-based team training and interprofessional education.