Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges

Cost-effectiveness of peer role play and standardized patients in undergraduate communication training.

BACKGROUND The few studies directly comparing the methodological approach of peer role play (RP) and standardized patients (SP) for the delivery of communication skills all suggest that both methods are effective. In this study we calculated the costs of both methods (given comparable outcomes) and are the first to generate a differential cost-effectiveness analysis of both methods. METHODS Medical students in their prefinal year were randomly assigned to one of two groups receiving communication training in Pediatrics either with RP (N = 34) or 19 individually trained SP (N = 35). In an OSCE with standardized patients using the Calgary-Cambridge Referenced Observation Guide both groups achieved comparable high scores (results published). In this study, corresponding costs were assessed as man-hours resulting from hours of work of SP and tutors. A cost-effectiveness analysis was performed. RESULTS Cost-effectiveness analysis revealed a major advantage for RP as compared to SP (112 vs. 172 man hours; cost effectiveness ratio .74 vs. .45) at comparable performance levels after training with both methods. CONCLUSIONS While both peer role play and training with standardized patients have their value in medical curricula, RP has a major advantage in terms of cost-effectiveness. This could be taken into account in future decisions.

Impact of case-relevant and case-irrelevant communication within the surgical team on surgical-site infection

BACKGROUND Surgical-site infections (SSIs) are the most common complications after surgery. An influence from talking and distractions during surgery on patient outcomes has been suggested, but there is limited evidence. The aim of this prospective observational study was to assess the relationship between intraoperative communication within the surgical team and SSI, and between intraoperative distractions and SSI. METHODS This prospective observational study included patients undergoing elective, open abdominal procedures. For each procedure, intraoperative case-relevant and case-irrelevant communication, and intraoperative distractions were observed continuously on site. The influence of communication and distractions on SSI after surgery was assessed using logistic regressions, adjusting for risk factors. RESULTS A total of 167 observed procedures were analysed; their mean(s.d.) duration was 4·6(2·1) h. A total of 24 SSIs (14·4 per cent) were diagnosed. Case-relevant communication during the procedure was independently associated with a reduced incidence of organ/space SSI (propensity score-adjusted odds ratio 0·86, 95 per cent c.i. 0·77 to 0·97; P = 0·014). Case-irrelevant communication during the closing phase of the procedure was independently associated with increased incidence of incisional SSI (propensity score-adjusted odds ratio 1·29, 1·08 to 1·55; P = 0·006). Distractions had no association with SSI. CONCLUSION More case-relevant communication was associated with fewer organ/space SSIs, and more case-irrelevant communication during wound closure was associated with incisional SSI.

The pragmatics of computer-mediated communication between South African and Mexican drug traffickers

South Africa and Mexico are ripe with drug trafficking. The gangs and syndicates running the drug businesses in these two countries collaborate occasionally. Communication between these international drug business partners takes place on social media. Their main language of communication is English, mixed with some limited use of Spanish and Afrikaans. The key purpose of the interactions between the South African and Mexican parties is the organisation of their business activities. This study aims at examining how the drug traffickers position each other and themselves regarding their common business interest and how their relationship evolves throughout their interactions. Moreover, it is of interest to look at how these people make use of different social media and their affordances. For this a qualitative analysis of the interaction between two drug traffickers (one South African and one Mexican) on Facebook, Threema and PlayStation 4 was performed. Computer-mediated communication between these two main informants was studied at various stages of their relationship. Results show that at first the interaction between the South African and Mexican drug traffickers consists of interpersonal negotiations of power. The high risk of the drug business and gang/syndicate membership paired with intercultural frictions causes the two interlocutors to be extremely cautious and at the same time to mark their position. As their relationship develops and they gain trust in each other a shift to interpersonal negotiations of solidarity takes place. In these discursive practices diverse linguistic strategies are employed for creating relational effects and for positioning the other and the self. The discursive activities of the interactants are also identity practices. Thus, the two drug traffickers construct identities through these social practices, positioning and their interpersonal relationship.