Individual Video Training iVT - Development of a National Infrastructure for Video-Supported Learning

Introduction: Video‐Supported Learning is particularly effective when it comes to skills and behaviors. Video registration of patient‐physician interviews, class room instruction or practical skills allow it to learners themselves, their peers, and their tutors to assess the quality of the learner's performance, to give specific feedback, and to make suggestions for improvement. Methods: In Switzerland, four pedagogical universities and two medical faculties joined to initiate the development of a national infrastructure for Video Supported Learning. The goal was to have a system that is simple to use, has most steps automated, provides the videos over the Internet, and has a sophisticated access control. Together with SWITCH, the national IT‐Support‐Organisation for Swiss Universities, the program iVT (Individual Video Training) was developed by integrating two preexisting technologies. The first technology is SWITCHcast, a podcast system. With SWITCHcast, videos are automatically uploaded to a server as soon as the registration is over. There the videos are processed and converted to different formats. The second technology is the national Single Logon System AAI (Authentification and Authorization Infrastructure) that enables iVT to link each video with the corresponding learner. The learner starts the registration with his Single Logon. Thus, the video can unambiguously be assigned. Via his institution's Learning Management System (LMS), the learner can access his video and give access to his video to peers and tutors. Results: iVT is now used at all involved institutions. The system works flawlessly. In Bern, we use iVT for the communications skills training in the forth and sixth year. Since students meet with patient actors alone, iVT is also used to certify attendance. Students are encouraged to watch the videos of the interview and the feedback of the patient actor. The offer to discuss a video with a tutor was not used by the students. Discussion: We plan to expand the use of iVT by making peer assessment compulsory. To support this, annotation capabilities are currently added to iVT. We also want to use iVT in training of practical skills, again for self as well as for peer assessment.  At present, we use iVT for quality control of patient actor's performance.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills-a controlled study.

BACKGROUND The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. METHODS All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. RESULTS At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. CONCLUSIONS Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional small group, interactive clinical skills course with feedback from various sources, improved these essential examination skills immediately after the teaching and several months later. We conclude that supplementary specific teaching activities are needed. Even a single, short-lasting targeted module can have a long lasting effect and is worth the additional effort.

Cost-effectiveness of peer role play and standardized patients in undergraduate communication training.

BACKGROUND The few studies directly comparing the methodological approach of peer role play (RP) and standardized patients (SP) for the delivery of communication skills all suggest that both methods are effective. In this study we calculated the costs of both methods (given comparable outcomes) and are the first to generate a differential cost-effectiveness analysis of both methods. METHODS Medical students in their prefinal year were randomly assigned to one of two groups receiving communication training in Pediatrics either with RP (N = 34) or 19 individually trained SP (N = 35). In an OSCE with standardized patients using the Calgary-Cambridge Referenced Observation Guide both groups achieved comparable high scores (results published). In this study, corresponding costs were assessed as man-hours resulting from hours of work of SP and tutors. A cost-effectiveness analysis was performed. RESULTS Cost-effectiveness analysis revealed a major advantage for RP as compared to SP (112 vs. 172 man hours; cost effectiveness ratio .74 vs. .45) at comparable performance levels after training with both methods. CONCLUSIONS While both peer role play and training with standardized patients have their value in medical curricula, RP has a major advantage in terms of cost-effectiveness. This could be taken into account in future decisions.

The "Profiles" document: a modern revision of the objectives of undergraduate medical studies in Switzerland

The Joint Commission of the Swiss Medical Schools (SMIFK/CIMS) decided in 2000 to establish a Swiss Catalogue of Learning Objectives (SCLO) for undergraduate medical training, which was adapted from a similar Dutch blueprint. A second version of the SCLO was developed and launched in 2008. The catalogue is a prerequisite for the accreditation of the curricula of the six Swiss medical faculties and defines the contents of the Federal Licensing Examination (FLE). Given the evolution of the field of medicine and of medical education, the SMIFK/CIMS has decided to embark on a total revision of the SCLO. This article presents the proposed structure and content of Profiles, a new document which, in the future, will direct the format of undergraduate studies and of the FLE. Profiles stands for the Principal Relevant Objectives for Integrative Learning and Education in Switzerland. It is currently being developed by a group of experts from the six Swiss faculties as well as representatives of other institutions involved in these developments. The foundations of Profiles are grounded in the evolution of medical practice and of public health and are based on up-to-date teaching concepts, such as EPAs (entrustable professional activities). An introduction will cover the concepts and a tutorial will be displayed. Three main chapters will provide a description of the seven 2015 CanMEDS roles, a list of core EPAs and a series of ≈250 situations embracing the most frequent and current conditions affecting health. As Profiles is still a work in progress, it is hoped that this paper will attract the interest of all individuals involved in the training of medical students.

Improving the Assessment of Communication Skills at the Swiss Federal Licensing Exam: Results of a Student's Needs Assessment

Introduction With a three year project the assessment of communication skills within the Swiss Federal Licensing Examinations (FLE) shall be improved. As a first step a needs assessment among communication experts and medical students of the Swiss Medical Faculties will be performed. In this presentation the results of the students’ needs assessment will be presented. Methods A bilingual student’s online questionnaire will be developed by an expert panel taking relevant literature, the Swiss Catalogue of Learning Objectives and other consensus statements for communication (e.g., the European and Basler consensus statements) into account. With a think aloud study response process validity evidence will be sought. The questionnaire will focus on the following topics related to communication skills: (1) What has been taught?, (2) What has been assessed in the faculty exams?, (3) What has been assessed in the FLE?, (4) What should have been assessed in the FLE and how should the assessment be improved? Results Results of the students’ needs assessment will be available by the end of 2015 and be presented. Conclusions/ Take-home message We hope for valuable input for improving the assessment of communications skills within the FLE also from the students’ side. Results of the needs assessment from the students and experts will be combined and taken as input for an international expert symposium on how to improve the communication skills assessment within the FLE.

Prevalence and severity of dental fluorosis among students from João Pessoa, PB, Brazil

The aim of this study was to determine the prevalence and severity of dental fluorosis among 12-15-year-old students from João Pessoa, PB, Brazil before starting a program of artificial fluoridation of drinking water. The use of fluoridated dentifrice was also surveyed. A sample of 1,402 students was randomly selected. However, 31 students refused to participate and 257 were not permanent residents in João Pessoa, thus leaving a final sample of 1,114 students. Clinical exams were carried out by two calibrated dentists (Kappa = 0.78) under natural indirect light. Upper and lower front teeth were cleaned with gauze and dried, and then examined using the TF index for fluorosis. A questionnaire on dentifrice ingestion and oral hygiene habits was applied to the students. The results revealed that fluorosis prevalence in this age group was higher than expected (29.2%). Most fluorosis cases were TF = 1 (66.8%), and the most severe cases were TF = 4 (2.2%). The majority of the students reported that they had been using fluoridated dentifrices since childhood; 95% of the participants preferred brands with a 1,500 ppm F concentration, and 40% remembered that they usually ingested or still ingest dentifrice during brushing. It was concluded that dental fluorosis prevalence among students in João Pessoa is higher than expected for an area with non-fluoridated water. However, although most students use fluoridated dentifrices, and almost half ingest slurry while brushing, the majority of cases had little aesthetic relevance from the professionals' point of view, thus suggesting that fluorosis is not a public health problem in the locality.

Influence of examiner's clinical experience on the reproducibility and accuracy of radiographic examination in detecting occlusal caries

The aim of this in vitro study was to assess the influence of varying examiner's clinical experience on the reproducibility and accuracy of radiographic examination for occlusal caries detection. Standardized bitewing radiographs were obtained from 166 permanent molars. Radiographic examination was performed by final-year dental students from two universities (A, n = 5; B, n = 5) and by dentists with 5 to 7 years of experience who work in two different countries (C, n = 5; D, n = 5). All examinations were repeated after 1-week interval. The teeth were histologically prepared and assessed for caries extension. For intraexaminer reproducibility, the unweighted kappa values were: A (0.11-0.40), B (0.12-0.33), C (0.47-0.58), and D (0.42-0.71). Interexaminer reproducibility statistics were computed based on means ± SD of unweighted kappa values: A (0.07 ± 0.05), B (0.12 ± 0.09), C (0.24 ± 0.08), and D (0.33 ± 0.10). Sensitivity, specificity, and accuracy were calculated at D(1) and D(3) thresholds and compared by performing McNemar test (p = 0.05). D(1) sensitivity ranged between 0.29 and 0.75 and specificity between 0.24 and 0.85. D(3) specificity was moderate to high (between 0.62 and 0.95) for all groups, with statistically significant difference between the dentists groups (C and D). Sensitivity was low to moderate (between 0.21 and 0.57) with statistically significant difference for groups B and D. Accuracy was similar for all groups (0.55). Spearman's correlations were: A (0.12), B (0.24), C (0.30), and D (0.38). In conclusion, the reproducibility of radiographic examination was influenced by the examiner's clinical experience, training, and dental education as well as the accuracy in detecting occlusal caries.

Evaluation of a novel needle guide for ultrasound-guided phantom vessel cannulation

We evaluated a novel, sled-mounted needle guide for ultrasound-guided vessel cannulation. Fifty medical students were randomly assigned to use ultrasound with the sled (sled group, n = 23) or ultrasound without the sled (control group, n = 27) for vessel cannulation in a phantom. For each of 15 attempts we recorded cannulation time and designated a successful cannulation as 1 and a failure as 0. Our primary outcome was the mean overall success rate. The median (IQR [range]) number of successes in the sled group and control group were 15.0 (13.0-15.0 [11.0-15.0]) and 11.0 (9.0-13.0 [6.0-15.0]), respectively (p < 0.001). Cannulation time decreased from the first to the last attempt in the sled group from 7.0 s (6.0-10.0 [4.0-16]) s to 4.0 s (3.0-4.0 [1.0-6.0]) s and in the control group from 35.0 s (27.0-35.0 [11.0-35.0]) s to 7.0 s (5.0-10.0 [3.0-25.0]) s. The sled group demonstrated a shorter cannulation time at each attempt (p < 0.001). The novel sled improved the success rate and efficiency of ultrasound-guided phantom vessel cannulation.

Repeat chlamydia screening among adolescents: cohort study in a school-based programme in New Orleans

OBJECTIVES To describe uptake of chlamydia screening, determine rates of repeated yearly screening and investigate determinants of repeated participation in an organised school-based screening programme. METHODS The authors analysed data from 1995 to 2005 from female and male students in up to 13 schools in New Orleans, Louisiana, USA. The authors calculated proportions of students tested among all enrolled students and among those with parental consent and the percentage of positive chlamydia tests in each school year. The authors used random effects logistic regression to examine the effect of past screening history on subsequent participation. RESULTS 35 041 students were registered for at least one school year. Overall coverage was >30% in all school years. Among all students registered for 4 years, 10.6% (95% CI 9.3% to 12.0%) of women and 12.7% (95% CI 11.2% to 14.2%) of men had a test every year. Among students with parental consent for 4 years, 49.3% (95% CI 44.6% to 54.1%) of women and 59.3% (95% CI 54.5% to 64.0%) of men had a test every year. Among students registered for 2 or more years, those with a previous positive chlamydia test were less likely to have a subsequent test (female adjusted OR 0.77, 95% CI 0.67 to 0.88 and male adjusted OR 0.84, 95% CI 0.69 to 1.02). Chlamydia positivity increased over time. CONCLUSIONS High levels of uptake can be achieved in school-based chlamydia screening programmes, but repeated yearly screening is difficult to sustain over time.

Impact of a stress coping strategy on perceived stress levels and performance during a simulated cardiopulmonary resuscitation: a randomized controlled trial

Background Cardiopulmonary resuscitation (CPR) causes significant stress, which may cause deficiencies in attention and increase distractibility. This may lead to misjudgements of priorities and delays in CPR performance, which may further increase mental stress (vicious cycle). This study assessed the impact of a task-focusing strategy on perceived stress levels and performance during a simulated CPR scenario. Methods This prospective, randomized-controlled trial was conducted at the simulator-center of the University Hospital Basel, Switzerland. A total of 124 volunteer medical students were randomized to receive a 10 minute instruction to cope with stress by loudly posing two taskfocusing questions (“what is the patient’s condition?”, “what immediate action is needed?”) when feeling overwhelmed by stress (intervention group) or a control group. The primary outcome was the perceived levels of stress and feeling overwhelmed (stress/overload); secondary outcomes were hands-on time, time to start CPR and number of leadership statements. Results Participants in the intervention group reported significantly less stress/overload levels compared to the control group (mean difference: -0.6 (95%CI −1.3, -0.1), p=0.04). Higher stress/overload was associated with less hands-on time. Leadership statements did not differ between groups, but the number of leadership statements did relate to performance. Hands-on time was longer in the intervention- group, but the difference was not statistically different (difference 5.5 (95%CI −3.1, 14.2), p=0.2); there were no differences in time to start CPR (difference −1.4 (95%CI −8.4, 5.7), p=0.71). Conclusions A brief stress-coping strategy moderately decreased perceived stress without significantly affecting performance in a simulated CPR. Further studies should investigate more intense interventions for reducing stress.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

European undergraduate curriculum in geriatric medicine developed using an international modified Delphi technique.

INTRODUCTION the rise in the number of older, frail adults necessitates that future doctors are adequately trained in the skills of geriatric medicine. Few countries have dedicated curricula in geriatric medicine at the undergraduate level. The aim of this project was to develop a consensus among geriatricians on a curriculum with the minimal requirements that a medical student should achieve by the end of medical school. METHODS a modified Delphi process was used. First, educational experts and geriatricians proposed a set of learning objectives based on a literature review. Second, three Delphi rounds involving a panel with 49 experts representing 29 countries affiliated to the European Union of Medical Specialists (UEMS) was used to gain consensus for a final curriculum. RESULTS the number of disagreements following Delphi Rounds 1 and 2 were 81 and 53, respectively. Complete agreement was reached following the third round. The final curriculum consisted of detailed objectives grouped under 10 overarching learning outcomes. DISCUSSION a consensus on the minimum requirements of geriatric learning objectives for medical students has been agreed by European geriatricians. Major efforts will be needed to implement these requirements, given the large variation in the quality of geriatric teaching in medical schools. This curriculum is a first step to help improve teaching of geriatrics in medical schools, and will also serve as a basis for advancing postgraduate training in geriatrics across Europe.

Lernzielkatalog für die studentische Lehre im Fachbereich „Geriatrie“ an Fakultäten für Humanmedizin.

Zusammenfassung Die Betreuung geriatrischer Patientinnen und Patienten setzt, nebst einer entsprechenden Haltung, fundierte Kenntnisse in Diagnostik und Behandlung praktisch aller medizinischen Fachgebiete voraus. Daher ist es wichtig, dass die Kompetenz von Studierenden der Humanmedizin im Bereich Geriatrie entsprechend gefördert wird. Bis heute hat jedoch die studentische Ausbildung im Fach Geriatrie an vielen europäischen Universitäten einen unklaren oder untergeordneten Stellenwert. Als ersten Schritt zur Förderung der Lehre in der Geriatrie hat die Europäische Facharztvereinigung Geriatrie (UEMS-GMS) in einem Delphi-Prozess einen Lernzielkatalog entwickelt. Dieser Katalog enthält die Mindestanforderungen mit spezifischen Lernzielen (Wissen, Fertigkeiten und Haltungen), welche die Studierenden der Humanmedizin bezüglich Geriatrie bis zum Abschluss des Medizinstudiums erwerben sollen. Zur Förderung der Implementierung dieses neuen, kompetenzbasierten Lernzielkatalogs an den deutschsprachigen Universitäten wurde eine an den Sprachgebrauch des „DACH-Raums“ (Deutschland, Österreich und Schweiz) angepasste deutsche Version erstellt. Im vorliegenden Beitrag wird diese Übersetzung vorgestellt. Die Fachgesellschaften für Geriatrie aus Deutschland, Österreich und der Schweiz empfehlen den medizinischen Fakultäten der jeweiligen Länder, diesen Katalog umzusetzen.

Comparing three CPR feedback devices and standard BLS in a single rescuer scenario: a randomised simulation study

BACKGROUND Efficiently performed basic life support (BLS) after cardiac arrest is proven to be effective. However, cardiopulmonary resuscitation (CPR) is strenuous and rescuers' performance declines rapidly over time. Audio-visual feedback devices reporting CPR quality may prevent this decline. We aimed to investigate the effect of various CPR feedback devices on CPR quality. METHODS In this open, prospective, randomised, controlled trial we compared three CPR feedback devices (PocketCPR, CPRmeter, iPhone app PocketCPR) with standard BLS without feedback in a simulated scenario. 240 trained medical students performed single rescuer BLS on a manikin for 8min. Effective compression (compressions with correct depth, pressure point and sufficient decompression) as well as compression rate, flow time fraction and ventilation parameters were compared between the four groups. RESULTS Study participants using the PocketCPR performed 17±19% effective compressions compared to 32±28% with CPRmeter, 25±27% with the iPhone app PocketCPR, and 35±30% applying standard BLS (PocketCPR vs. CPRmeter p=0.007, PocketCPR vs. standard BLS p=0.001, others: ns). PocketCPR and CPRmeter prevented a decline in effective compression over time, but overall performance in the PocketCPR group was considerably inferior to standard BLS. Compression depth and rate were within the range recommended in the guidelines in all groups. CONCLUSION While we found differences between the investigated CPR feedback devices, overall BLS quality was suboptimal in all groups. Surprisingly, effective compression was not improved by any CPR feedback device compared to standard BLS. All feedback devices caused substantial delay in starting CPR, which may worsen outcome.

Improving Pediatric Basic Life Support Performance Through Blended Learning With Web-Based Virtual Patients: Randomized Controlled Trial

BACKGROUND E-learning and blended learning approaches gain more and more popularity in emergency medicine curricula. So far, little data is available on the impact of such approaches on procedural learning and skill acquisition and their comparison with traditional approaches. OBJECTIVE This study investigated the impact of a blended learning approach, including Web-based virtual patients (VPs) and standard pediatric basic life support (PBLS) training, on procedural knowledge, objective performance, and self-assessment. METHODS A total of 57 medical students were randomly assigned to an intervention group (n=30) and a control group (n=27). Both groups received paper handouts in preparation of simulation-based PBLS training. The intervention group additionally completed two Web-based VPs with embedded video clips. Measurements were taken at randomization (t0), after the preparation period (t1), and after hands-on training (t2). Clinical decision-making skills and procedural knowledge were assessed at t0 and t1. PBLS performance was scored regarding adherence to the correct algorithm, conformance to temporal demands, and the quality of procedural steps at t1 and t2. Participants' self-assessments were recorded in all three measurements. RESULTS Procedural knowledge of the intervention group was significantly superior to that of the control group at t1. At t2, the intervention group showed significantly better adherence to the algorithm and temporal demands, and better procedural quality of PBLS in objective measures than did the control group. These aspects differed between the groups even at t1 (after VPs, prior to practical training). Self-assessments differed significantly only at t1 in favor of the intervention group. CONCLUSIONS Training with VPs combined with hands-on training improves PBLS performance as judged by objective measures.