Stability of repeated student evaluations of teaching in the second preclinical year of a medical curriculum

RESUME L'étude de la médecine à la Faculté de l'Université de Lausanne est un cursus de six ans. Depuis la réforme générale du curriculum en octobre 1995, le programme de la deuxième année consacrée à l'étude de l'être humain sain a été transformé. L'enseignement intégré par système ou organe a été introduit en remplaçant l'enseignement par discipline. Parallèlement, un système d'évaluation de l'enseignement par les étudiants a été proposé. Il a été amélioré au fil des années et depuis l'année académique 1998-99, l'évaluation est devenue systémique et régulière. Notre étude présente et compare les résultats des évaluations de l'enseignement et des enseignants de neuf cours intégrés dispensés en deuxième année durant deux années académiques (1998-99 et 1999-2000). Une forte corrélation entre les résultats des deux années consécutives ainsi qu'une importante disparité des estimations à l'intérieure de chacune de deux années ont été observées. Ceci démontre un engagement sérieux des étudiants dans le processus d'évaluation, révèle la pertinence de leur analyse et leur bonne capacité de discernement. L'analyse de nos résultats montre que les évaluations effectuées par les étudiants peuvent constituer une source fiable d'informations et contribuer à l'amélioration du processus d'enseignement.

Evaluation pré-TAVI : comparaison entre le scanner cardiaque et l'échocardiographie.

Objectifs: Comparer le CT et l'échocardiographie cardiaques pour l'évaluation pré-interventionnelle des patients éligibles pour un remplacement aortique percutané (TAVI). Matériels et méthodes: Trente patients (15F/15H, âge 84±7y) éligibles pour un TAVI par voie transfémorale (n=15) ou transapicale (n=15) ont bénéficié d'un CT pré-procédural pour évaluer le diamètre (DCT) valvulaire aortique. Une échographie trans-thoracique pré et post-TAVI a été effectuée pour évaluer le gradient trans-valvulaire (Gmax) et la différence (ΔGmax), et une échographie trans-oesophagienne (ETO) pour confirmer le diamètre valvulaire (DUS). Le test-t de Student, le test de Lin (ρc) et le test de Bland-Altman (LOA) ont été utilisés pour les comparaisons. Résultats: Le DCT était similaire chez les patients bénéficiant d'un TAVI transfémoral ou transapical (22.9±3.0mm vs. 21.2±1.5mm,p=0.06). Le DCT était plus bas que le DUS (22.2±2.6mm vs. 23.3±2.1mm,p=0.017) et l'agrément entre DCT et DUS était modéré (ρc=0.62,différence moyenne=-1.1±1.9mm, 95%LOA:-4.8-2.6). Le Gmax pré-TAVI était similaire chez les patients ayant un TAVI transfémoral ou transapical (70.8±33.7 vs. 86.3±24.0mmHg,p=0.17). Le Gmax post-TAVI était plus bas que le Gmax pré-TAVI (78.5±29.7 vs. 16.8±5.1mmHg,p<0.001). Le ΔGmax était similaire pour les TAVI transfémoraux ou transapicaux (46.3±28.6 vs. 70.4±25.1 mmHg,p=0.05). Conclusion: Le CT cardiaque représente une alternative non-invasive à l'ETO pour l'évaluation pré-TAVI du diamètre valvulaire aortique.

Teaching motivational interviewing to medical students : a pre-post test pilot study

Objective: To test the efficacy of teaching motivational interviewing (MI) to medical students. Methods: Thirteen 4th year medical students volunteered to participate. Seven days before and 7 days after an 8-hour interactive training MI workshop, each student performed a videorecorded interview with two standardized patients: a 60 year old alcohol dependent woman and a 50 year old cigarette smoking man. Students' counseling skills were coded by two blinded clinicians using the Motivational Interviewing Treatment Integrity 3.0 (MITI). Inter-rater reliability was calculated for all interviews and a test-retest was completed in a sub-sample of 10 consecutive interviews three days apart. Difference between MITI scores before and after training were calculated and tested using non-parametric tests. Effect size was approximated by calculating the probability that posttest scores are greater than pretest scores (P*=P(Pre<Post)+1/2P(Pre=Post)), P*>1/2 indicating greater scores in posttest, P*=1/2 no effect, and P*<1/2 smaller scores in posttest. Results: Median differences between MITI scores before and after MI training indicated a general progression in MI skills: MI spirit global score (median difference=1.5, Inter quartile range=1.5, p<0.001, P*=0.90); Empathy global score (med diff=1, IQR=0.5, p<0.001, P*=0.85); Percentage of MI adherent skills (med diff=36.6, IQR=50.5, p<0.001, P*=0.85); Percentage of open questions (med diff=18.6, IQR=21.6, p<0.001, P*=0.96); reflections/ questions ratio (med diff=0.2, IQR=0.4, p<0.001, P*=0.81). Only Direction global score and the percentage of complex reflections were not significantly improved (med diff=0, IQR=1, p=0.53, P*=0.44, and med diff=4.3, IQR=24.8, p=0.48, P*=0.62, respectively). Inter-rater reliability indicated weighted kappa ranged between 0.14 for Direction to 0.51 for Collaboration and ICC ranged between 0.28 for Simple reflection to 0.95 for Closed question. Test-retests indicated weighted kappa ranged between 0.27 for Direction to 0.80 for Empathy and ICC ranged between 0.87 for Complex reflection to 0.98 for Closed question. Conclusion: This pilot study indicated that an 8-hour training in MI for voluntary 4th year medical students resulted in significant improvement of MI skills. Larger sample of unselected medical students should be studied to generalize the benefit of MI training to medical students. Interrater reliability and test-retests suggested that coders' training should be intensified.

Que faire d'un stagiaire dans votre consultation [Tips for hosting a medical student in a PC consultation].

Hosting a medical student in one's primary care consultation challenges the practitioner to be a clinical teacher as well as providing high-quality patient care. A few tips can make this double task easier. Before the consultation it is possible to define the student's learning objectives and to plan the consultation. During the consultation itself some teaching models exist (One minute preceptor, SNAPP) that facilitate the teaching by maximising the teaching moments for each student-patient encounter. And finally after the consultation a time of reflection where both student and clinical teacher can think about what went well and what could be done better.

Teaching Motivational Interviewing to Medical Students to Improve Behavior Change Counseling Skills - Results of a Pilot Test

BACKGROUND: Patient behavior accounts for half or more of the variance in health, disease, mortality and treatment outcome and costs. Counseling using motivational interviewing (MI) effectively improves the substance use and medical compliance behavior of patients. Medical training should include substantial focus on this key issue of health promotion. The objective of the study is to test the efficacy of teaching MI to medical students. METHODS: Thirteen fourth-year medical students volunteered to participate. Seven days before and after an 8-hour interactive MI training workshop, each student performed a video-recorded interview with two standardized patients: a 60 year-old alcohol dependent female consulting a primary care physician for the first time about fatigue and depression symptoms; and a 50 year-old male cigarette smoker hospitalized for myocardial infarction. All 52 videos (13 students×2 interviews before and after training) were independently coded by two blinded clinicians using the Motivational Interviewing Training Integrity (MITI, 3.0). MITI scores consist of global spirit (Evocation, Collaboration, Autonomy/Support), global Empathy and Direction, and behavior count summary scores (% Open questions, Reflection to question ratio, % Complex reflections, % MI-adherent behaviors). A "beginning proficiency" threshold (BPT) is defined for each of these 9 scores. The proportion of students reaching BPT before and after training was compared using McNemar exact tests. Inter-rater reliability was evaluated by comparing double coding, and test-retest analyses were conducted on a sub-sample of 10 consecutive interviews by each coder. Weighted Kappas were used for global rating scales and intra-class correlations (ICC) were computed for behavior count summary scores. RESULTS: The percent of counselors reaching BPT before and after MI training increased significantly for Evocation (15% to 65%, p<.001), Collaboration (27% to 77%, p=.001), Autonomy/Support (15% to 54%, p=.006), and % Open questions (4% to 38%, p=.004). Proportions increased, but were not statistically significant for Empathy (38% to 58%, p=.18), Reflection to question ratio (0% to 15%, p=.12), % Complex reflection (35% to 54%, p=.23), and % MI-adherent behaviors (8% to 15%, p=.69). There was virtually no change for the Direction scale (92% to 88%, p=1.00). The reliability analyses produced mixed results. Weighted kappas for inter-rater reliability ranged from .14 for Direction to .51 for Collaboration, and from .27 for Direction to .80 for Empathy for test-retest. ICCs ranged from .20 for Complex reflections to .89 for Open questions (inter-rater), and from .67 for Complex reflections to .99 for Reflection to question ratio (test-retest). CONCLUSION: This pilot study indicates that a single 8-hour training in motivational interviewing for voluntary fourth-year medical students results in significant improvement of some MI skills. A larger sample of randomly selected medical students observed over longer periods should be studied to test if MI training generalizes to medical students. Inter-rater reliability and test-retest findings indicate a need for caution when interpreting the present results, as well as for more intensive training to help appropriately capture more dimensions of the process in future studies.

An international university network for online teaching of pathology in Frenchspeaking countries

Introduction: Building online courses is a highly time consuming task for teachers of a single university. Universities working alone create high-quality courses but often cannot cover all pathological fields. Moreover this often leads to duplication of contents among universities, representing a big waste of teacher time and energy. We initiated in 2011 a French university network for building mutualized online teaching pathology cases, and this network has been extended in 2012 to Quebec and Switzerland. Method: Twenty French universities (see & for details), University Laval in Quebec and University of Lausanne in Switzerland are associated to this project. One e-learning Moodle platform (http://moodle.sorbonne-paris-cite.fr/) contains texts with URL pointing toward virtual slides that are decentralized in several universities. Each university has the responsibility of its own slide scanning, slide storage and online display with virtual slide viewers. The Moodle website is hosted by PRES Sorbonne Paris Cité, and financial supports for hardware have been obtained from UNF3S (http://www.unf3s.org/) and from PRES Sorbonne Paris Cité. Financial support for international fellowships has been obtained from CFQCU (http://www.cfqcu.org/). Results: The Moodle interface has been explained to pathology teachers using web-based conferences with screen sharing. The teachers added then contents such as clinical cases, selfevaluations and other media organized in several sections by student levels and pathological fields. Contents can be used as online learning or online preparation of subsequent courses in classrooms. In autumn 2013, one resident from Quebec spent 6 weeks in France and Switzerland and created original contents in inflammatory skin pathology. These contents are currently being validated by senior teachers and will be opened to pathology residents in spring 2014. All contents of the website can be accessed for free. Most contents just require anonymous connection but some specific fields, especially those containing pictures obtained from patients who agreed for a teaching use only, require personal identification of the students. Also, students have to register to access Moodle tests. All contents are written in French but one case has been translated into English to illustrate this communication (http://moodle.sorbonne-pariscite.fr/mod/page/view.php?id=261) (use "login as a guest"). The Moodle test module allows many types of shared questions, making it easy to create personalized tests. Contents that are opened to students have been validated by an editorial committee composed of colleagues from the participating institutions. Conclusions: Future developments include other international fellowships, the next one being scheduled for one French resident from May to October 2014 in Quebec, with a study program centered on lung and breast pathology. It must be kept in mind that these e-learning programs highly depend on teachers' time, not only at these early steps but also later to update the contents. We believe that funding resident fellowships for developing online pathological teaching contents is a win-win situation, highly beneficial for the resident who will improve his knowledge and way of thinking, highly beneficial for the teachers who will less worry about access rights or image formats, and finally highly beneficial for the students who will get courses fully adapted to their practice.