Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings

OBJECTIVE: To describe the electronic medical databases used in antiretroviral therapy (ART) programmes in lower-income countries and assess the measures such programmes employ to maintain and improve data quality and reduce the loss of patients to follow-up. METHODS: In 15 countries of Africa, South America and Asia, a survey was conducted from December 2006 to February 2007 on the use of electronic medical record systems in ART programmes. Patients enrolled in the sites at the time of the survey but not seen during the previous 12 months were considered lost to follow-up. The quality of the data was assessed by computing the percentage of missing key variables (age, sex, clinical stage of HIV infection, CD4+ lymphocyte count and year of ART initiation). Associations between site characteristics (such as number of staff members dedicated to data management), measures to reduce loss to follow-up (such as the presence of staff dedicated to tracing patients) and data quality and loss to follow-up were analysed using multivariate logit models. FINDINGS: Twenty-one sites that together provided ART to 50 060 patients were included (median number of patients per site: 1000; interquartile range, IQR: 72-19 320). Eighteen sites (86%) used an electronic database for medical record-keeping; 15 (83%) such sites relied on software intended for personal or small business use. The median percentage of missing data for key variables per site was 10.9% (IQR: 2.0-18.9%) and declined with training in data management (odds ratio, OR: 0.58; 95% confidence interval, CI: 0.37-0.90) and weekly hours spent by a clerk on the database per 100 patients on ART (OR: 0.95; 95% CI: 0.90-0.99). About 10 weekly hours per 100 patients on ART were required to reduce missing data for key variables to below 10%. The median percentage of patients lost to follow-up 1 year after starting ART was 8.5% (IQR: 4.2-19.7%). Strategies to reduce loss to follow-up included outreach teams, community-based organizations and checking death registry data. Implementation of all three strategies substantially reduced losses to follow-up (OR: 0.17; 95% CI: 0.15-0.20). CONCLUSION: The quality of the data collected and the retention of patients in ART treatment programmes are unsatisfactory for many sites involved in the scale-up of ART in resource-limited settings, mainly because of insufficient staff trained to manage data and trace patients lost to follow-up.

The mini-clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned?

OBJECTIVES The generation of learning goals (LGs) that are aligned with learning needs (LNs) is one of the main purposes of formative workplace-based assessment. In this study, we aimed to analyse how often trainer–student pairs identified corresponding LNs in mini-clinical evaluation exercise (mini-CEX) encounters and to what degree these LNs aligned with recorded LGs, taking into account the social environment (e.g. clinic size) in which the mini-CEX was conducted. METHODS Retrospective analyses of adapted mini-CEX forms (trainers’ and students’ assessments) completed by all Year 4 medical students during clerkships were performed. Learning needs were defined by the lowest score(s) assigned to one or more of the mini-CEX domains. Learning goals were categorised qualitatively according to their correspondence with the six mini-CEX domains (e.g. history taking, professionalism). Following descriptive analyses of LNs and LGs, multi-level logistic regression models were used to predict LGs by identified LNs and social context variables. RESULTS A total of 512 trainers and 165 students conducted 1783 mini-CEXs (98% completion rate). Concordantly, trainer–student pairs most often identified LNs in the domains of ‘clinical reasoning’ (23% of 1167 complete forms), ‘organisation/efficiency’ (20%) and ‘physical examination’ (20%). At least one ‘defined’ LG was noted on 313 student forms (18% of 1710). Of the 446 LGs noted in total, the most frequently noted were ‘physical examination’ (49%) and ‘history taking’ (21%). Corresponding LNs as well as social context factors (e.g. clinic size) were found to be predictors of these LGs. CONCLUSIONS Although trainer–student pairs often agreed in the LNs they identified, many assessments did not result in aligned LGs. The sparseness of LGs, their dependency on social context and their partial non-alignment with students’ LNs raise questions about how the full potential of the mini-CEX as not only a ‘diagnostic’ but also an ‘educational’ tool can be exploited.

Undergraduate palliative care teaching in Swiss medical faculties: a nationwide survey and improved learning objectives

BACKGROUND In 2007, a first survey on undergraduate palliative care teaching in Switzerland has revealed major heterogeneity of palliative care content, allocation of hours and distribution throughout the 6 year curriculum in Swiss medical faculties. This second survey in 2012/13 has been initiated as part of the current Swiss national strategy in palliative care (2010 - 2015) to serve as a longitudinal monitoring instrument and as a basis for redefinition of palliative care learning objectives and curriculum planning in our country. METHODS As in 2007, a questionnaire was sent to the deans of all five medical faculties in Switzerland in 2012. It consisted of eight sections: basic background information, current content and hours in dedicated palliative care blocks, current palliative care content in other courses, topics related to palliative care presented in other courses, recent attempts at improving palliative care content, palliative care content in examinations, challenges, and overall summary. Content analysis was performed and the results matched with recommendations from the EAPC for undergraduate training in palliative medicine as well as with recommendations from overseas countries. RESULTS There is a considerable increase in palliative care content, academic teaching staff and hours in all medical faculties compared to 2007. No Swiss medical faculty reaches the range of 40 h dedicated specifically to palliative care as recommended by the EAPC. Topics, teaching methods, distribution throughout different years and compulsory attendance still differ widely. Based on these results, the official Swiss Catalogue of Learning Objectives (SCLO) was complemented with 12 new learning objectives for palliative and end of life care (2013), and a national basic script for palliative care was published (2015). CONCLUSION Performing periodic surveys of palliative care teaching at national medical faculties has proven to be a useful tool to adapt the national teaching framework and to improve the recognition of palliative medicine as an integral part of medical training.

The "Profiles" document: a modern revision of the objectives of undergraduate medical studies in Switzerland

The Joint Commission of the Swiss Medical Schools (SMIFK/CIMS) decided in 2000 to establish a Swiss Catalogue of Learning Objectives (SCLO) for undergraduate medical training, which was adapted from a similar Dutch blueprint. A second version of the SCLO was developed and launched in 2008. The catalogue is a prerequisite for the accreditation of the curricula of the six Swiss medical faculties and defines the contents of the Federal Licensing Examination (FLE). Given the evolution of the field of medicine and of medical education, the SMIFK/CIMS has decided to embark on a total revision of the SCLO. This article presents the proposed structure and content of Profiles, a new document which, in the future, will direct the format of undergraduate studies and of the FLE. Profiles stands for the Principal Relevant Objectives for Integrative Learning and Education in Switzerland. It is currently being developed by a group of experts from the six Swiss faculties as well as representatives of other institutions involved in these developments. The foundations of Profiles are grounded in the evolution of medical practice and of public health and are based on up-to-date teaching concepts, such as EPAs (entrustable professional activities). An introduction will cover the concepts and a tutorial will be displayed. Three main chapters will provide a description of the seven 2015 CanMEDS roles, a list of core EPAs and a series of ≈250 situations embracing the most frequent and current conditions affecting health. As Profiles is still a work in progress, it is hoped that this paper will attract the interest of all individuals involved in the training of medical students.

Computer-based summative assessment of clinical reasoning in clerkships: A mixed-method comparison of key feature problems with case-based multiple choice questions

Background: It is yet unclear if there are differences between using electronic key feature problems (KFPs) or electronic case-based multiple choice questions (cbMCQ) for the assessment of clinical decision making. Summary of Work: Fifth year medical students were exposed to clerkships which ended with a summative exam. Assessment of knowledge per exam was done by 6-9 KFPs, 9-20 cbMCQ and 9-28 MC questions. Each KFP consisted of a case vignette and three key features (KF) using “long menu” as question format. We sought students’ perceptions of the KFPs and cbMCQs in focus groups (n of students=39). Furthermore statistical data of 11 exams (n of students=377) concerning the KFPs and (cb)MCQs were compared. Summary of Results: The analysis of the focus groups resulted in four themes reflecting students’ perceptions of KFPs and their comparison with (cb)MCQ: KFPs were perceived as (i) more realistic, (ii) more difficult, (iii) more motivating for the intense study of clinical reasoning than (cb)MCQ and (iv) showed an overall good acceptance when some preconditions are taken into account. The statistical analysis revealed that there was no difference in difficulty; however KFP showed a higher discrimination and reliability (G-coefficient) even when corrected for testing times. Correlation of the different exam parts was intermediate. Conclusions: Students perceived the KFPs as more motivating for the study of clinical reasoning. Statistically KFPs showed a higher discrimination and higher reliability than cbMCQs. Take-home messages: Including KFPs with long menu questions into summative clerkship exams seems to offer positive educational effects.