Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings

OBJECTIVE: To describe the electronic medical databases used in antiretroviral therapy (ART) programmes in lower-income countries and assess the measures such programmes employ to maintain and improve data quality and reduce the loss of patients to follow-up. METHODS: In 15 countries of Africa, South America and Asia, a survey was conducted from December 2006 to February 2007 on the use of electronic medical record systems in ART programmes. Patients enrolled in the sites at the time of the survey but not seen during the previous 12 months were considered lost to follow-up. The quality of the data was assessed by computing the percentage of missing key variables (age, sex, clinical stage of HIV infection, CD4+ lymphocyte count and year of ART initiation). Associations between site characteristics (such as number of staff members dedicated to data management), measures to reduce loss to follow-up (such as the presence of staff dedicated to tracing patients) and data quality and loss to follow-up were analysed using multivariate logit models. FINDINGS: Twenty-one sites that together provided ART to 50 060 patients were included (median number of patients per site: 1000; interquartile range, IQR: 72-19 320). Eighteen sites (86%) used an electronic database for medical record-keeping; 15 (83%) such sites relied on software intended for personal or small business use. The median percentage of missing data for key variables per site was 10.9% (IQR: 2.0-18.9%) and declined with training in data management (odds ratio, OR: 0.58; 95% confidence interval, CI: 0.37-0.90) and weekly hours spent by a clerk on the database per 100 patients on ART (OR: 0.95; 95% CI: 0.90-0.99). About 10 weekly hours per 100 patients on ART were required to reduce missing data for key variables to below 10%. The median percentage of patients lost to follow-up 1 year after starting ART was 8.5% (IQR: 4.2-19.7%). Strategies to reduce loss to follow-up included outreach teams, community-based organizations and checking death registry data. Implementation of all three strategies substantially reduced losses to follow-up (OR: 0.17; 95% CI: 0.15-0.20). CONCLUSION: The quality of the data collected and the retention of patients in ART treatment programmes are unsatisfactory for many sites involved in the scale-up of ART in resource-limited settings, mainly because of insufficient staff trained to manage data and trace patients lost to follow-up.

Using Informatics and the Electronic Medical Record to Describe Antimicrobial Use in the Clinical Management of Diarrhea Cases at 12 Companion Animal Practices

Antimicrobial drugs may be used to treat diarrheal illness in companion animals. It is important to monitor antimicrobial use to better understand trends and patterns in antimicrobial resistance. There is no monitoring of antimicrobial use in companion animals in Canada. To explore how the use of electronic medical records could contribute to the ongoing, systematic collection of antimicrobial use data in companion animals, anonymized electronic medical records were extracted from 12 participating companion animal practices and warehoused at the University of Calgary. We used the pre-diagnostic, clinical features of diarrhea as the case definition in this study. Using text-mining technologies, cases of diarrhea were described by each of the following variables: diagnostic laboratory tests performed, the etiological diagnosis and antimicrobial therapies. The ability of the text miner to accurately describe the cases for each of the variables was evaluated. It could not reliably classify cases in terms of diagnostic tests or etiological diagnosis; a manual review of a random sample of 500 diarrhea cases determined that 88/500 (17.6%) of the target cases underwent diagnostic testing of which 36/88 (40.9%) had an etiological diagnosis. Text mining, compared to a human reviewer, could accurately identify cases that had been treated with antimicrobials with high sensitivity (92%, 95% confidence interval, 88.1%-95.4%) and specificity (85%, 95% confidence interval, 80.2%-89.1%). Overall, 7400/15,928 (46.5%) of pets presenting with diarrhea were treated with antimicrobials. Some temporal trends and patterns of the antimicrobial use are described. The results from this study suggest that informatics and the electronic medical records could be useful for monitoring trends in antimicrobial use.

Developing a point-of-care electronic medical record system for TB/HIV co-infected patients: experiences from Lighthouse Trust, Lilongwe, Malawi.

BACKGROUND Implementation of user-friendly, real-time, electronic medical records for patient management may lead to improved adherence to clinical guidelines and improved quality of patient care. We detail the systematic, iterative process that implementation partners, Lighthouse clinic and Baobab Health Trust, employed to develop and implement a point-of-care electronic medical records system in an integrated, public clinic in Malawi that serves HIV-infected and tuberculosis (TB) patients. METHODS Baobab Health Trust, the system developers, conducted a series of technical and clinical meetings with Lighthouse and Ministry of Health to determine specifications. Multiple pre-testing sessions assessed patient flow, question clarity, information sequencing, and verified compliance to national guidelines. Final components of the TB/HIV electronic medical records system include: patient demographics; anthropometric measurements; laboratory samples and results; HIV testing; WHO clinical staging; TB diagnosis; family planning; clinical review; and drug dispensing. RESULTS Our experience suggests that an electronic medical records system can improve patient management, enhance integration of TB/HIV services, and improve provider decision-making. However, despite sufficient funding and motivation, several challenges delayed system launch including: expansion of system components to include of HIV testing and counseling services; changes in the national antiretroviral treatment guidelines that required system revision; and low confidence to use the system among new healthcare workers. To ensure a more robust and agile system that met all stakeholder and user needs, our electronic medical records launch was delayed more than a year. Open communication with stakeholders, careful consideration of ongoing provider input, and a well-functioning, backup, paper-based TB registry helped ensure successful implementation and sustainability of the system. Additional, on-site, technical support provided reassurance and swift problem-solving during the extended launch period. CONCLUSION Even when system users are closely involved in the design and development of an electronic medical record system, it is critical to allow sufficient time for software development, solicitation of detailed feedback from both users and stakeholders, and iterative system revisions to successfully transition from paper to point-of-care electronic medical records. For those in low-resource settings, electronic medical records for integrated care is a possible and positive innovation.

Webinar Training: an acceptable, feasible and effective approach for multi-site medical record abstraction: the BOWII experience

Background Abstractor training is a key element in creating valid and reliable data collection procedures. The choice between in-person vs. remote or simultaneous vs. sequential abstractor training has considerable consequences for time and resource utilization. We conducted a web-based (webinar) abstractor training session to standardize training across six individual Cancer Research Network (CRN) sites for a study of breast cancer treatment effects in older women (BOWII). The goals of this manuscript are to describe the training session, its participants and participants' evaluation of webinar technology for abstraction training. Findings A webinar was held for all six sites with the primary purpose of simultaneously training staff and ensuring consistent abstraction across sites. The training session involved sequential review of over 600 data elements outlined in the coding manual in conjunction with the display of data entry fields in the study's electronic data collection system. Post-training evaluation was conducted via Survey Monkey©. Inter-rater reliability measures for abstractors within each site were conducted three months after the commencement of data collection. Ten of the 16 people who participated in the training completed the online survey. Almost all (90%) of the 10 trainees had previous medical record abstraction experience and nearly two-thirds reported over 10 years of experience. Half of the respondents had previously participated in a webinar, among which three had participated in a webinar for training purposes. All rated the knowledge and information delivered through the webinar as useful and reported it adequately prepared them for data collection. Moreover, all participants would recommend this platform for multi-site abstraction training. Consistent with participant-reported training effectiveness, results of data collection inter-rater agreement within sites ranged from 89 to 98%, with a weighted average of 95% agreement across sites. Conclusions Conducting training via web-based technology was an acceptable and effective approach to standardizing medical record review across multiple sites for this group of experienced abstractors. Given the substantial time and cost savings achieved with the webinar, coupled with participants' positive evaluation of the training session, researchers should consider this instructional method as part of training efforts to ensure high quality data collection in multi-site studies.

Spatial-temporal clustering of companion animal enteric syndrome: detection and investigation through the use of electronic medical records from participating private practices

SUMMARY There is interest in the potential of companion animal surveillance to provide data to improve pet health and to provide early warning of environmental hazards to people. We implemented a companion animal surveillance system in Calgary, Alberta and the surrounding communities. Informatics technologies automatically extracted electronic medical records from participating veterinary practices and identified cases of enteric syndrome in the warehoused records. The data were analysed using time-series analyses and a retrospective space-time permutation scan statistic. We identified a seasonal pattern of reports of occurrences of enteric syndromes in companion animals and four statistically significant clusters of enteric syndrome cases. The cases within each cluster were examined and information about the animals involved (species, age, sex), their vaccination history, possible exposure or risk behaviour history, information about disease severity, and the aetiological diagnosis was collected. We then assessed whether the cases within the cluster were unusual and if they represented an animal or public health threat. There was often insufficient information recorded in the medical record to characterize the clusters by aetiology or exposures. Space-time analysis of companion animal enteric syndrome cases found evidence of clustering. Collection of more epidemiologically relevant data would enhance the utility of practice-based companion animal surveillance.

The application of medical informatics to the veterinary management programs at companion animal practices in Alberta, Canada: a case study.

Companion animals closely share their domestic environment with people and have the potential to, act as sources of zoonotic diseases. They also have the potential to be sentinels of infectious and noninfectious, diseases. With the exception of rabies, there has been minimal ongoing surveillance of, companion animals in Canada. We developed customized data extraction software, the University of, Calgary Data Extraction Program (UCDEP), to automatically extract and warehouse the electronic, medical records (EMR) from participating private veterinary practices to make them available for, disease surveillance and knowledge creation for evidence-based practice. It was not possible to build, generic data extraction software; the UCDEP required customization to meet the specific software, capabilities of the veterinary practices. The UCDEP, tailored to the participating veterinary practices', management software, was capable of extracting data from the EMR with greater than 99%, completeness and accuracy. The experiences of the people developing and using the UCDEP and the, quality of the extracted data were evaluated. The electronic medical record data stored in the data, warehouse may be a valuable resource for surveillance and evidence-based medical research.

Intra-Rater and Inter-Rater Reliability of a Medical Record Abstraction Study on Transition of Care after Childhood Cancer.

BACKGROUND The abstraction of data from medical records is a widespread practice in epidemiological research. However, studies using this means of data collection rarely report reliability. Within the Transition after Childhood Cancer Study (TaCC) which is based on a medical record abstraction, we conducted a second independent abstraction of data with the aim to assess a) intra-rater reliability of one rater at two time points; b) the possible learning effects between these two time points compared to a gold-standard; and c) inter-rater reliability. METHOD Within the TaCC study we conducted a systematic medical record abstraction in the 9 Swiss clinics with pediatric oncology wards. In a second phase we selected a subsample of medical records in 3 clinics to conduct a second independent abstraction. We then assessed intra-rater reliability at two time points, the learning effect over time (comparing each rater at two time-points with a gold-standard) and the inter-rater reliability of a selected number of variables. We calculated percentage agreement and Cohen's kappa. FINDINGS For the assessment of the intra-rater reliability we included 154 records (80 for rater 1; 74 for rater 2). For the inter-rater reliability we could include 70 records. Intra-rater reliability was substantial to excellent (Cohen's kappa 0-6-0.8) with an observed percentage agreement of 75%-95%. In all variables learning effects were observed. Inter-rater reliability was substantial to excellent (Cohen's kappa 0.70-0.83) with high agreement ranging from 86% to 100%. CONCLUSIONS Our study showed that data abstracted from medical records are reliable. Investigating intra-rater and inter-rater reliability can give confidence to draw conclusions from the abstracted data and increase data quality by minimizing systematic errors.

Low correlation between self-report and medical record documentation of urinary tract infection symptoms.

BACKGROUND Correlations between symptom documentation in medical records and patient self-report (SR) vary depending on the condition studied. Patient symptoms are particularly important in urinary tract infection (UTI) diagnosis, and this correlation for UTI symptoms is currently unknown. METHODS This is a cross-sectional survey study in hospitalized patients with Escherichia coli bacteriuria. Patients were interviewed within 24 hours of diagnosis for the SR of UTI symptoms. We reviewed medical records for UTI symptoms documented by admitting or treating inpatient physicians (IPs), nurses (RNs), and emergency physicians (EPs). The level of agreement between groups was assessed using Cohen κ coefficient. RESULTS Out of 43 patients, 34 (79%) self-reported at least 1 of 6 primary symptoms. The most common self-reported symptoms were urinary frequency (53.5%); retention (41.9%); flank pain, suprapubic pain, and fatigue (37.2% each); and dysuria (30.2%). Correlation between SR and medical record documentation was slight to fair (κ, 0.06-0.4 between SR and IPs and 0.09-0.5 between SR and EDs). Positive agreement was highest for dysuria and frequency. CONCLUSION Correlation between self-reported UTI symptoms and health care providers' documentation was low to fair. Because medical records are a vital source of information for clinicians and researchers and symptom assessment and documentation are vital in distinguishing UTI from asymptomatic bacteriuria, efforts must be made to improve documentation.

The PRO-AGE study: an international randomised controlled study of health risk appraisal for older persons based in general practice

BACKGROUND: This paper describes the study protocol, the recruitment, and base-line data for evaluating the success of randomisation of the PRO-AGE (PRevention in Older people-Assessment in GEneralists' practices) project. METHODS/DESIGN: A group of general practitioners (GPs) in London (U.K.), Hamburg (Germany) and Solothurn (Switzerland) were trained in risk identification, health promotion, and prevention in older people. Their non-disabled older patients were invited to participate in a randomised controlled study. Participants allocated to the intervention group were offered the Health Risk Appraisal for Older Persons (HRA-O) instrument with a site-specific method for reinforcement (London: physician reminders in electronic medical record; Hamburg: one group session or two preventive home visits; Solothurn: six-monthly preventive home visits over a two-year period). Participants allocated to the control group received usual care. At each site, an additional group of GPs did not receive the training, and their eligible patients were invited to participate in a concurrent comparison group. Primary outcomes are self-reported health behaviour and preventative care use at one-year follow-up. In Solothurn, an additional follow-up was conducted at two years. The number of older persons agreeing to participate (% of eligible persons) in the randomised controlled study was 2503 (66.0%) in London, 2580 (53.6%) in Hamburg, and 2284 (67.5%) in Solothurn. Base-line findings confirm that randomisation of participants was successful, with comparable characteristics between intervention and control groups. The number of persons (% of eligible) enrolled in the concurrent comparison group was 636 (48.8%) in London, 746 (35.7%) in Hamburg, and 1171 (63.0%) in Solothurn. DISCUSSION: PRO-AGE is the first large-scale randomised controlled trial of health risk appraisal for older people in Europe. Its results will inform about the effects of implementing HRA-O with different methods of reinforcement.

Retention in care during the first 3 years of antiretroviral therapy for women in Malawi's option B+ programme: an observational cohort study

Background Studies of Malawi's option B+ programme for HIV-positive pregnant and breastfeeding women have reported high loss to follow-up during pregnancy and at the start of antiretroviral therapy (ART), but few data exist about retention during breastfeeding and after weaning. We examined loss to follow-up and retention in care in patients in the option B+ programme during their first 3 years on ART. Methods We analysed two data sources: aggregated facility-level data about patients in option B+ who started ART between Oct 1, 2011, and June 30, 2012, at 546 health facilities; and patient-level data from 20 large facilities with electronic medical record system for HIV-positive women who started ART between Sept 1, 2011, and Dec 31, 2013, under option B+ or because they had WHO clinical stages 3 or 4 disease or had CD4 counts of less than 350 cells per μL. We used facility-level data to calculate representative estimates of retention and loss to follow-up. We used patient-level data to study temporal trends in retention, timing of loss to follow-up, and predictors of no follow-up and loss to follow-up. We defined patients who were more than 60 days late for their first follow-up visit as having no follow-up and patients who were more than 60 days late for a subsequent visit as being lost to follow-up. We calculated proportions and cumulative probabilities of patients who had died, stopped ART, had no follow-up, were lost to follow-up, or were retained alive on ART for 36 months. We calculated odds ratios and hazard ratios to examine predictors of no follow-up and loss to follow-up. Findings Analysis of facility-level data about patients in option B+ who had not transferred to a different facility showed retention in care to be 76·8% (20 475 of 26 658 patients) after 12 months, 70·8% (18 306 of 25 849 patients) after 24 months, and 69·7% (17 787 of 25 535 patients) after 36 months. Patient-level data included 29 145 patients. 14 630 (50·2%) began treatment under option B+. Patients in option B+ had a higher risk of having no follow-up and, for the first 2 years of ART, higher risk of loss to follow-up than did patients who started ART because they had CD4 counts less than 350 cells per μL or WHO clinical stage 3 or 4 disease. Risk of loss to follow-up during the third year was low and similar for patients retained for 2 years. Retention rates did not change as the option B+ programme matured. Interpretation Our data suggest that pregnant and breastfeeding women who start ART immediately after they are diagnosed with HIV can be retained on ART through the option B+ programme, even after many have stopped breastfeeding. Interventions might be needed to improve retention in the first year on ART in option B+. Funding Bill & Melinda Gates Foundation, Partnerships for Enhanced Engagement in Research Health, and National Institute of Allergy and Infectious Diseases.

Sexual activity-related emergency department admissions: eleven years of experience at a Swiss university hospital

PRINCIPALS: Most people enjoy sexual intercourse without complications, but a significant, if small, number need to seek emergency medical help for related health problems. The true incidence of these problems is not known. We therefore assessed all admissions to our emergency department (ED) in direct relation to sexual intercourse. METHODS: All data were collected prospectively and entered into the ED's centralised electronic patient record database (Qualicare, Switzerland) and retrospectively analysed. The database was scanned for the standardised key words: 'sexual intercourse' (German 'Geschlechtsverkehr') or 'coitus' (German 'Koitus'). RESULTS: A total of 445 patients were available for further evaluation; 308 (69.0%) were male, 137 (31.0%) were female. The median age was 32 years (range 16-71) for male subjects and 30 years (range 16-70) for female subjects. Two men had cardiovascular emergencies. 46 (10.3%) of our patients suffered from trauma. Neurological emergencies occurred in 55 (12.4%) patients: the most frequent were headaches in 27 (49.0%), followed by subarachnoid haemorrhage (12, 22.0%) and transient global amnesia (11, 20.0%). 154 (97.0%) of the patients presenting with presumed infection actually had infections of the urogenital tract. The most common infection was urethritis (64, 41.0%), followed by cystitis (21, 13.0%) and epididymitis (19, 12.0%). A sexually transmitted disease (STD) was diagnosed in 43 (16.0%) of all patients presenting with a presumed infection. 118 (43.0%) of the patients with a possible infection requested testing for an STD because of unsafe sexual activity without underlying symptoms. CONCLUSIONS: Sexual activity is mechanically dangerous, potentially infectious and stressful for the cardiovascular system. Because information on ED presentation related to sexual intercourse is scarce, more efforts should be undertaken to document all such complications to improve treatment and preventative strategies.

Optimizing Triage and Hospitalization in Adult General Medical Emergency Patients. The Triage Project

Background: Patients presenting to the emergency department (ED) currently face inacceptable delays in initial treatment, and long, costly hospital stays due to suboptimal initial triage and site-of-care decisions. Accurate ED triage should focus not only on initial treatment priority, but also on prediction of medical risk and nursing needs to improve site-of-care decisions and to simplify early discharge management. Different triage scores have been proposed, such as the Manchester triage system (MTS). Yet, these scores focus only on treatment priority, have suboptimal performance and lack validation in the Swiss health care system. Because the MTS will be introduced into clinical routine at the Kantonsspital Aarau, we propose a large prospective cohort study to optimize initial patient triage. Specifically, the aim of this trial is to derive a three-part triage algorithm to better predict (a) treatment priority; (b) medical risk and thus need for in-hospital treatment; (c) post-acute care needs of patients at the most proximal time point of ED admission. Methods/design: Prospective, observational, multicenter, multi-national cohort study. We will include all consecutive medical patients seeking ED care into this observational registry. There will be no exclusions except for non-adult and non-medical patients. Vital signs will be recorded and left over blood samples will be stored for later batch analysis of blood markers. Upon ED admission, the post-acute care discharge score (PACD) will be recorded. Attending ED physicians will adjudicate triage priority based on all available results at the time of ED discharge to the medical ward. Patients will be reassessed daily during the hospital course for medical stability and readiness for discharge from the nurses and if involved social workers perspective. To assess outcomes, data from electronic medical records will be used and all patients will be contacted 30 days after hospital admission to assess vital and functional status, re-hospitalization, satisfaction with care and quality of life measures. We aim to include between 5000 and 7000 patients over one year of recruitment to derive the three-part triage algorithm. The respective main endpoints were defined as (a) initial triage priority (high vs. low priority) adjudicated by the attending ED physician at ED discharge, (b) adverse 30 day outcome (death or intensive care unit admission) within 30 days following ED admission to assess patients risk and thus need for in-hospital treatment and (c) post acute care needs after hospital discharge, defined as transfer of patients to a post-acute care institution, for early recognition and planning of post-acute care needs. Other outcomes are time to first physician contact, time to initiation of adequate medical therapy, time to social worker involvement, length of hospital stay, reasons fordischarge delays, patient’s satisfaction with care, overall hospital costs and patients care needs after returning home. Discussion: Using a reliable initial triage system for estimating initial treatment priority, need for in-hospital treatment and post-acute care needs is an innovative and persuasive approach for a more targeted and efficient management of medical patients in the ED. The proposed interdisciplinary , multi-national project has unprecedented potential to improve initial triage decisions and optimize resource allocation to the sickest patients from admission to discharge. The algorithms derived in this study will be compared in a later randomized controlled trial against a usual care control group in terms of resource use, length of hospital stay, overall costs and patient’s outcomes in terms of mortality, re-hospitalization, quality of life and satisfaction with care.

Radiological findings of sexual intercourse related emergency department admissions: a first overview

OBJECTIVES Sexuality is an essential aspect of human function, well-being and quality of life. Many people have sex without complications. However, there are some people who need to seek emergency medical help for related health problems. The aim of this study was to present a first overview of patients who received a radiological examination related to sexual intercourse based emergency department admission. METHODS Our centralized electronic patient record database was reviewed for patients who had been admitted to our emergency department with an emergency after sexual intercourse between 2000 and 2011. The database was scanned for the standardized key words 'sexual intercourse' or 'coitus' retrospectively. For all patients identified in the electronic patient record database the radiological examinations were searched for manually in our Radiology Information System, and reviewed by three independent radiologists. RESULTS One hundred and twenty nine out of 445 (29,0%) patients received a radiological examination after immediate emergency department admission related to sexual intercourse. Fifty two out of 129 (40.3%) patients had positive radiological findings while 77 (59.7%) did not. Eighty point seven percent (n = 42) of the radiological findings were a sexual intercourse-associated pathology and 19.2% (n = 10) were considered to be incidental findings. Age and male sex positively correlated with radiological imaging workup (p<0.001, respectively p<0.037). The most common sexual intercourse-associated pathology was headache attributed to cerebrovascular insult (n = 21, 40.3%) followed by epididymitis (n = 7, 16.6%) and obstructive uropathy (n = 5, 11.6%). Of the patients with headache attributed to non-traumatic intracranial hemorrhage, subarachnoid hemorrhage (n = 14, 66.6%) was the most common, followed by intracerebral bleeding (n = 4, 19.0%) and one subdural hemorrhage. CONCLUSIONS Pathological findings are manifold. Cerebral imaging is the most common type of radiological imaging performed. Further prospective and standardized studies should be performed to better evaluate the significance of radiological imaging in this patient collective with the aim to gain better knowledge on what patients profit from what type of radiological imaging when presenting with a sexual intercourse related emergency. ADVANCES IN KNOWLEDGE The present study provides a first overview on radiological findings of sexual intercourse related emergency department admissions.

Mining free-text medical records for companion animal enteric syndrome surveillance.

Large amounts of animal health care data are present in veterinary electronic medical records (EMR) and they present an opportunity for companion animal disease surveillance. Veterinary patient records are largely in free-text without clinical coding or fixed vocabulary. Text-mining, a computer and information technology application, is needed to identify cases of interest and to add structure to the otherwise unstructured data. In this study EMR's were extracted from veterinary management programs of 12 participating veterinary practices and stored in a data warehouse. Using commercially available text-mining software (WordStat™), we developed a categorization dictionary that could be used to automatically classify and extract enteric syndrome cases from the warehoused electronic medical records. The diagnostic accuracy of the text-miner for retrieving cases of enteric syndrome was measured against human reviewers who independently categorized a random sample of 2500 cases as enteric syndrome positive or negative. Compared to the reviewers, the text-miner retrieved cases with enteric signs with a sensitivity of 87.6% (95%CI, 80.4-92.9%) and a specificity of 99.3% (95%CI, 98.9-99.6%). Automatic and accurate detection of enteric syndrome cases provides an opportunity for community surveillance of enteric pathogens in companion animals.