Using technology to teach technology: design and evaluation of bilingual online physician education about electronic medical records.

The "EMR Tutorial" is designed to be a bilingual online physician education environment about electronic medical records. After iterative assessment and redesign, the tutorial was tested in two groups: U.S. physicians and Mexican medical students. Split-plot ANOVA revealed significantly different pre-test scores in the two groups, significant cognitive gains for the two groups overall, and no significant difference in the gains made by the two groups. Users rated the module positively on a satisfaction questionnaire.

Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records.

BACKGROUND: We have carried out an extensive qualitative research program focused on the barriers and facilitators to successful adoption and use of various features of advanced, state-of-the-art electronic health records (EHRs) within large, academic, teaching facilities with long-standing EHR research and development programs. We have recently begun investigating smaller, community hospitals and out-patient clinics that rely on commercially-available EHRs. We sought to assess whether the current generation of commercially-available EHRs are capable of providing the clinical knowledge management features, functions, tools, and techniques required to deliver and maintain the clinical decision support (CDS) interventions required to support the recently defined "meaningful use" criteria. METHODS: We developed and fielded a 17-question survey to representatives from nine commercially available EHR vendors and four leading internally developed EHRs. The first part of the survey asked basic questions about the vendor's EHR. The second part asked specifically about the CDS-related system tools and capabilities that each vendor provides. The final section asked about clinical content. RESULTS: All of the vendors and institutions have multiple modules capable of providing clinical decision support interventions to clinicians. The majority of the systems were capable of performing almost all of the key knowledge management functions we identified. CONCLUSION: If these well-designed commercially-available systems are coupled with the other key socio-technical concepts required for safe and effective EHR implementation and use, and organizations have access to implementable clinical knowledge, we expect that the transformation of the healthcare enterprise that so many have predicted, is achievable using commercially-available, state-of-the-art EHRs.

Improving follow-up of abnormal cancer screens using electronic health records: trust but verify test result communication.

BACKGROUND: Early detection of colorectal cancer through timely follow-up of positive Fecal Occult Blood Tests (FOBTs) remains a challenge. In our previous work, we found 40% of positive FOBT results eligible for colonoscopy had no documented response by a treating clinician at two weeks despite procedures for electronic result notification. We determined if technical and/or workflow-related aspects of automated communication in the electronic health record could lead to the lack of response. METHODS: Using both qualitative and quantitative methods, we evaluated positive FOBT communication in the electronic health record of a large, urban facility between May 2008 and March 2009. We identified the source of test result communication breakdown, and developed an intervention to fix the problem. Explicit medical record reviews measured timely follow-up (defined as response within 30 days of positive FOBT) pre- and post-intervention. RESULTS: Data from 11 interviews and tracking information from 490 FOBT alerts revealed that the software intended to alert primary care practitioners (PCPs) of positive FOBT results was not configured correctly and over a third of positive FOBTs were not transmitted to PCPs. Upon correction of the technical problem, lack of timely follow-up decreased immediately from 29.9% to 5.4% (p<0.01) and was sustained at month 4 following the intervention. CONCLUSION: Electronic communication of positive FOBT results should be monitored to avoid limiting colorectal cancer screening benefits. Robust quality assurance and oversight systems are needed to achieve this. Our methods may be useful for others seeking to improve follow-up of FOBTs in their systems.

Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential?

BACKGROUND: Given the fragmentation of outpatient care, timely follow-up of abnormal diagnostic imaging results remains a challenge. We hypothesized that an electronic medical record (EMR) that facilitates the transmission and availability of critical imaging results through either automated notification (alerting) or direct access to the primary report would eliminate this problem. METHODS: We studied critical imaging alert notifications in the outpatient setting of a tertiary care Department of Veterans Affairs facility from November 2007 to June 2008. Tracking software determined whether the alert was acknowledged (ie, health care practitioner/provider [HCP] opened the message for viewing) within 2 weeks of transmission; acknowledged alerts were considered read. We reviewed medical records and contacted HCPs to determine timely follow-up actions (eg, ordering a follow-up test or consultation) within 4 weeks of transmission. Multivariable logistic regression models accounting for clustering effect by HCPs analyzed predictors for 2 outcomes: lack of acknowledgment and lack of timely follow-up. RESULTS: Of 123 638 studies (including radiographs, computed tomographic scans, ultrasonograms, magnetic resonance images, and mammograms), 1196 images (0.97%) generated alerts; 217 (18.1%) of these were unacknowledged. Alerts had a higher risk of being unacknowledged when the ordering HCPs were trainees (odds ratio [OR], 5.58; 95% confidence interval [CI], 2.86-10.89) and when dual-alert (>1 HCP alerted) as opposed to single-alert communication was used (OR, 2.02; 95% CI, 1.22-3.36). Timely follow-up was lacking in 92 (7.7% of all alerts) and was similar for acknowledged and unacknowledged alerts (7.3% vs 9.7%; P = .22). Risk for lack of timely follow-up was higher with dual-alert communication (OR, 1.99; 95% CI, 1.06-3.48) but lower when additional verbal communication was used by the radiologist (OR, 0.12; 95% CI, 0.04-0.38). Nearly all abnormal results lacking timely follow-up at 4 weeks were eventually found to have measurable clinical impact in terms of further diagnostic testing or treatment. CONCLUSIONS: Critical imaging results may not receive timely follow-up actions even when HCPs receive and read results in an advanced, integrated electronic medical record system. A multidisciplinary approach is needed to improve patient safety in this area.

The relationship between rheumatoid arthritis and reproductive function

There is growing support for the theory that an interaction between the immune and reproductive/endocrine systems underlies the pathogenesis of autoimmune rheumatic diseases. Most of the recent evidence derives from studies of sex hormones and pregnancy in women with systemic lupus. Other than an ameliorative effect of pregnancy, little is known about reproductive factors in relation to rheumatoid arthritis. To elucidate the relationship, a population-based retrospective study was undertaken. Included were 378 female residents of Olmsted County, Minnesota diagnosed with rheumatoid arthritis between 1950 and 1982 (cases) and 325 arthritis-free, married female controls matched to the 324 married cases on birth-year, age at first marriage, and duration of Olmsted County residency. Information of reproductive factors was extracted from the medical records system maintained by the Mayo Clinic.^ Cases had lower fertility rates compared with the female population of Minnesota (rate ratio = 0.86, 95% confidence interval (CI)= 0.80-0.92). Fertility was significantly reduced even prior to the onset of rheumatoid factor positive arthritis. Restricting the comparison to married Olmsted County residents did not alter the results. Further adjustments for time not at risk of conception using survival analysis and proportional hazards modeling only intensified the fertility reduction in the married cases compared with controls. Nulligravidity was more common among cases than controls (odds ratio = 3.16, CI = 1.61-6.20). Independent of fertility, pregnancy had a protective effect against rheumatoid arthritis (odds ratio = 0.31, CI = 0.11-0.89), which was dramatically reversed in the 12 months postpartum (odds ratio = 4.67, CI = 1.50-14.47). Cases were younger at menopause than controls (p $<$ 0.01).^ Small but statistically insignificant associations were observed between rheumatoid arthritis and the following factors: increased frequency of complaints to a physician of infertility; increased frequency of spontaneous abortion, premature birth, and congenital malformations following arthritis onset; and increased prevalence of menopause at arthritis onset. Cases did not differ from controls on age at menarche, duration of pregnancy, or birth weight.^ The findings provide further support for the involvement of the reproductive/endocrine systems in the pathogenesis of autoimmune rheumatic disease. The search for biological mechanisms should be intensified. ^

Concordance between medical records and personal interview in ascertaining breast cancer and diabetes status: Analysis of the south Texas women's health project

Accurate ascertainment of risk factors and disease status is vital in public health research for proper classification of research subjects. The two most common ways of obtaining this data is by self-report and review of medical records (MRs). South Texas Women’s Health Project was a case-control study looking at interrelationships between hormones, diet, and body size and breast cancer among Hispanic women 30-79 years of age. History of breast cancer, diabetes mellitus (DM) and use of DM medications was ascertained from a personal interview. At the time of interview, the subject identified her major health care providers and signed the medical records release form, which was sent to the designated providers. The MRs were reviewed to confirm information obtained from the interview.^ Aim of this study was to determine the sensitivity and specificity between MRs and personal interview in diagnosis of breast cancer, DM and DM treatment. We also wanted to assess how successful our low-cost approach was in obtaining pertinent MRs and what factors influenced the quality of MR or interview data. Study sample was 721 women with both self-report and MR data available by June 2007. Overall response rate for MR requests was 74.5%. MRs were 80.9% sensitive and 100% specific in confirming breast cancer status. Prevalence of DM was 22.7% from the interviews and 16% from MRs. MRs did not provide definite information about DM status of 53.6% subjects. Sensitivity and specificity of MRs for DM status was 88.9% and 90.4% respectively. Disagreement on DM status from the two sources was seen in 15.9% subjects. This discordance was more common among older subjects, those who were married and were predominantly Spanish speaking. Income and level of education did not have a statistically significantly association with this disagreement.^ Both self-report and MRs underestimate the prevalence of DM. Relying solely on MRs leads to greater misclassification than relying on self-report data. MRs have good to excellent specificity and thus serve as a good tool to confirm information obtained from self-report. Self-report and MRs should be used in a complementary manner for accurate assessment of DM and breast cancer status.^

THE INCIDENCE OF PELVIC ENDOMETRIOSIS IN ROCHESTER, MINNESOTA, 1970-1979

The primary objectives of the study were to measure the incidence of pelvic endometriosis among white females of reproductive age (15-49 years) in Rochester, Minnesota, during the period 1970-1979 and to determine the risk of endometriosis by age, marital status, nun status, and educational attainment in this population. An historical prospective design was used. Incident (newly diagnosed) cases were identified from community medical records, and person-years of risk in the study population were estimated from census data.^ Almost two-thirds of the incident cases had surgically verified endometriosis, while the remainder were diagnosed by clinical findings alone. Incidence rates were prepared first with histologically confirmed cases only and then with the successive inclusion of less certain cases: surgically visualized, clinically probable, and clinically possible. On this basis, overall incidence rates were 108.8 to 246.9 newly diagnosed cases per 100,000 person-years. The incidence of pelvic endometriosis was lowest for women 15-19 years of age, increased markedly through age 44, and then declined for women 45-49 years of age. A significantly greater risk of pelvic endometriosis in never married women was detected only when the numerator was limited to histologically confirmed cases. Among never married women 20-49 years of age, no significant difference in the risk of pelvic endometriosis by nun status was detected, but a trend toward a lower incidence in nuns was observed. Women with education beyond high school had a significantly higher incidence of endometriosis than women with less education.^ Cases in the four diagnostic groups differed greatly by age and marital status but were similar with respect to virtually all other characteristics, once age differences were considered. Reproductive history characteristics described included: age of menarche; history of menopause; total pregnancies; ages of first pregnancy, marriage, and sexual intercourse; years from menarche to first intercourse; years of ovulatory cycling; difficulty becoming pregnant; and delay of the first pregnancy by choice. How these characteristics of incident cases differ from those of women free of endometriosis needs to be studied in future research. ^

COMPREHENSIVE CALCULATION-BASED IMRT QA USING R&V DATA, TREATMENT RECORDS, AND A SECOND TREATMENT PLANNING SYSTEM

Purpose: Traditional patient-specific IMRT QA measurements are labor intensive and consume machine time. Calculation-based IMRT QA methods typically are not comprehensive. We have developed a comprehensive calculation-based IMRT QA method to detect uncertainties introduced by the initial dose calculation, the data transfer through the Record-and-Verify (R&V) system, and various aspects of the physical delivery. Methods: We recomputed the treatment plans in the patient geometry for 48 cases using data from the R&V, and from the delivery unit to calculate the “as-transferred” and “as-delivered” doses respectively. These data were sent to the original TPS to verify transfer and delivery or to a second TPS to verify the original calculation. For each dataset we examined the dose computed from the R&V record (RV) and from the delivery records (Tx), and the dose computed with a second verification TPS (vTPS). Each verification dose was compared to the clinical dose distribution using 3D gamma analysis and by comparison of mean dose and ROI-specific dose levels to target volumes. Plans were also compared to IMRT QA absolute and relative dose measurements. Results: The average 3D gamma passing percentages using 3%-3mm, 2%-2mm, and 1%-1mm criteria for the RV plan were 100.0 (σ=0.0), 100.0 (σ=0.0), and 100.0 (σ=0.1); for the Tx plan they were 100.0 (σ=0.0), 100.0 (σ=0.0), and 99.0 (σ=1.4); and for the vTPS plan they were 99.3 (σ=0.6), 97.2 (σ=1.5), and 79.0 (σ=8.6). When comparing target volume doses in the RV, Tx, and vTPS plans to the clinical plans, the average ratios of ROI mean doses were 0.999 (σ=0.001), 1.001 (σ=0.002), and 0.990 (σ=0.009) and ROI-specific dose levels were 0.999 (σ=0.001), 1.001 (σ=0.002), and 0.980 (σ=0.043), respectively. Comparing the clinical, RV, TR, and vTPS calculated doses to the IMRT QA measurements for all 48 patients, the average ratios for absolute doses were 0.999 (σ=0.013), 0.998 (σ=0.013), 0.999 σ=0.015), and 0.990 (σ=0.012), respectively, and the average 2D gamma(5%-3mm) passing percentages for relative doses for 9 patients was were 99.36 (σ=0.68), 99.50 (σ=0.49), 99.13 (σ=0.84), and 98.76 (σ=1.66), respectively. Conclusions: Together with mechanical and dosimetric QA, our calculation-based IMRT QA method promises to minimize the need for patient-specific QA measurements by identifying outliers in need of further review.

Description and analysis of variation in dairy product and concomitant nutrient purchases between Hispanic and non -Hispanic households using a panel of shoppers' purchase records

The purpose of this research was development of a method of estimating nutrient availability in populations as approximated by supermarket purchase records. Demographic information describing 12,516 panel households was obtained from a marketing and advertising program operated by H. E. Butt Grocery Company of San Antonio, Texas. A non-probability sample of 2,161 households meeting expenditure criteria was selected and all purchases of dairy products for this sample of households were organized into a database constructed to facilitate the retrieval, aggregation, and analysis of dairy product purchases and their nutrient contents. Two hypotheses were tested: (1) no difference would be found between Hispanic and non-Hispanic purchases of dairy product categories during the study period and (2) no difference would be found between Hispanic and non-Hispanic purchases of nutrients contained in those dairy products during the thirteen-week study period.^ Food purchase records were used to estimate nutrient exposure on a weekly, per capita basis for Hispanic and non-Hispanic households by linking some 40,000 dairy purchase Universal Product code (UPC) numbers with food composition values contained in USDA Handbook 8-1. Results of this study suggest Hispanic sample households consistently purchased fewer dairy products than did non-Hispanic sample households and consequently had fewer nutrients available from dairy purchases. While weekly expenditures for dairy products among the sample households remained relatively constant during the study period, shifts in the types of dairy products purchased were observed. The effect of ethnicity on dairy product and nutrient purchases was significant over the thirteen-week period. A database consisting of customer, household, and purchase information can be developed to successfully associate food item UPC numbers with a standard reference of food composition to estimate nutrient availability in a population over extended periods of time. ^