EFFECTS OF INFORMATION DISPLAY ON THE CONSTRUCTION OF CLINICIAN MENTAL MODELS

Objective: To determine how a clinician’s background knowledge, their tasks, and displays of information interact to affect the clinician’s mental model. Design: Repeated Measure Nested Experimental Design Population, Sample, Setting: Populations were gastrointestinal/internal medicine physicians and nurses within the greater Houston area. A purposeful sample of 24 physicians and 24 nurses were studied in 2003. Methods: Subjects were randomized to two different displays of two different mock medical records; one that contained highlighted patient information and one that contained non-highlighted patient information. They were asked to read and summarize their understanding of the patients aloud. Propositional analysis was used to understand their comprehension of the patients. Findings: Different mental models were found between physicians and nurses given the same display of information. The information they shared was very minor compared to the variance in their mental models. There was additionally more variance within the nursing mental models than the physician mental models given different displays of the same information. Statistically, there was no interaction effect between the display of information and clinician type. Only clinician type could account for the differences in the clinician comprehension and thus their mental models of the cases. Conclusion: The factors that may explain the variance within and between the clinician models are clinician type, and only in the nursing group, the use of highlighting.

From Caregiver to Computer Geek: The Design of a Web Resource for Novice Clinical Informaticians

Introduction: Throughout the United States, there are massive initiatives in place to reform healthcare through the implementation of electronic health records. The goals are to improve patient care through improved access to records, the improvement of business and reimbursement processes, streamlining of clinician workflows for increased efficiency, and reducing the variability in the delivery of patient care. [See PDF for complete abstract]

Efficacy of quality criteria to identify potentially harmful information: a cross-sectional survey of complementary and alternative medicine web sites.

BACKGROUND: Many users search the Internet for answers to health questions. Complementary and alternative medicine (CAM) is a particularly common search topic. Because many CAM therapies do not require a clinician's prescription, false or misleading CAM information may be more dangerous than information about traditional therapies. Many quality criteria have been suggested to filter out potentially harmful online health information. However, assessing the accuracy of CAM information is uniquely challenging since CAM is generally not supported by conventional literature. OBJECTIVE: The purpose of this study is to determine whether domain-independent technical quality criteria can identify potentially harmful online CAM content. METHODS: We analyzed 150 Web sites retrieved from a search for the three most popular herbs: ginseng, ginkgo and St. John's wort and their purported uses on the ten most commonly used search engines. The presence of technical quality criteria as well as potentially harmful statements (commissions) and vital information that should have been mentioned (omissions) was recorded. RESULTS: Thirty-eight sites (25%) contained statements that could lead to direct physical harm if acted upon. One hundred forty five sites (97%) had omitted information. We found no relationship between technical quality criteria and potentially harmful information. CONCLUSIONS: Current technical quality criteria do not identify potentially harmful CAM information online. Consumers should be warned to use other means of validation or to trust only known sites. Quality criteria that consider the uniqueness of CAM must be developed and validated.

Improving follow-up of abnormal cancer screens using electronic health records: trust but verify test result communication.

BACKGROUND: Early detection of colorectal cancer through timely follow-up of positive Fecal Occult Blood Tests (FOBTs) remains a challenge. In our previous work, we found 40% of positive FOBT results eligible for colonoscopy had no documented response by a treating clinician at two weeks despite procedures for electronic result notification. We determined if technical and/or workflow-related aspects of automated communication in the electronic health record could lead to the lack of response. METHODS: Using both qualitative and quantitative methods, we evaluated positive FOBT communication in the electronic health record of a large, urban facility between May 2008 and March 2009. We identified the source of test result communication breakdown, and developed an intervention to fix the problem. Explicit medical record reviews measured timely follow-up (defined as response within 30 days of positive FOBT) pre- and post-intervention. RESULTS: Data from 11 interviews and tracking information from 490 FOBT alerts revealed that the software intended to alert primary care practitioners (PCPs) of positive FOBT results was not configured correctly and over a third of positive FOBTs were not transmitted to PCPs. Upon correction of the technical problem, lack of timely follow-up decreased immediately from 29.9% to 5.4% (p<0.01) and was sustained at month 4 following the intervention. CONCLUSION: Electronic communication of positive FOBT results should be monitored to avoid limiting colorectal cancer screening benefits. Robust quality assurance and oversight systems are needed to achieve this. Our methods may be useful for others seeking to improve follow-up of FOBTs in their systems.

Development and validation of the Neuro Symptom Inventory in the primary brain tumor patient population

Symptoms has been shown to predict quality of life, treatment course and survival in solid tumor patients. Currently, no instrument exists that measures both cancer-related symptoms and the neurologic symptoms that are unique to persons with primary brain tumors (PBT). The aim of this study was to develop and validate an instrument to measure symptoms in patients who have PBT. A conceptual analysis of symptoms and symptom theories led to defining the symptoms experience as the perception of the frequency, intensity, distress, and meaning that occurs as symptoms are produced, perceived, and expressed. The M.D. Anderson Symptom Inventory (MDASI) measures both symptoms and how they interfere with daily functioning in patients with cancer, which is similar to the situational meaning defined in the analysis. A list of symptoms pertinent to the PBT population was added to the core MDASI and reviewed by a group of experts for validity. As a result, 18 items were added to the core MDASI (the MDASI-BT) for the next phase of instrument development, establishing validity and reliability through a descriptive, cross-sectional approach with PBT patients. Data were collected with a patient completed demographic data sheet, an investigator completed clinician checklist, and the MDASI-BT. Analysis evaluated the reliability and validity of the MDASI-BT in PBT patients. Data were obtained from 201 patients. The number of items was reduced to 22 by evaluation of symptom severity as well as cluster analysis. Regression analysis showed more than half (56%) of the variability in symptom severity was explained by the brain tumor module items. Factor analysis confirmed that the 22 item MDASI-BT measured six underlying constructs: (a) affective; (b) cognitive; (c) focal neurologic deficits; (d) constitutional symptoms; (e) treatment-related symptoms; and (f) gastrointestinal symptoms. The MDASI-BT was sensitive to disease severity and if the patient was hospitalized. The MDASI-BT is the first instrument to measure symptoms in PBT patients that has demonstrated reliability and validity. It is the first step in a program of research to evaluate the occurrence of symptoms and plan and evaluate interventions for PBT patients. ^

Posttraumatic stress disorder among veterans of the Operation Iraqi Freedom (OIF) and Operation Enduring Freedom (OEF) wars: Psychological comorbidities, postdeployment social support and unit support

Much attention has been given to treating Operation Iraqi Freedom/Operation Enduring (OIF/OEF) Veterans with posttraumatic stress disorder (PTSD). However, little attention is given to those Veterans who do not meet diagnostic criteria for PTSD but who may still benefit from intervention. Research is needed to investigate the impact of how different racial/ethnic backgrounds, different levels of social support and comorbid mental health disorders impact OIF/OEF Veterans with varying levels of PTSD. The purpose of this dissertation is to examine the association of comorbid Axis I disorders, race/ethnicity, different levels of postdeployment social support and unit support on OIF/OEF Veterans with varying levels of PTSD. Data for this dissertation were from postdeployment screenings of OIF/OEF Veterans from a large Veterans Affairs hospital in southeast Texas. To examine the study hypotheses, we conducted multinomial logistic regressions of the clinician reported data. ^ The first article examined the prevalence of subthreshold and full levels of PTSD and compared Axis I and alcohol use comorbidity rates among 1,362 OIF/OEF Veterans with varying levels of PTSD. Results suggest that OIF/OEF Veterans with subthreshold PTSD experience similar levels of psychological distress as those with full PTSD and highlight the need to provide timely and appropriate mental health services to individuals who may not meet the diagnostic criteria for full PTSD. ^ These results suggest that OIF/OEF Veterans of all race/ethnicities can benefit from strong social support systems. Postdeployment social support was found to be a protective factor against the development of PTSD among White, Black and Hispanic veterans while deployment unit support was a protective factor only among Black Veterans. The second article investigated the association between postdeployment social support and unit support with varying levels of PTSD by race/ethnicity among 1,115 OIF/OEF Veterans. ^ The results of this study can help to formulate treatment and interventions for OIF/OEF Veterans with varying levels of PTSD and social support systems.^

Prediction of sepsis in the burn intensive care unit patient

Sepsis is a significant cause for multiple organ failure and death in the burn patient, yet identification in this population is confounded by chronic hypermetabolism and impaired immune function. The purpose of this study was twofold: 1) determine the ability of the systemic inflammatory response syndrome (SIRS) and American Burn Association (ABA) criteria to predict sepsis in the burn patient; and 2) develop a model representing the best combination of clinical predictors associated with sepsis in the same population. A retrospective, case-controlled, within-patient comparison of burn patients admitted to a single intensive care unit (ICU) was conducted for the period January 2005 to September 2010. Blood culture results were paired with clinical condition: "positive-sick"; "negative-sick", and "screening-not sick". Data were collected for the 72 hours prior to each blood culture. The most significant predictors were evaluated using logistic regression, Generalized Estimating Equations (GEE) and ROC area under the curve (AUC) analyses to assess model predictive ability. Bootstrapping methods were employed to evaluate potential model over-fitting. Fifty-nine subjects were included, representing 177 culture periods. SIRS criteria were not found to be associated with culture type, with an average of 98% of subjects meeting criteria in the 3 days prior. ABA sepsis criteria were significantly different among culture type only on the day prior (p = 0.004). The variables identified for the model included: heart rate>130 beats/min, mean blood pressure<60 mmHg, base deficit<-6 mEq/L, temperature>36°C, use of vasoactive medications, and glucose>150 mg/d1. The model was significant in predicting "positive culture-sick" and sepsis state, with AUC of 0.775 (p < 0.001) and 0.714 (p < .001), respectively; comparatively, the ABA criteria AUC was 0.619 (p = 0.028) and 0.597 (p = .035), respectively. SIRS criteria are not appropriate for identifying sepsis in the burn population. The ABA criteria perform better, but only for the day prior to positive blood culture results. The time period useful to diagnose sepsis using clinical criteria may be limited to 24 hours. A combination of predictors is superior to individual variable trends, yet algorithms or computer support will be necessary for the clinician to find such models useful. ^

Biomedical informatics applications for epilepsy management: A systematic review

Epilepsy is a very complex disease which can have a variety of etiologies, co-morbidities, and a long list of psychosocial factors4. Clinical management of epilepsy patients typically includes serological tests, EEG's, and imaging studies to determine the single best antiepileptic drug (AED). Self-management is a vital component of achieving optimal health when living with a chronic disease. For patients with epilepsy self-management includes any necessary actions to control seizures and cope with any subsequent effects of the condition9; including aspects of treatment, seizure, and lifestyle. The use of computer-based applications can allow for more effective use of clinic visits and ultimately enhance the patient-provider relationship through focused discussion of determinants affecting self-management. ^ The purpose of this study is to conduct a systematic literature review on informatics application in epilepsy self-management in an effort to describe current evidence for informatics applications and decision support as an adjunct to successful clinical management of epilepsy. Each publication was analyzed for the type of study design utilized. ^ A total of 68 publications were included and categorized by the study design used, development stage, and clinical domain. Descriptive study designs comprised of three-fourths of the publications and indicate an underwhelming use of prospective studies. The vast majority of prospective studies also focused on clinician use to increase knowledge in treating patients with epilepsy. ^ Due to the chronic nature of epilepsy and the difficulty that both clinicians and patients can experience in managing epilepsy, more prospective studies are needed to evaluate applications that can effectively increase management activities. Within the last two decades of epilepsy research, management studies have employed the use of biomedical informatics applications. While the use of computer applications to manage epilepsy has increased, more progress is needed.^

Global practice experience: A useful lens for understanding patient and staff perceptions of successful integration of health information technology in primary care

Making healthcare comprehensive and more efficient remains a complex challenge. Health Information Technology (HIT) is recognized as an important component of this transformation but few studies describe HIT adoption and it's effect on the bedside experience by physicians, staff and patients. This study applied descriptive statistics and correlation analysis to data from the Patient-Centered Medical Home National Demonstration Project (NDP) of the American Academy of Family Physicians. Thirty-six clinics were followed for 26 months by clinician/staff questionnaires and patient surveys. This study characterizes those clinics as well as staff and patient perspectives on HIT usefulness, the doctor-patient relationship, electronic medical record (EMR) implementation, and computer connections in the practice throughout the study. The Global Practice Experience factor, a composite score related to key components of primary care, was then correlated to clinician and patient perspectives. This study found wide adoption of HIT among NDP practices. Patient perspectives on HIT helpfulness on the doctor-patient showed a suggestive trend that approached statistical significance (p = 0.172). Clinicians and staff noted successful integration of EMR into clinic workflow and their perception of helpfulness to the doctor-patient relationship show a suggestive increase also approaching statistical significance (p=0.06). GPE was correlated with clinician/staff assessment of a helpful doctor-patient relationship midway through the study (R 0.460, p = 0.021) with the remaining time points nearing statistical significance. GPE was also correlated to both patient perspectives of EMR helpfulness in the doctor-patient relationship (R 0.601, p = 0.001) and computer connections (R 0.618, p = 0.0001) at the start of the study. ^

Development of a standard sign-out procedure for clinicians in a pediatric intensive care unit

Background: Poor communication among health care providers is cited as the most common cause of sentinel events involving patients. Sign-out of patient data at the change of clinician shifts is a component of communication that is especially vulnerable to errors. Sign-outs are particularly extensive and complex in intensive care units (ICUs). There is a paucity of validated tools to assess ICU sign-outs. ^ Objective: To design a valid and reliable survey tool to assess the perceptions of Pediatric ICU (PICU) clinicians about sign-out. ^ Design: Cross-sectional, web-based survey ^ Setting: Academic hospital, 31-bed PICU ^ Subjects: Attending faculty, fellows, nurse practitioners and physician assistants. ^ Interventions: A survey was designed with input from a focus group and administered to PICU clinicians. Test-retest reliability, internal consistency and validity of the survey tool were assessed. ^ Measurements and Main Results: Forty-eight PICU clinicians agreed to participate. We had 42(88%) and 40(83%) responses in the test and retest phases. The mean scores for the ten survey items ranged from 2.79 to 3.67 on a five point Likert scale with no significant test-retest difference and a Pearson correlation between pre and post answers of 0.65. The survey item scores showed internal consistency with a Cronbach's Alpha of 0.85. Exploratory factor analysis revealed three constructs: efficacy of sign-out process, recipient satisfaction and content applicability. Seventy eight % clinicians affirmed the need for improvement of the sign-out process and 83% confirmed the need for face- to-face verbal sign-out. A system-based sign-out format was favored by fellows and advanced level practitioners while attendings preferred a problem-based format (p=0.003). ^ Conclusions: We developed a valid and reliable survey to assess clinician perceptions about the ICU sign-out process. These results can be used to design a verbal template to improve and standardize the sign-out process.^

Analytical frame for public policy implementation

"I don't think we truly understand how to implement. What does it mean to truly implement? Not the command center type that our culture is very good at, but a thorough planned systematic approach" (HP, 9.28.2011). This important question is asked by a clinician who works in a health care setting and who has experienced the implementation of a public policy. This case study applied the lessons learned from three generations of public policy research to a health care setting. As a result of the study an analytical frame was created as a guide to assess an organization's readiness for the implementation of a public policy.^