Health information exchange: Using metrics to address quality of care and return on investment

Health Information Exchange (HIE) will play a key part in our nation’s effort to improve healthcare. The evidence of HIEs transformational role in healthcare delivery systems is quite limited. The lack of such evidence led us to explore what exists in the healthcare industry that may provide evidence of effectiveness and efficiency of HIEs. The objective of the study was to find out how many fully functional HIEs are using any measurements or metrics to gauge impact of HIE on quality improvement (QI) and on return on investment (ROI).^ A web-based survey was used to determine the number of operational HIEs using metrics for QI and ROI. Our study highlights the fact that only 50 percent of the HIEs who responded use or plan to use metrics. However, 95 percent of the respondents believed HIEs improve quality of care while only 56 percent believed HIE showed positive ROI. Although operational HIEs present numerous opportunities to demonstrate the business model for improving health care quality, evidence to document the impact of HIEs is lacking. ^

Development of a standard sign-out procedure for clinicians in a pediatric intensive care unit

Background: Poor communication among health care providers is cited as the most common cause of sentinel events involving patients. Sign-out of patient data at the change of clinician shifts is a component of communication that is especially vulnerable to errors. Sign-outs are particularly extensive and complex in intensive care units (ICUs). There is a paucity of validated tools to assess ICU sign-outs. ^ Objective: To design a valid and reliable survey tool to assess the perceptions of Pediatric ICU (PICU) clinicians about sign-out. ^ Design: Cross-sectional, web-based survey ^ Setting: Academic hospital, 31-bed PICU ^ Subjects: Attending faculty, fellows, nurse practitioners and physician assistants. ^ Interventions: A survey was designed with input from a focus group and administered to PICU clinicians. Test-retest reliability, internal consistency and validity of the survey tool were assessed. ^ Measurements and Main Results: Forty-eight PICU clinicians agreed to participate. We had 42(88%) and 40(83%) responses in the test and retest phases. The mean scores for the ten survey items ranged from 2.79 to 3.67 on a five point Likert scale with no significant test-retest difference and a Pearson correlation between pre and post answers of 0.65. The survey item scores showed internal consistency with a Cronbach's Alpha of 0.85. Exploratory factor analysis revealed three constructs: efficacy of sign-out process, recipient satisfaction and content applicability. Seventy eight % clinicians affirmed the need for improvement of the sign-out process and 83% confirmed the need for face- to-face verbal sign-out. A system-based sign-out format was favored by fellows and advanced level practitioners while attendings preferred a problem-based format (p=0.003). ^ Conclusions: We developed a valid and reliable survey to assess clinician perceptions about the ICU sign-out process. These results can be used to design a verbal template to improve and standardize the sign-out process.^

Air Force Web Preventive Health Assessment (AF WEBPHA) mental health screening effectiveness

The U.S. Air Force assesses Active Duty Air Force (ADAF) health annually using the Air Force Web-based Preventative Health Assessment (AF WebPHA). The assessment is based on a self-administered survey used to determine the overall Air Force health and readiness, as well as, the individual health of each airman. Individual survey responses as well as groups of responses generate further computer generated assessment and result in a classification of 'Critical', 'Priority', or 'Routine', depending on the need and urgency for further evaluation by a health care provider. The importance of the 'Priority' and 'Critical' classifications is to provide timely intervention to prevent or limit unfavorable outcomes that may threaten an airman. Though the USAF has been transitioning from a paper form to the online WebPHA survey for the last three years it was not made mandatory for all airmen until 2009. The survey covers many health aspects including family history, tobacco use, exercise, alcohol use, and mental health. ^ Military stressors such as deployment, change of station, and the trauma of war can aggravate and intensify the common baseline worries experienced by the general population and place airmen at additional risks for mental health concerns and illness. This study assesses the effectiveness of the AF WebPHA mental health screening questions in predicting a mental health disorder diagnosis according to International Classification of Diseases, 9th Revision, Clinical Modification (ICD-9-CM) codes generated by physicians or their surrogates. In order to assess the sensitivity, specificity, and positive predictive value of the AF WebPHA as a screening tool for mental health, survey results were compared to ascertain if they generated any mental health disorder related diagnosis for the period from January 1, 2009 to March 31, 2010. ^ Statistical analysis of the AF WebPHA mental health responses when compared with matching ICD-9-CM codes found that the sensitivity for 'Critical' or 'Priority' responses was only 3.4% and that it would correctly predict those who had the selected mental health diagnosis 9% of the time.^

Using Blackboard Administered Precourse and Post course Tests to Assess Student Readiness to Learn and Change in Knowledge

Students arrive at classes with a varying social situations and course subject knowledge. Blackboard is a web based course delivery program that permits testing of students before arriving at the first class. A pretest was used to assess preexisting subject knowledge(S) and a survey was used to assess non-subject (N) factors that might impact the student’s final grade. A posttest was administered after all content was delivered and used to access change in S. [See PDF for complete abstract]

A qualitative assessment of the impact of Texas policy changes on nutrition in child care centers in Travis County, Texas

Background. Over half of children in the United States under age five spend 32 hours a week in child care, facilities, where they consume approximately 33-50% of their food intake. ^ Objectives. The aim of this research was to identify the effects of state nutrition policies on provision of food in child care centers. ^ Subjects. Eleven directors or their designee from ten randomly selected licensed child care centers in Travis County, Texas were interviewed. Centers included both nonprofit and for-profit centers, with enrollments ranging from 19 to 82. ^ Methods. Centers were selected using a web-based list of licensed child care providers in the Austin area. One-on-one interviews were conducted in person with center directors using a standard set of questions developed from previous pilot work. Interview items included demographic data, questions about state policies regarding provision of foods in centers, effects of policies on child care center budgets and foods offered, and changes in the provision of food. All interviews were audiotaped and transcribed, and themes were identified using standard qualitative techniques. ^ Results. Four of the centers provided both meals and snacks, four provided snacks only, and two did not provide any food. Directors of centers that provided food were more likely to report adherence to the Minimum Standards than directors of centers that did not. In general, center directors reported that the regulations were loosely enforced. In contrast, center directors were more concerned about a local city-county regulation that required food permits and new standards for kitchens. Most of these local regulations were cost prohibitive and, as a result, centers had changed the types of foods provided, which included providing less fresh produce and more prepackaged items. Although implementation of local regulations had reduced provision of fruits and vegetables to children, no adjustments were reported for allocation of resources, tuition costs or care of the children. ^ Conclusions. Qualitative data from a small sample of child care directors indicate that the implementation and accountability of food- and nutrition-related guidelines for centers is sporadic, uncoordinated, and can have unforeseen effects on the provision of food. A quantitative survey and dietary assessment methods should be conducted to verify these findings in a larger and more representative sample.^

Sleep quality and quantity and associated factors among high school students from south Texas

Background. Insufficient and poor quality sleep among adolescents affects not only the cognitive functioning, but overall health of the individual. Existing research suggests that adolescents from varying ethnic groups exhibit differing sleep patterns. However, little research focuses on sleep patterns and associated factors (i.e. tobacco use, mental health indicators) among Hispanic youth. ^ Methods. The study population (n=2,536) included students in grades 9-12 who attended one of the three public high schools along the Texas-Mexico border in 2003. This was a cross sectional study using secondary data collected via a web-based, confidential, self-administered survey. Separate logistic regression models were estimated to identify factors associated with reduced (<9 hours/night) and poor quality sleep on average during weeknights. ^ Results. Of participants, 49.5% reported reduced sleep while 12.8% reported poor quality sleep. Factors significantly (p<0.05) associated with poor quality sleep were: often feeling stressed or anxious (OR=5.49), being born in Mexico (OR=0.65), using a computer/playing video games 15+ hours per week (OR=2.29), working (OR=1.37), being a current smoker (OR=2.16), and being a current alcohol user (OR=1.64). Factors significantly associated with reduced quantity of sleep were: often feeling stressed or anxious (OR=2.74), often having headaches/stomachaches (OR=1.77), being a current marijuana user (OR=1.70), being a current methamphetamine user (OR=4.92), and being a current alcohol user (OR=1.27). ^ Discussion. Previous research suggests that there are several factors that can influence sleep quality and quantity in adolescents. This paper discusses these factors (i.e. work, smoking, alcohol, etc.) found to be associated with poor sleep quality and reduced sleep quantity in the Hispanic adolescent population. A reduced quantity of sleep (81.20% of the participants) and a poor quality of sleep (12.80% of the participants) were also found in high school students from South Texas. ^

The Open Door Mission: Measuring and predicting outcomes of one community-based substance abuse treatment program

The objectives of this study were to identify and measure the average outcomes of the Open Door Mission's nine-month community-based substance abuse treatment program, identify predictors of successful outcomes, and make recommendations to the Open Door Mission for improving its treatment program.^ The Mission's program is exclusive to adult men who have limited financial resources: most of which were homeless or dependent on parents or other family members for basic living needs. Many, but not all, of these men are either chemically dependent or have a history of substance abuse.^ This study tracked a cohort of the Mission's graduates throughout this one-year study and identified various indicators of success at short-term intervals, which may be predictive of longer-term outcomes. We tracked various levels of 12-step program involvement, as well as other social and spiritual activities, such as church affiliation and recovery support.^ Twenty-four of the 66 subjects, or 36% met the Mission's requirements for success. Specific to this success criteria; Fifty-four, or 82% reported affiliation with a home church; Twenty-six, or 39% reported full-time employment; Sixty-one, or 92% did not report or were not identified as having any post-treatment arrests or incarceration, and; Forty, or 61% reported continuous abstinence from both drugs and alcohol.^ Five research-based hypotheses were developed and tested. The primary analysis tool was the web-based non-parametric dependency modeling tool, B-Course, which revealed some strong associations with certain variables, and helped the researchers generate and test several data-driven hypotheses. Full-time employment is the greatest predictor of abstinence: 95% of those who reported full time employment also reported continuous post-treatment abstinence, while 50% of those working part-time were abstinent and 29% of those with no employment were abstinent. Working with a 12-step sponsor, attending aftercare, and service with others were identified as predictors of abstinence.^ This study demonstrates that associations with abstinence and the ODM success criteria are not simply based on one social or behavioral factor. Rather, these relationships are interdependent, and show that abstinence is achieved and maintained through a combination of several 12-step recovery activities. This study used a simple assessment methodology, which demonstrated strong associations across variables and outcomes, which have practical applicability to the Open Door Mission for improving its treatment program. By leveraging the predictive capability of the various success determination methodologies discussed and developed throughout this study, we can identify accurate outcomes with both validity and reliability. This assessment instrument can also be used as an intervention that, if operationalized to the Mission’s clients during the primary treatment program, may measurably improve the effectiveness and outcomes of the Open Door Mission.^

The Need for School-Based Teen Dating Violence Prevention

Schools have several competing demands, and often suffer from inefficient access to needed resources. Thus, the addition of any program into an already overtaxed school system must be met with convincing evidence that 1) a need or problem exists and is relevant to the education of students, 2) the problem is amenable to change, and 3) addressing the problem is in the best interest of educators and students. The purpose of the present paper is to present a case for inclusion of teen dating violence prevention programs in middle and high schools. We also discuss a recent survey of 219 employees of a suburban school district in southeast Texas. Specifically, we examined their perceived need for and appropriateness of a school-based dating violence prevention program. The anonymous internet-based survey revealed that a majority of participants believed that teen dating violence was a problem, 19% reported having observed an instance of teen dating violence, and 82% believed school to be an appropriate outlet for the implementation of a dating violence prevention program.