A process evaluation of a health literacy intervention targeting pediatric providers' communication skills at the Texas Children's Health Plan

Background. Health literacy is an important determinant for quality health care, and affects communication between patients and physicians. Poor communication may result in negative effects in health. Improved communication between patients and physicians could positively affect health outcomes. Communication skills are teachable.^ Objectives. (1) to evaluate the process involved in the design and implementation of a health literacy intervention targeting pediatric providers’ communication skills at the Texas Children’s Health Plan in Houston, Texas; and (2) to describe lessons learned from this process that may be used in future attempts to address the issue of health literacy and health communication. ^ Design/methods. The process evaluation of the implementation of a health literacy strategy at the Texas Children’s Health Plan (TCHP) consisted of a critical analysis of all documents and minutes from meetings of the team of investigators. It also involved a secondary analysis of data collected between December 2006 and June 2007. Descriptive statistics, paired t-test and Wilcoxon-signed-rank test were employed in analyzing the data. This information was complemented with a limited review of existing literature on communication skills training programs. ^ Results. The design of the educational intervention followed recommendations from experts in the field of health literacy. The delivery of the intervention was possible and benefited from existing resources and logistics within the TCHP. Very few targeted providers participated in two offerings of the workshop (6.6% and 1.7% respectively). After the educational intervention, providers showed increased knowledge of health literacy facts and its effects in health (p=0.001); increased awareness of the low health literacy problem (p=0.003); increased expectations for change in practice (p=0.002), and intent to use health literacy strategies for communication immediately following the intervention (p=0.001). Low participation indicated the need for further investigation of barriers to, and means for successful implementation of programs aimed to improving health communication. ^ Conclusions. A short, focused intervention utilizing health literacy strategies for communication appeared effective in increasing knowledge and intentions for change in a small group of pediatric providers. ^

A process evaluation of the childhood lead poisoning prevention program in Houston, Texas, 1992--1995

A process evaluation of the Houston Childhood Lead Poisoning Prevention Program, 1992-1995, was conducted. The Program's goal is to reduce lead poisoning prevalence. The study proposed to determine to what extent the Program was implemented as planned by measuring how well Program services were actually: (1) received by the intended target population; (2) delivered to children with elevated blood lead levels; (3) delivered in compliance with the Centers for Disease Control and Prevention and Program guidelines and timetables; and (4) able to reduce lead poisoning prevalence among those rescreened. Utilizing a program monitoring design, the Program's pre-collected computer records were reviewed. The study sample consisted of 820 children whose blood lead levels were above 15 micrograms per deciLiter, representing approximately 2.9% of the 28,406 screened over this period. Three blood lead levels from each participant were examined: the initial elevated result; the confirmatory result; and the next rescreen result, after the elevated confirmatory level. Results showed that the Program screened approximately 18% (28,406 of 161,569) of Houston's children under age 6 years for lead poisoning. Based on Chi-square tests of significance, results also showed that lead-poisoned participants were more likely to be younger than 3 years, male and Hispanic, compared to those not lead poisoned. The age, gender and ethnic differences observed were statistically significant (p =.01, p =.00, p =.00). Four of the six Program services: medical evaluations, rescreening, environmental inspections and confirmation, had satisfactory delivery completion rates of 71%-98%. Delivery timetable compliance rates for three of the six services examined: outreach contacts, home visits and environmental inspections were below 32%. However, dangerously elevated blood lead levels fell and lead poisoning prevalence dropped from 3.3% at initial screening to 1.2% among those rescreened, after intervention. From a public health perspective, reductions in lead poisoning prevalence are very meaningful. Based on these findings, the following are recommendations for future research: (1) integrate Program database files by utilizing a computer database management program; (2) target services at Hispanic male children under age 3 years living in the highest risk neighborhoods; (3) increase resources to: improve tracking and documentation of service delivery and provide more non-medical case management and environmental services; and (4) share the evaluation methodology/findings with the Centers for Disease Control and Prevention administrators; the implications may be relevant to other program managers conducting such assessments. ^

Process evaluation of intervention program for prevention of early sexual activity and alcohol use among Hispanic teenagers

Hispanic teens are a high-risk population for initiation of early sexual activity and alcohol use which in turn has numerous social and health consequences. One strategy to address prevention of these behaviors is to implement a capacity building intervention that promotes parent child communication, encompasses their cultural values and community participation. This study describes the process evaluation of a pilot intervention program amongst Hispanic teens and their families living along the Texas-Mexico border. “Girls Lets Talk” is a small group intervention with 10-14 year old teens and their female adult family members that involves education regarding effects of alcohol use and sexual activity as well as activities for monitoring and refusal skills to prevent risky behaviors. Two waves of the program each consisting of at least seven mother daughter dyads were conducted. During the designing process, community advisory board meetings and focus groups were held to review course materials and ensure they were appropriate to the Mexican American culture. Parent and adolescent surveys were administered at the beginning and end of the intervention to assess for psychosocial outcome variables. All sessions received high mean satisfactory scores (mean of 4.00 or better on a five point scale) for both adult and adolescent participants. Qualitative feedback was obtained via debriefing sessions to evaluate experience as well as alter recruitment strategies. A Wilcoxon Sign Rank analysis of the pre and post intervention surveys was done that showed significant changes in some outcome variables such as intentions and confidence for monitoring behaviors for adults and beliefs regarding sexual activity. “Girls Lets Talk” is a promising example of how a process evaluation plan can help develop a theory based health promotion program using the community based participatory research approach. The intervention may also be effective in altering intentions and enhancing self-efficacy among parents and teens in order to decrease risky behaviors such as early sexual activity and alcohol use.^

Modeling a health promotion campaign process

In this work we will present a model that describes how the number of healthy and unhealthy subjects that belong to a cohort, changes through time when there are occurrences of health promotion campaigns aiming to change the undesirable behavior. This model also includes immigration and emigration components for each group and a component taking into account when a subject that used to perform a healthy behavior changes to perform the unhealthy behavior. We will express the model in terms of a bivariate probability generating function and in addition we will simulate the model. ^ An illustrative example on how to apply the model to the promotion of condom use among adolescents will be created and we will use it to compare the results obtained from the simulations and the results obtained by the probability generating function. ^

'Reform' of the British national health service after the election of a labour government: Understanding the policy development process

The policy development process leading to the Labour government's white paper of December 1997—The new NHS: Modern, Dependable—is the focus of this project and the public policy development literature is used to aid in the understanding of this process. Policy makers who had been involved in the development of the white paper were interviewed in order to acquire a thorough understanding of who was involved in this process and how they produced the white paper. A theoretical framework is used that sorts policy development models into those that focus on knowledge and experience, and those which focus on politics and influence. This framework is central to understanding the evidence gathered from the individuals and associations that participated in this policy development process. The main research question to be asked in this project is to what extent do either of these sets of policy development models aid in understanding and explicating the process by which the Labour government's policies were developed. The interview evidence, along with published evidence, show that a clear pattern of policy change emerged from this policy development process, and the Knowledge-Experience and Politics-Influence policy making models both assist in understanding this process. The early stages of the policy development process were characterized as hierarchical and iterative, yet also very collaborative among those participating, with knowledge and experience being quite prevalent. At every point in the process, however, informal networks of political influence were used and noted to be quite prevalent by all of the individuals interviewed. The later stages of the process then became increasingly noninclusive, with decisions made by a select group of internal and external policy makers. These policy making models became an important tool with which to understand the policy development process. This Knowledge-Experience and Politics-Influence dichotomy of policy development models could therefore be useful in analyzing other types of policy development. ^

Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^

Use of a modified delphi process for establishing occupational exposure limits in support of health surveillance for space travelers

On-orbit exposures can come from numerous factors related to the space environment as evidenced by almost 50 years of environmental samples collected for water analysis, air analysis, radiation analysis, and physiologic parameters. For astronauts and spaceflight participants the occupational exposures can be very different from those experienced by workers performing similar tasks in workplaces on Earth, because the duration of the exposure could be continuous for very long orbital, and eventually interplanetary, missions. The establishment of long-term exposure standards is vital to controlling the quality of the spacecraft environment over long periods. NASA often needs to update and revise its prior exposure standards (Spacecrafts Maximum Allowable Concentrations (SMACs)). Traditional standards-setting processes are often lengthy, so a more rapid method to review and establish standards would be a substantial advancement in this area. This project investigates use of the Delphi method for this purpose. ^ In order to achieve the objectives of this study a modified Delphi methodology was tested in three trials executed by doctoral students and a panel of experts in disciplines related to occupational safety and health. During each test/trial modifications were made to the methodology. Prior to submission of the Delphi Questionnaire to the panel of experts a pilot study/trial was conducted using five doctoral students with the goals of testing and adjusting the Delphi questionnaire to improve comprehension, work out any procedural issues and evaluate the effectiveness of the questionnaire in drawing the desired responses. The remainder of the study consisted of two trials of the Modified Delphi process using 6 chemicals that currently have the potential of causing occupational exposures to NASA astronauts or spaceflight participants. To assist in setting Occupational Exposure Limits (OEL), the expert panel was established consisting of experts from academia, government and industry. Evidence was collected and used to create close-ended questionnaires which were submitted to the Delphi panel of experts for the establishment of OEL values for three chemicals from the list of six originally selected (trial 1). Once the first Delphi trial was completed, adjustments were made to the Delphi questionnaires and the process above was repeated with the remaining 3 chemicals (trial 2). ^ Results indicate that experience in occupational safety and health and with OEL methodologies can have a positive effect in minimizing the time experts take in completing this process. Based on the results of the questionnaires and comparison of the results with the SMAC already established by NASA, we conclude that use of the Delphi methodology is appropriate for use in the decision-making process for the selection of OELs.^

A PROCESS FOR ACHIEVING COMPARABLE DATA FROM HETEROGENEOUS DATABASES

The current state of health and biomedicine includes an enormity of heterogeneous data ‘silos’, collected for different purposes and represented differently, that are presently impossible to share or analyze in toto. The greatest challenge for large-scale and meaningful analyses of health-related data is to achieve a uniform data representation for data extracted from heterogeneous source representations. Based upon an analysis and categorization of heterogeneities, a process for achieving comparable data content by using a uniform terminological representation is developed. This process addresses the types of representational heterogeneities that commonly arise in healthcare data integration problems. Specifically, this process uses a reference terminology, and associated "maps" to transform heterogeneous data to a standard representation for comparability and secondary use. The capture of quality and precision of the “maps” between local terms and reference terminology concepts enhances the meaning of the aggregated data, empowering end users with better-informed queries for subsequent analyses. A data integration case study in the domain of pediatric asthma illustrates the development and use of a reference terminology for creating comparable data from heterogeneous source representations. The contribution of this research is a generalized process for the integration of data from heterogeneous source representations, and this process can be applied and extended to other problems where heterogeneous data needs to be merged.

Sequential incoherence in a multi-party synchronous computer mediated communication for an introductory Health Informatics course.

Online courses will play a key role in the high-volume Informatics education required to train the personnel that will be necessary to fulfill the health IT needs of the country. Online courses can cause feelings of isolation in students. A common way to address these feelings is to hold synchronous online "chats" for students. Conventional chats, however, can be confusing and impose a high extrinsic cognitive load on their participants that hinders the learning process. In this paper we present a qualitative analysis that shows the causes of this high cognitive load and our solution through the use of a moderated chat system.

A Coordinated and Systematic Model for Adopting, Implementing and Maintaining Effective Sexual Health Education Programs in Schools

Getting evidence-based sexual health education activities into schools can be a complicated process. Working models that assist our educational system in the selection, implementation, and maintenance of effective school-based adolescent health programs are needed. Replicating sexual health programs in school-based settings: A model for schools provides a comprehensive and applied approach that engages all of the important stakeholders within a school district. The results from this study hold much potential to inform Texas and the nation about how a coordinated and practical model can assist school districts to increase the use of evidence-based programs addressing teen pregnancy prevention and sexual health issues.

Conceptual Bases of the Planning Process in Family Preservation/Family Support State Plans

Congress and the Department of Health and Human Services (DHHS) intend for the Family Preservation and Support Act of 1993 (P.L. 103-66) to catalyze major reforms in state human services systems. DHHS and numerous other institutions developed conceptual and procedural guidance for the states' planning processes. Review of the planning dimensions of participation and expertise reveals that major emphases on stakeholder participation and technical planning processes obscure the need for expertise in family preservation and family support.

Community participation in health services

This study critically analyzes and synthesizes community participation (CP) theory across disciplines, defining and beginning to map out the elements of CP according to a preliminary framework of structure, process, intermediate outcomes, and ultimate outcomes. The first study component sought to determine the impact of Sight N' Soul, a CP project utilizing neighborhood health workers (NHWs), on appointment missing in an indigent urban African-American population. It found that persons entering the vision care system through contact with an NEW were about a third less likely to miss an appointment than those persons entering the system through some other avenue. While theory in this area remains too poorly developed to hypothesize causal relationships between structure, process, and outcomes, a summary of the elements of Sight N' Soul's structure and process both developed the preliminary framework and serves as a first step to mapping these relationships. The second component of the study uncovered the elements of structure and process that may contribute to a sustained egalitarian partnership between community people and professionals, a CP program called Project HEAL. Elements of Project HEAL's structure and process included a shared belief in the program; spirituality; contribution, ownership, and reciprocation; a feeling of family; making it together; honesty, trust, and openness about conflict; the inevitability of uncertainty and change; and the guiding interactional principles of respect; love, care, and compassion; and personal responsibility. The third component analyzed the existing literature, identifying and addressing gaps and inconsistencies and highlighting areas needing more highly developed ethical analysis. Focal issues include the political, economic, and historical context of CP; the power of naming; the issue of purpose; the nature of community; the power to muster and allocate resources; and the need to move to a systems view of health and well-being, expanding our understanding of the universe of potential outcomes of CP, including iatrogenic outcomes. Intermediate outcomes might include change in community, program, and individual capacity, as well as improved health care delivery. Ultimate outcomes include increased positive interdependencies and opportunities for contribution; improved mental, physical, and spiritual health; increased social justice; and decreased exploitation. ^