Process evaluation of the Texas occupational safety & health surveillance system

Introduction: The Texas Occupational Safety & Health Surveillance System (TOSHSS) was created to collect, analyze and interpret occupational injury and illness data in order to decrease the impact of occupational injuries within the state of Texas. This process evaluation was performed midway through the 4-year grant to assess the efficiency and effectiveness of the surveillance system’s planning and implementation activities1. ^ Methods: Two evaluation guidelines published by the Centers for Disease Control and Prevention (CDC) were used as the theoretical models for this process evaluation. The Framework for Program Evaluation in Public Health was used to examine the planning and design of TOSHSS using logic models. The Framework for Evaluating Public Health Surveillance Systems was used to examine the implementation of approximately 60 surveillance activities, including uses of the data obtained from the surveillance system. ^ Results/Discussion: TOSHSS planning activities omitted the creation of a scientific advisory committee and specific activities designed to maintain contacts with stakeholders; and proposed activities should be reassessed and aligned with ongoing performance measurement criteria, including the role of collaborators in helping the surveillance system achieve each proposed activity. TOSHSS implementation activities are substantially meeting expectations and received an overall score of 61% for all activities being performed. TOSHSS is considered a surveillance system that is simple, flexible, acceptable, fairly stable, timely, moderately useful, with good data quality and a PVP of 86%. ^ Conclusions: Through the third year of TOSHSS implementation, the surveillance system is has made a considerable contribution to the collection of occupational injury and illness information within the state of Texas. Implementation of the nine recommendations provided under this process evaluation is expected to increase the overall usefulness of the surveillance system and assist TDSHS in reducing occupational fatalities, injuries, and diseases within the state of Texas. ^ 1 Disclaimer: The Texas Occupational Safety and Health Surveillance System is supported by Grant/Cooperative Agreement Number (U60 OH008473-01A1). The content of the current evaluation are solely the responsibility of the authors and do not necessarily represent the official views of the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health.^

THE EVALUATION OF PUBLIC HEALTH COMPONENTS OF INTERNATIONAL DISASTER RELIEF OPERATIONS: INDOCHINESE REFUGEES IN THAILAND, 1979-1982

Refugee populations suffer poor health status and yet the activities of refugee relief agencies in the public health sector have not been subjected previously to comprehensive evaluation. The purpose of this study was to examine the effectiveness and cost of the major public health service inputs of the international relief operation for Indochinese refugees in Thailand coordinated by the United Nations High Commissioner for Refugees (UNHCR). The investigator collected data from surveillance reports and agency records pertaining to 11 old refugee camps administered by the Government of Thailand Ministry of Interior (MOI) since an earlier refugee influx, and five new Khmer holding centers administered directly by UNHCR, from November, 1979, to March, 1982.^ Generous international funding permitted UNHCR to maintain a higher level of public health service inputs than refugees usually enjoyed in their countries of origin or than Thais around them enjoyed. Annual per capita expenditure for public health inputs averaged approximately US$151. Indochinese refugees in Thailand, for the most part, had access to adequate general food rations, to supplementary feeding programs, and to preventive health measures, and enjoyed high-quality medical services. Old refugee camps administered by MOI consistently received public health inputs of lower quantity and quality compared with new UNHCR-administered holding centers, despite comparable per capita expenditure after both types of camps had stabilized (static phase).^ Mortality and morbidity rates among new Khmer refugees were catastrophic during the emergency and transition phases of camp development. Health status in the refugee population during the static phase, however, was similar to, or better than, health status in the refugees' countries of origin or the Thai communities surrounding the camps. During the static phase, mortality and morbidity generally remained stable at roughly the same low levels in both types of camps.^ Furthermore, the results of multiple regression analyses demonstrated that combined public health inputs accounted for from one to 23 per cent of the variation in refugee mortality and morbidity. The direction of associations between some public health inputs and specific health outcome variables demonstrated no clear pattern. ^

Evaluation of Knowledge Regarding Diagnostic Strategies for Genetic Diseases in Select Residents

Genetics education for physicians has been a popular publication topic in the United States and in Europe for over 20 years. Decreasing numbers of medical genetics professionals and an increasing volume of genetic information has created a dire need for increased genetics training in medical school and in clinical practice. This study aimed to assess how well pediatrics-focused primary care physicians apply their general genetics knowledge to clinical genetic testing using scenario-based questions. We chose to specifically focus on knowledge of the diagnostic applicability of Chromosomal Microarray (CMA) technology in pediatrics because of its recent recommendation by the International Standard Cytogenomic Array (ISCA) Consortium as a first-tier genetic test for individuals with developmental disabilities and/or congenital anomalies. Proficiency in ordering baseline genetic testing was evaluated for eighty-one respondents from four pediatrics-focused residencies (categorical pediatrics, pediatric neurology, internal medicine/pediatrics, and family practice) at two large residency programs in Houston, Texas. Similar to other studies, we found an overall deficit of genetic testing knowledge, especially among family practice residents. Interestingly, residents who elected to complete a genetics rotation in medical school scored significantly better than expected, as well as better than residents who did not elect to complete a genetics rotation. We suspect that the insufficient knowledge among physicians regarding a baseline genetics work-up is leading to redundant (i.e. concurrent karyotype and CMA) and incorrect (i.e. ordering CMA to detect achondroplasia) genetic testing and is contributing to rising health care costs in the United States. Our results provide specific teaching points upon which medical schools can focus education about clinical genetic testing and suggest that increased collaboration between primary care physicians and genetics professionals could benefit patient health care overall.

Economic evaluation of latent tuberculosis infection screening among health care workers in Houston

Since interferon-gamma release assays (IGRAs) were introduced in the 2000's, tuberculin skin testing (TST) and IGRAs have been used in various latent tuberculosis infection (LTBI) screening settings. IGRAs are laboratory-based tests and are considered not to be affected by previous Bacille de Calmette et Guérin (BCG) vaccination; however, they are more costly when compared directly with TST, which does not require specimen processing in a laboratory. This study aimed to examine TST and two types of IGRAs, QuantiFERON-TB Gold in Tube (QFT-GIT) and T-SPOT. TB (TSPOT), from an economic viewpoint. Firstly, a systematic literature review was conducted to identify cost related analyses of LTBI screening. Secondly, specific cost information detailing each test's items and labor was collected from an LTBI screening program of health care workers in Houston, and the cost of each test was computed. Thirdly, using the computed cost estimate of each test, cost-effectiveness analyses were conducted to compare TST and IGRAs.^ A literature search showed that a limited number of studies have been conducted, but the IGRA's economic advantages were common among studies. Cost analyses showed that IGRAs were much more costly than TST. The results were consistent with previous studies. In cost-effectiveness analyses, where test cost and consequential TB-related cost were considered, IGRAs showed variable advantages over TST depending on the targeted population. When only non BCG-vaccinated people were considered, TST was the least costly option among the three tests. On the other hand, when only BCG-vaccinated people were considered, IGRAs were less costly options. These results were mostly consistent even with varying assumption parameters.^ IGRAs can be more costly than TST, but their economic disadvantages are alleviated when the target population was BCG-vaccinated. Based on current knowledge, IGRAs may be recommended in a population where the BCG history is mixed. Additional studies are needed to better understand IGRA's reliability among low-incidence and low-risk populations in which background TB prevalence is low.^

Encouraging adolescents toward mental health careers via website biographies.

This project designed, developed, implemented and is currently evaluating the effectiveness of an interactive, multi-media website designed to encourage adolescents to consider careers in mental health. This Web-based learning environment features biographies of mental health scientists. Evaluation is conducted in a systematic, structured way using cognitive achievement, usability (ease of use), and affective scales (e.g., fun to use) as outcome measures

Evaluation and Model of a Clinical Librarian Program

Clinical medical librarianship is entering its second decade, but little evaluative data has accrued in the literature. Variations from the original programs and novel new approaches have insured the survival of the program so far. The clinical librarian (CL) forms a vital link between the library and the health care professional, operating as an important information transfer agent. However, to further insure the survival of these vital programs, hard evaluative evidence is needed. The University of Texas Medical Branch (UTMB) at Galveston began a CL Program in 1978/79. An extensive three-year pre/post evaluation study was conducted using a specifically developed evaluation model, which, if adopted by others, will provide the needed comparative data. Both a pilot study, or formative evaluation, and a summative evaluation were conducted. The results of this evaluation confirmed many of the conclusions reported by other CL programs. Eight hypotheses were proposed at the beginning of this study. Data were collected and used to support acceptance or rejection of the null hypotheses, and conclusions were drawn according to the results. Implications relevant to the study conclusions and future trends in medical librarianship are also discussed in the closing chapter.

An evaluation of the Texas "A Woman's Right to Know" booklet: A state mandated patient education document for induced abortion

Many patient educational documents are written at a grade level higher than the level at which most individuals can read. This discrepancy can lead to treatment noncompliance and negative health outcomes. Therefore, it is important that patients receive readable health information. The Texas "A Woman's Right to Know" booklet is a state mandated informational document provided to women seeking abortion services. Given the significance of the abortion procedure, it is imperative that women considering having an abortion receive accurate and readable health materials. However, no published studies were found that evaluated the readability of the "A Woman's Right to Know" booklet. Therefore, the purpose of this study was to assess the readability of the "A Woman's Right to Know" booklet. To assess the readability, the Flesch-Kincaid readability test was used to evaluate the reading grade level of the entire "A Woman's Right to Know" booklet and each of the 7 sections of the booklet. The results showed that the readability of the entire booklet as well as each section of the booklet was written below the 8th grade reading level. Although the booklet was written below the estimated United States reading level (8th grade), the reading level of this booklet may still be too high for people in Texas who read below the 8th grade level. Based on these results, it is recommended that health care professionals involved in the distribution and explanation of the "A Woman's Right to Know" booklet provide their patients with both written and verbal medical information. The patients should be allowed to ask questions about the abortion procedure so that they can make the most informed choice.^

Formative evaluation of a parental involvement program for obesity prevention with low-income elementary school children

This study addresses the responses to a postcard campaign with health messages targeting the parents of children in a sample of low-income elementary schools and assesses the feasibility and areas of possible improvements in such a project. The campaign was implemented in Spring 2009 with 4 th grade students (n=1070) in fifteen economically disadvantaged elementary schools in Travis County, Texas. Postcards were sent home with children, and parents filled out a feedback card that the children returned to school. Response data, in the form of self-administered feedback cards (n=2665) and one-on-one teacher interviews (n=8), were qualitatively analyzed using NVivo 8 software. Postcard reception and points of improvement were then identified from the significant themes that emerged including health, cessation or reduction of unhealthy behaviors, motivation, family, and the comprehension of abstract health concepts. ^ Responses to the postcard campaign were almost completely positive, with less than 1% of responses reporting some sort of dislike, and many parents reported a modification of their behavior. However, possible improvements that could be made to the campaign are: increased focus of the postcards on the parents as the target population, increased information about serving size, greater emphasis on the link between obesity and health, alteration of certain skin tones used in the graphical depiction of people on the cards, and smaller but more frequent incentives to return the feedback cards for the students. The program appears to be an effective method of communicating health messages to the parents of 4th grade children.^

An evaluation of Employee Assistance Programs: An overview and case study

Methodologies for the analysis and cross-evaluations of Employee Assistance Programs (EAPs) are necessary to indicate program weaknesses and strengths for both present and future EAP services.^ As EAPs have matured from simplistic industrial alcoholism programs to all problem-encompassing, complex programs, an aggressive group of entrepreneurs has developed. Business and industrial managements need established criteria to select the most suitable professional services for their needs, as well as the best investment value for cost containments.^ Four major EAPs were compared to determine critical areas necessary for cross evaluation. Future standardization of terminology and definitions of services will facilitate both the evaluation of a specific program and its comparison to problems or successes of other EAPs.^ Past evaluation difficulties have been caused by the lack of EAP program accreditations and professional personnel licensure requirements. The Association of Labor Management Administrators and Consultants on Alcoholism (ALMACA) has recently set certification criteria for personnel, which will enhance the professional standards for EAPs. ^

An evaluation of a behavioral change intervention for smokeless tobacco use

During the last three decades considerable attention has been placed on the reduction of tobacco use due to cigarette smoking. During this time, studies have been funded and programs have been developed that focus on both prevention and cessation of cigarette smoking. This intense focus has led to a significant decline in cigarette smoking. But now, use of another form of tobacco--smokeless tobacco--is gaining in popularity.^ In 1989, the National Cancer Institute funded a research study at The University of Texas M. D. Anderson Cancer Center, called Working Well, to develop, implement, and evaluate worksite health promotion programs aimed at reducing cancer risks. As part of this program, a behavioral intervention for smokeless tobacco use was developed. This dissertation evaluates the impact of that behavioral change intervention for smokeless tobacco use.^ Data collected during the Working Well program were analyzed to determine the effect of the intervention. The primary outcomes analyzed were smokeless tobacco cessation, stages of change movement, and prevalence. The secondary outcomes analyzed included the prediction of smokeless tobacco use, stage movement, and cessation. Primary outcome analyses were conducted using the worksite as the unit of analysis, while the secondary analyses were conducted using the individual as the unit of analysis.^ Approximately 20% of the male population used smokeless tobacco. Results of intervention analyses indicate that the Working Well program produced no intervention effect on any of the primary outcomes. At the final observation, the experimental worksites achieved a quit rate of 27%, while the control worksites achieved a quit rate of 26% (P = 0.78). Stage movement for the experimental worksites was 49%, while the control worksites experienced stage movement of 43% (P = 0.20). The results of the analyses on smokeless tobacco prevalence followed the same pattern. Predictors of smokeless tobacco use, cessation, and stage movement were also identified.^ Based on the results found in this study, smokeless tobacco should remain a research priority. Future research should focus on smokeless tobacco use, including the identification of the determinants of smokeless tobacco use and the development of measures and effective intervention strategies. ^

TECHNOLOGY ASSESSMENT: SMALL-VOLUME INFUSION PUMPS

"Technology assessment is a comprehensive form of policy research that examines the short- and long-term social consequences of the application or use of technology" (US Congress 1967).^ This study explored a research methodology appropriate for technology assessment (TA) within the health industry. The case studied was utilization of external Small-Volume Infusion Pumps (SVIP) at a cancer treatment and research center. Primary and secondary data were collected in three project phases. In Phase I, hospital prescription records (N = 14,979) represented SVIP adoption and utilization for the years 1982-1984. The Candidate Adoption-Use (CA-U) diffusion paradigm developed for this study was germane. Compared to classic and unorthodox curves, CA-U more accurately simulated empiric experience. The hospital SVIP 1983-1984 trends denoted assurance in prescribing chemotherapy and concomitant balloon SVIP efficacy and efficiency. Abandonment of battery pumps was predicted while exponential demand for balloon SVIP was forecast for 1985-1987. In Phase II, patients using SVIP (N = 117) were prospectively surveyed from July to October 1984; the data represented a single episode of therapy. The questionnaire and indices, specifically designed to measure the impact of SVIP, evinced face validity. Compeer group data were from pre-SVIP case reviews rather than from an inpatient sample. Statistically significant results indicated that outpatients using SVIP interacted socially more than inpatients using the alternative technology. Additionally, the hospital's education program effectively taught clients to discriminate between self care and professional SVIP services. In these contexts, there was sufficient evidence that the alternative technology restricted patients activity whereas SVIP permitted patients to function more independently and in a social lifestyle, thus adding quality to life. In Phase III, diffusion forecast and patient survey findings were combined with direct observation of clinic services to profile some economic dimensions of SVIP. These three project phases provide a foundation for executing: (1) cost effectiveness analysis of external versus internal infusors, (2) institutional resource allocation, and (3) technology deployment to epidemiology-significant communities. The models and methods tested in this research of clinical technology assessment are innovative and do assess biotechnology. ^

EVALUATION OF THE EFFECTIVENESS OF ANISOTROPIC ANALYTICAL ALGORITHM IN FLATTENED AND FLATTENING-FILTER-FREE BEAMS FOR HIGH ENERGY LUNG DOSE DELIVERY USING THE RADIOLOGICAL PHYSICS CENTER LUNG PHANTOM

The effectiveness of the Anisotropic Analytical Algorithm (AAA) implemented in the Eclipse treatment planning system (TPS) was evaluated using theRadiologicalPhysicsCenteranthropomorphic lung phantom using both flattened and flattening-filter-free high energy beams. Radiation treatment plans were developed following the Radiation Therapy Oncology Group and theRadiologicalPhysicsCenterguidelines for lung treatment using Stereotactic Radiation Body Therapy. The tumor was covered such that at least 95% of Planning Target Volume (PTV) received 100% of the prescribed dose while ensuring that normal tissue constraints were followed as well. Calculated doses were exported from the Eclipse TPS and compared with the experimental data as measured using thermoluminescence detectors (TLD) and radiochromic films that were placed inside the phantom. The results demonstrate that the AAA superposition-convolution algorithm is able to calculate SBRT treatment plans with all clinically used photon beams in the range from 6 MV to 18 MV. The measured dose distribution showed a good agreement with the calculated distribution using clinically acceptable criteria of ±5% dose or 3mm distance to agreement. These results show that in a heterogeneous environment a 3D pencil beam superposition-convolution algorithms with Monte Carlo pre-calculated scatter kernels, such as AAA, are able to reliably calculate dose, accounting for increased lateral scattering due to the loss of electronic equilibrium in low density medium. The data for high energy plans (15 MV and 18 MV) showed very good tumor coverage in contrast to findings by other investigators for less sophisticated dose calculation algorithms, which demonstrated less than expected tumor doses and generally worse tumor coverage for high energy plans compared to 6MV plans. This demonstrates that the modern superposition-convolution AAA algorithm is a significant improvement over previous algorithms and is able to calculate doses accurately for SBRT treatment plans in the highly heterogeneous environment of the thorax for both lower (≤12 MV) and higher (greater than 12 MV) beam energies.

An evaluation of the centers for Medicare & Medicaid Services' Hospital Acquired Conditions and Present on Admission Indicator Reporting program

Objective: This dissertation evaluated three aspects of the Centers for Medicare and Medicaid Services' Hospital Acquired Conditions and Present on Admission Indicator Reporting program (HACPOA program) to produce three journal articles for publication. ^ Methods: All payer admission records from state inpatient databases from Arizona, New Jersey and Washington states were analyzed for the year 2008. However some analyses required a sample of adult only Medicare patients in the first two studies. California's inpatient data (2004 – 2010) was also analyzed in the third study to examine the reporting and non-payment program elements' impact on the incidence of hospital acquired conditions. ^ Results: Majority diagnoses reported in inpatient prospective payment systems hospitals were present on admission. However, some diagnoses are still coded as "not present on admission" and "insufficient documentation to determine whether or not conditions are present on admission or not". This is important because it reveals that hospital complications still occur in hospitals. Hospital fall and trauma injuries were the most common hospital acquired conditions observed in this study. Predictors of hospital fall injuries include age, gender, number of diagnoses, number of procedures, number of chronic conditions while predictors of hospital trauma injuries include number of e-codes, number of diagnoses and the presence of chronic conditions on a patient's admission records. Finally, the implementation of the present on admission reporting requirement increased reports of certain hospital acquired conditions while the non-payment policy element in the Hospital Acquired Conditions program reduced the incidence of hospital fall and trauma injuries in particular. ^ Conclusion: The implementation of the Hospital Acquired Conditions and Present on Admission Indicator Reporting program has made the state inpatient database a more useful source of data capable of now identifying hospital complications. The reporting and nonpayment program elements in the HACPOA program have also impacted the incidence of hospital acquired conditions. ^

Evaluation of PRESAGE® dosimeters for brachytherapy sources and the 3D dosimetry and characterization of the new AgX100 125I seed model

With continuous new improvements in brachytherapy source designs and techniques, method of 3D dosimetry for treatment dose verifications would better ensure accurate patient radiotherapy treatment. This study was aimed to first evaluate the 3D dose distributions of the low-dose rate (LDR) Amersham 6711 OncoseedTM using PRESAGE® dosimeters to establish PRESAGE® as a suitable brachytherapy dosimeter. The new AgX100 125I seed model (Theragenics Corporation) was then characterized using PRESAGE® following the TG-43 protocol. PRESAGE® dosimeters are solid, polyurethane-based, 3D dosimeters doped with radiochromic leuco dyes that produce a linear optical density response to radiation dose. For this project, the radiochromic response in PRESAGE® was captured using optical-CT scanning (632 nm) and the final 3D dose matrix was reconstructed using the MATLAB software. An Amersham 6711 seed with an air-kerma strength of approximately 9 U was used to irradiate two dosimeters to 2 Gy and 11 Gy at 1 cm to evaluate dose rates in the r=1 cm to r=5 cm region. The dosimetry parameters were compared to the values published in the updated AAPM Report No. 51 (TG-43U1). An AgX100 seed with an air-kerma strength of about 6 U was used to irradiate two dosimeters to 3.6 Gy and 12.5 Gy at 1 cm. The dosimetry parameters for the AgX100 were compared to the values measured from previous Monte-Carlo and experimental studies. In general, the measured dose rate constant, anisotropy function, and radial dose function for the Amersham 6711 showed agreements better than 5% compared to consensus values in the r=1 to r=3 cm region. The dose rates and radial dose functions measured for the AgX100 agreed with the MCNPX and TLD-measured values within 3% in the r=1 to r=3 cm region. The measured anisotropy function in PRESAGE® showed relative differences of up to 9% with the MCNPX calculated values. It was determined that post-irradiation optical density change over several days was non-linear in different dose regions, and therefore the dose values in the r=4 to r=5 cm regions had higher uncertainty due to this effect. This study demonstrated that within the radial distance of 3 cm, brachytherapy dosimetry in PRESAGE® can be accurate within 5% as long as irradiation times are within 48 hours.