A comprehensive framework for evaluating funder's performance

Evaluation methods for assessing the performance of non-profit funders are lacking. The purpose of the research was to create a comprehensive framework that systematically assesses the goals and objectives of a funder, how these relate to the funder's allocation of resources, and the potential impact of programs and services selected by the funder for resource allocation to address organizational goals and objectives. The Houston Affiliate of Susan G. Komen for the Cure, a local chapter of a national breast cancer awareness advocacy organization, was selected as the funding agency whose performance assessment was to assist in the creation of this framework. Evaluation approaches from the government sector were adapted and incorporated into the research to guide the methods used to answer the three research questions corresponding to the three phases of research within the study: (1) what are the funding goals and objectives of the Affiliate?; (2) what allocation scheme does the organization use to address these goals and objectives and select programs for funding?; and, (3) to what extent do the programs funded by the Affiliate have potential long-term impact? ^ Within the first stage of the research, document reviews of the Affiliate's mission-based documents and bylaws and interviews with organizational and community informants revealed a highly latent constellation of broad objectives that were not formalized into one guiding document, thus creating gaps in management and governance. Within the second phase of the research, reviews of grant applications from the 2008-2009 funding cycle and interviews with employees and volunteers familiar with the funding process revealed competing ideas regarding resource allocation in light of vague organizational documents describing funding goals and objectives. Within the final stage of the research, these findings translated to the Affiliate selecting programs with highly varying potential long-term impact with regards to addressing goals and objectives relating to breast cancer education, screening, diagnostics, treatment, and support. The resulting performance assessment framework, consisting of three phases of research utilizing organizational documents and key informant interviews, demonstrated the importance of clearly defined funding goals and objectives, reference documents and committee participation within the funding process, and regular reviews of potential long-term impact for selected programs, all supported by the active participation and governance of a funder's Board of Directors.^

Whence a healthy mind: Correlation of physical fitness and academic performance among schoolchildren

Background. Public schools are a key forum in the fight for child health because of the opportunities they present for physical activity and fitness surveillance. However, because schools are evaluated and funded on the basis of standardized academic performance rather than physical activity, empirical research evaluating the connections between fitness and academic performance is needed to justify curriculum allocations to physical activity. ^ Methods. Analyses were based on a convenience sample of 315,092 individually-matched standardized academic (TAKS™) and fitness (FITNESSGRAM®) test records collected by 13 Texas school districts under state mandates. We categorized each fitness result in quintiles by age and gender and used a mixed effects regression model to compare the academic performance of the top and bottom fitness groups for each fitness test and grade level combination. ^ Results. All fitness variables except BMI showed significant, positive associations with academic performance after sociodemographic covariate adjustments, with effect sizes ranging from 0.07 (95% CI: 0.05,0.08) in girls trunklift-TAKS reading to 0.34 (0.32,0.35) in boys cardiovascular-TAKS math. Cardiovascular fitness showed the largest inter-quintile difference in TAKS score (32-75 points), followed by curl-ups. After an additional adjustment for BMI and curl-ups, cardiovascular associations peaked in 8th-9 th grades (maximum inter-quintile difference 142 TAKS points; effect size 0.75 (0.69,0.82) for 8th grade girls math) and showed dose-response characteristics across quintiles (p<0.001 for both genders and outcomes). BMI analysis demonstrated limited, non-linear association with academic performance after adjustment for sociodemographic, cardiovascular fitness and curl-up variables. Low-BMI Hispanic high school boys showed significantly lower TAKS scores than the moderate (but not high) BMI group. High-BMI non-Hispanic white high school girls showed significantly lower scores than the moderate (but not low) BMI group. ^ Conclusions. In this study, fitness was strongly and significantly related to academic performance. Cardiovascular fitness showed a distinct dose-response association with academic performance independent of other sociodemographic and fitness variables. The association peaked in late middle to early high school. The independent association of BMI to academic performance was only found in two sub-groups and was non-linear, with both low and high BMI posing risk relative to moderate BMI but not to each other. In light of our findings, we recommend that policymakers consider PE mandates in middle-high school and require linkage of academic and fitness records to facilitate longitudinal surveillance. School administrators should consider increasing PE time in pursuit of higher academic test scores, and PE practitioners should emphasize cardiovascular fitness over BMI reduction.^

The performance of interferon-gamma release assays in tuberculosis patients with type II diabetes

The sensitivity of Interferon-γ release assays for detection of Mycobacterium tuberculosis (MTB) infection or disease is affected by conditions that depress host immunity (such as HIV). It is critical to determine whether these assays are affected by diabetes and related conditions (i.e. hyperglycemia, chronic hyperglycemia, or being overweight/obese) given that immune impairment is thought to underline susceptibility to tuberculosis (TB) in people with diabetes. This is important for tuberculosis control due to the millions of type 2 diabetes patients at risk for tuberculosis worldwide.^ The objective of this study was to identify host characteristics, including diabetes, that may affect the sensitivity of two commercially available Interferon-γ (IFN-γ) release assays (IGRA), the QuantiFERON®-TB Gold (QFT-G) and the T-SPOT®.TB in active TB patients. We further explored whether IFN-γ secretion in response to MTB antigens (ESAT-6 and CFP-10) is associated with diabetes and its defining characteristics (high blood glucose, high HbA1c, high BMI). To achieve these objectives, the sensitivity of QFT-G and T-SPOT. TB assays were evaluated in newly diagnosed, tuberculosis confirmed (by positive smear for acid fast bacilli and/or positive culture for MTB) adults enrolled at Texas and Mexico study sites between March 2006 and April 2009. Univariate and multivariate models were constructed to identify host characteristics associated with IGRA result and level of IFN-γ secretion.^ QFT-G was positive in 68% of tuberculosis patients. Those with diabetes, chronic hyperglycemia or obesity were more likely to have a positive QFT-G result, and to secrete higher levels of IFN-γ in response to the mycobacterial antigens (p<0.05). Previous history of BCG vaccination was the only other host characteristic associated with QFT-G result, whereby a higher proportion of non-BCG vaccinated persons were QFT-G positive, in comparison to vaccinated persons. In a separate group of patients, the T-SPOT.TB was 94% sensitive, with similar performance in all tuberculosis patients, regardless of host characteristics.^ In summary, we have demonstrated the validity of QFT-G and T-SPOT. TB to support the diagnosis of TB in patients with a range of host characteristics, but most notably in patients with diabetes. We also confirmed that TB patients with diabetes and associated characteristics (chronic hyperglycemia or BMI) secreted higher titers of IFN-γ when stimulated with MTB specific antigens, in comparison to patients without these characteristics. Together, these findings suggest that the mechanism by which diabetes increases risk to TB may not be explained by the inability to secrete IFN-γ, a key cytokine for TB control.^

Performance recovery from exercise: A review from a statistical point of view

Background. Research into methods for recovery from fatigue due to exercise is a popular topic among sport medicine, kinesiology and physical therapy. However, both the quantity and quality of studies and a clear solution of recovery are lacking. An analysis of the statistical methods in the existing literature of performance recovery can enhance the quality of research and provide some guidance for future studies. Methods: A literature review was performed using SCOPUS, SPORTDiscus, MEDLINE, CINAHL, Cochrane Library and Science Citation Index Expanded databases to extract the studies related to performance recovery from exercise of human beings. Original studies and their statistical analysis for recovery methods including Active Recovery, Cryotherapy/Contrast Therapy, Massage Therapy, Diet/Ergogenics, and Rehydration were examined. Results: The review produces a Research Design and Statistical Method Analysis Summary. Conclusion: Research design and statistical methods can be improved by using the guideline from the Research Design and Statistical Method Analysis Summary. This summary table lists the potential issues and suggested solutions, such as, sample size calculation, sports specific and research design issues consideration, population and measure markers selection, statistical methods for different analytical requirements, equality of variance and normality of data, post hoc analyses and effect size calculation.^

Performance tiers: Implementing comparative effectiveness analysis in the health care setting through operations research and spatial methods

This dissertation develops and tests a comparative effectiveness methodology utilizing a novel approach to the application of Data Envelopment Analysis (DEA) in health studies. The concept of performance tiers (PerT) is introduced as terminology to express a relative risk class for individuals within a peer group and the PerT calculation is implemented with operations research (DEA) and spatial algorithms. The analysis results in the discrimination of the individual data observations into a relative risk classification by the DEA-PerT methodology. The performance of two distance measures, kNN (k-nearest neighbor) and Mahalanobis, was subsequently tested to classify new entrants into the appropriate tier. The methods were applied to subject data for the 14 year old cohort in the Project HeartBeat! study.^ The concepts presented herein represent a paradigm shift in the potential for public health applications to identify and respond to individual health status. The resultant classification scheme provides descriptive, and potentially prescriptive, guidance to assess and implement treatments and strategies to improve the delivery and performance of health systems. ^

HEALTH MAINTENANCE ORGANIZATION ENVIRONMENT: AN EMPIRICAL STUDY OF THE RELATIONSHIP OF EXTERNAL CONTEXT AND PERFORMANCE

The research project is an extension of a series of administrative science and health care research projects evaluating the influence of external context, organizational strategy, and organizational structure upon organizational success or performance. The research will rely on the assumption that there is not one single best approach to the management of organizations (the contingency theory). As organizational effectiveness is dependent on an appropriate mix of factors, organizations may be equally effective based on differing combinations of factors. The external context of the organization is expected to influence internal organizational strategy and structure and in turn the internal measures affect performance (discriminant theory). The research considers the relationship of external context and organization performance.^ The unit of study for the research will be the health maintenance organization (HMO); an organization the accepts in exchange for a fixed, advance capitation payment, contractual responsibility to assure the delivery of a stated range of health sevices to a voluntary enrolled population. With the current Federal resurgence of interest in the Health Maintenance Organization (HMO) as a major component in the health care system, attention must be directed at maximizing development of HMOs from the limited resources available. Increased skills are needed in both Federal and private evaluation of HMO feasibility in order to prevent resource investment and in projects that will fail while concurrently identifying potentially successful projects that will not be considered using current standards.^ The research considers 192 factors measuring contextual milieu (social, educational, economic, legal, demographic, health and technological factors). Through intercorrelation and principle components data reduction techniques this was reduced to 12 variables. Two measures of HMO performance were identified, they are (1) HMO status (operational or defunct), and (2) a principle components factor score considering eight measures of performance. The relationship between HMO context and performance was analysed using correlation and stepwise multiple regression methods. In each case it has been concluded that the external contextual variables are not predictive of success or failure of study Health Maintenance Organizations. This suggests that performance of an HMO may rely on internal organizational factors. These findings have policy implications as contextual measures are used as a major determinant in HMO feasibility analysis, and as a factor in the allocation of limited Federal funds. ^

THE RELATIONSHIP BETWEEN ATTITUDE ASSESSMENT/ROLE PERCEPTION AND THE FINANCIAL PERFORMANCE OF HOSPITAL DEPARTMENT MANAGERS

Much of the current healthcare financial literature addresses the concern of government officials, the public, and healthcare providers regarding the need for control of health care costs. The literature suggests that attitudes of hospital department managers toward their role in financial management affects their ability to effect favorable financial results.^ There were several objectives of the dissertation: (1) To identify whether or not there exists a relationship between the attitude/role perception of hospital managers and the financial performance of their departments. (2) To compile a descriptive survey data base of key factors identified in the financial literature from individual hospitals. (3) To compile a brief descriptive survey of hospital managers' financial management background and training (both formal and informal). (4) To conduct an attitude assessment/role perception survey regarding the importance or relevance of a suggested financial management role set (i.e., issues discussed in the current literature) as viewed by the selected hospital managers and their matched administrators. (5) To propose plausible theoretical models and statistical tests of seven proposed hypotheses.^ The statistical results of a variety of methods generally suggested, for the sample population, that the null hypothesis should not be rejected concerning the relationships between a department manager's financial attitudes and role perceptions and the resultant financial performance.^ The fact that the results of this study did not suggest that there was a significant relationship which existed between role perception and financial performance does not necessarily indicate that the theories supporting such a relationship in literature are false, not that such a relationship does not exist. Several alternative theories were postulated to explain the apparent lack of statistical relationship, and suggestions for refinement and/or improvement of further research were discussed. ^

REPRODUCTIVE PERFORMANCE IN THE DES-EXPOSED DAUGHTERS

This research examined the relation between prenatal exposure to diethylstilbestrol (DES) and subsequent reproductive performance in females. Although previous studies have agreed that unfavorable pregnancy outcomes (spontaneous abortions, stillbirths, ectopic pregnancies, and premature births) occur with greater frequency in the exposed as compared to unexposed women, the role of exposure to DES in-utero on subsequent fertility (pregnancy achievement) remains controversial. Also, the possibility that the reproductive dysfunction reported in exposed women might be due to familial predisposition to reproductive dysfunction rather than to DES exposure has not been examined heretofore.^ The purposes of the research were to: (1) measure the overall differences in rates of live births between exposed and unexposed women; (2) determine if infertility or early unrecognized spontaneous miscarriages (as opposed to recognized fetal death) contributes to poor reproductive performance in the exposed; and (3) determine if constitutional predisposition contributes to poor reproductive performance in exposed daughters.^ The study population comprised those participants in the National Cooperative Diethylstilbestrol Adenosis (DESAD) Project who were identified through review of prenatal records. Birth interval curves (survival analyses) were used to compare the reproductive performance of exposed daughters and unexposed women. Birth interval curves were also constructed for unexposed siblings (of exposed participants) and unexposed nonsiblings to determine the role of constitutional predisposition in the reproductive performance of exposed daughters.^ The DES-daughters, as compared to unexposed women, were found to be at a reproductive disadvantage when the overall differences in rates of live births were compared.^ When the differences in rates of live births due specifically to infertility or early unrecognized spontaneous miscarriages (as opposed to recognized fetal death) were examined, the exposed maintained the reproductive disadvantage. This analysis was suggestive but not statistically significant for the first-birth-interval and was neither suggestive nor significant in the second-birth-interval. (Abstract shortened with permission of author.) ^

An assessment of the relative influence of a vapor recovery system in reducing occupational exposure to volatile organic compounds in high performance liquid chromatography

Occupational exposures to organic solvents, specifically acetonitrile and methanol, have the potential to cause serious long-term health effects. In the laboratory, these solvents are used extensively in protocols involving the use of high performance liquid chromatography (HPLC). Operators of HPLC equipment may be potentially exposed to these organic solvents when local exhaust ventilation is not employed properly or is not available, which can be the case in many settings. The objective of this research was to characterize the various sites of vapor release in the HPLC process and then to determine the relative influence of a novel vapor recovery system on the overall exposure to laboratory personnel. The effectiveness of steps to reduce environmental solvent vapor concentrations was assessed by measuring exposure levels of acetonitrile and methanol before and after installation of the vapor recovery system. With respect to acetonitrile, the concentration was not statistically significant with p=0.938; moreover, exposure after the intervention was actually higher than prior to intervention. With respect to methanol, the concentration was not statistically significant with p=0.278. This indicates that the exposure to methanol after the intervention was not statistically significantly higher or lower than prior to intervention. Thus, installation of the vapor recovery device did not result in statistically significant reduction in exposures in the settings encountered, and acetonitrile actually increased significantly.^

Differences in performance for quality of care indicators for acute myocardial infarction (AMI) across various hospital categories in Texas

The study analyzed Hospital Compare data for Medicare Fee-for-service patients at least 65 years of age to determine whether hospital performance for AMI outcome and processes of care measures differ amongst Texas hospitals with respect to ownership status (for profit vs. not-for-profit), academic status (teaching vs. non-teaching) and geographical setting (rural vs. urban). ^ The study found a statistically significant difference between for-profit and not-for-profit hospitals in four process-of-care measures (aspirin at discharge, P=0.028; ACE or ARB inhibitor for LSVD, P=0.048; Smoking cessation advice: P=0.034; outpatients who got aspirin with 24 hours of arrival in the ED, P=0.044). No significant difference in performance was found between COTH-member teaching and non-teaching hospitals for any of the eight process-of-care measures or the two outcome measures for AMI. The study was unable to compare performance based on geographic setting of hospitals due to lack of sufficient data for rural hospitals. ^ The results of the study suggest that for-profit Texas hospitals might be slightly better than not-for –profit hospitals at providing possible heart attack patients with certain processes of care.^

Territorial quality and sustainable development : Indicators of performance in the context of a model for participatory rural tourism certification

El turismo rural ha sido incorporado por pequeños establecimientos agropecuarios del partido de Cnel. Suárez, provincia de Buenos Aires, Argentina, como actividad alternativa para mejorar la calidad de vida de sus miembros y superar situaciones de crisis agravadas por la marginalidad productiva del SO bonaerense, región a la que pertenecen. Bajo el programa Cambio Rural del INTA (Instituto Nacional de Tecnología Agropecuaria) conforman el Grupo 'Cortaderas II', junto a otros emprendedores interesados en valorar el medio rural. Han avanzado en el proceso de reconocimiento de su identidad y puesta en valor de recursos específicos con anclaje en el territorio. Esta identidad comienza a apreciarse internamente, a raíz de la dinámica grupal lograda y la incipiente articulación con otros actores para la construcción de un partenariado público y privado que genere sinergias y contribuya al desarrollo sustentable del territorio. Sin embargo, aún no es claramente percibida por el turista, cada vez más exigente. Por lo tanto, el presente trabajo persigue proponer indicadores para evaluar el desempeño de un Sistema de Gestión de Calidad con enfoque territorial que, adaptando el modelo europeo 'Marca de Calidad Territorial', sustente una estrategia comercial de diferenciación del servicio y simultáneamente, mida el progreso hacia una mejor calidad de vida y fortalecimiento de vínculos con la cultura local y el entorno físico-natural en el marco del desarrollo sustentable. La investigación se plantea para la micro escala, ya que se trata de un estudio de caso, relevándose información primaria mediante observación directa y entrevistas semi-estructuradas, complementada con información secundaria diagnóstica utilizada por INTA. Las características del grupo y su dinámica de funcionamiento bajo el programa Cambio Rural revelan que es posible adoptar un proceso de certificación participativa propuesto para cuatro pilares de la calidad: de Bienes y Servicios, Institucional, Social y Ambiental. El modelo se integra con indicadores de evaluación de desempeño, agrupados en áreas clave para cada una de las dimensiones de la sustentabilidad, que contemplan el paisaje y la gestión de los recursos naturales; el impacto económico de la actividad, la calidad de la oferta y satisfacción del turista; así como las relaciones sociales internas y los vínculos con otros actores del territorio. Principalmente se encontraron fortalezas en la búsqueda de partenariados y debilidades en aspectos de comunicación y promoción. Se considera que este sistema de herramientas de gestión sustentable permitiría superar las dificultades de una certificación individual, pudiendo aplicarse a emprendimientos con otra ubicación geográfica