A comprehensive framework for evaluating funder's performance

Evaluation methods for assessing the performance of non-profit funders are lacking. The purpose of the research was to create a comprehensive framework that systematically assesses the goals and objectives of a funder, how these relate to the funder's allocation of resources, and the potential impact of programs and services selected by the funder for resource allocation to address organizational goals and objectives. The Houston Affiliate of Susan G. Komen for the Cure, a local chapter of a national breast cancer awareness advocacy organization, was selected as the funding agency whose performance assessment was to assist in the creation of this framework. Evaluation approaches from the government sector were adapted and incorporated into the research to guide the methods used to answer the three research questions corresponding to the three phases of research within the study: (1) what are the funding goals and objectives of the Affiliate?; (2) what allocation scheme does the organization use to address these goals and objectives and select programs for funding?; and, (3) to what extent do the programs funded by the Affiliate have potential long-term impact? ^ Within the first stage of the research, document reviews of the Affiliate's mission-based documents and bylaws and interviews with organizational and community informants revealed a highly latent constellation of broad objectives that were not formalized into one guiding document, thus creating gaps in management and governance. Within the second phase of the research, reviews of grant applications from the 2008-2009 funding cycle and interviews with employees and volunteers familiar with the funding process revealed competing ideas regarding resource allocation in light of vague organizational documents describing funding goals and objectives. Within the final stage of the research, these findings translated to the Affiliate selecting programs with highly varying potential long-term impact with regards to addressing goals and objectives relating to breast cancer education, screening, diagnostics, treatment, and support. The resulting performance assessment framework, consisting of three phases of research utilizing organizational documents and key informant interviews, demonstrated the importance of clearly defined funding goals and objectives, reference documents and committee participation within the funding process, and regular reviews of potential long-term impact for selected programs, all supported by the active participation and governance of a funder's Board of Directors.^

A qualitative assessment of multi-level nutrition strategies for reducing racial and ethnic disparities in diabetes

The purpose of this study is to examine the stages of program realization of the interventions that the Bronx Health REACH program initiated at various levels to improve nutrition as a means for reducing racial and ethnic disparities in diabetes. This study was based on secondary analyses of qualitative data collected through the Bronx Health REACH Nutrition Project, a project conducted under the auspices of the Institute on Urban Family Health, with support from the Centers for Disease Control and Prevention (CDC). Local human subjects' review and approval through the Institute on Urban Family Health was required and obtained in order to conduct the Bronx Health REACH Nutrition Project. ^ The study drew from two theoretical models—Glanz and colleagues' nutrition environments model and Shediac-Rizkallah and Bone's sustainability model. The specific study objectives were two-fold: (1) to categorize each nutrition activity to a specific dimension (i.e. consumer, organizational or community nutrition environment); and (2) to evaluate the stage at which the program has been realized (i.e. development, implementation or sustainability). ^ A case study approach was applied and a constant comparative method was used to analyze the data. Triangulation of data based was also conducted. Qualitative data from this study revealed the following principal findings: (1) communities of color are disproportionately experiencing numerous individual and environmental factors contributing to the disparities in diabetes; (2) multi-level strategies that targeted the individual, organizational and community nutrition environments can appropriately address these contributing factors; (3) the nutrition strategies greatly varied in their ability to appropriately meet criteria for the three program stages; and (4) those nutrition strategies most likely to succeed (a) conveyed consistent and culturally relevant messages, (b) had continued involvement from program staff and partners, (c) were able to adapt over time or setting, (d) had a program champion and a training component, (e) were integrated into partnering organizations, and (f) were perceived to be successful by program staff and partners in their efforts to create individual, organizational and community/policy change. As a result of the criteria-based assessment and qualitative findings, an ecological framework elaborating on Glanz and colleagues model was developed. The qualitative findings and the resulting ecological framework developed from this study will help public health professionals and community leaders to develop and implement sustainable multi-level nutrition strategies for addressing racial and ethnic disparities in diabetes. ^

A BAYESIAN APPROACH TO DOSE-RESPONSE ASSESSMENT AND DRUG-DRUG INTERACTION ANALYSIS: APPLICATION TO IN VITRO STUDIES

The considerable search for synergistic agents in cancer research is motivated by the therapeutic benefits achieved by combining anti-cancer agents. Synergistic agents make it possible to reduce dosage while maintaining or enhancing a desired effect. Other favorable outcomes of synergistic agents include reduction in toxicity and minimizing or delaying drug resistance. Dose-response assessment and drug-drug interaction analysis play an important part in the drug discovery process, however analysis are often poorly done. This dissertation is an effort to notably improve dose-response assessment and drug-drug interaction analysis. The most commonly used method in published analysis is the Median-Effect Principle/Combination Index method (Chou and Talalay, 1984). The Median-Effect Principle/Combination Index method leads to inefficiency by ignoring important sources of variation inherent in dose-response data and discarding data points that do not fit the Median-Effect Principle. Previous work has shown that the conventional method yields a high rate of false positives (Boik, Boik, Newman, 2008; Hennessey, Rosner, Bast, Chen, 2010) and, in some cases, low power to detect synergy. There is a great need for improving the current methodology. We developed a Bayesian framework for dose-response modeling and drug-drug interaction analysis. First, we developed a hierarchical meta-regression dose-response model that accounts for various sources of variation and uncertainty and allows one to incorporate knowledge from prior studies into the current analysis, thus offering a more efficient and reliable inference. Second, in the case that parametric dose-response models do not fit the data, we developed a practical and flexible nonparametric regression method for meta-analysis of independently repeated dose-response experiments. Third, and lastly, we developed a method, based on Loewe additivity that allows one to quantitatively assess interaction between two agents combined at a fixed dose ratio. The proposed method makes a comprehensive and honest account of uncertainty within drug interaction assessment. Extensive simulation studies show that the novel methodology improves the screening process of effective/synergistic agents and reduces the incidence of type I error. We consider an ovarian cancer cell line study that investigates the combined effect of DNA methylation inhibitors and histone deacetylation inhibitors in human ovarian cancer cell lines. The hypothesis is that the combination of DNA methylation inhibitors and histone deacetylation inhibitors will enhance antiproliferative activity in human ovarian cancer cell lines compared to treatment with each inhibitor alone. By applying the proposed Bayesian methodology, in vitro synergy was declared for DNA methylation inhibitor, 5-AZA-2'-deoxycytidine combined with one histone deacetylation inhibitor, suberoylanilide hydroxamic acid or trichostatin A in the cell lines HEY and SKOV3. This suggests potential new epigenetic therapies in cell growth inhibition of ovarian cancer cells.

Self-Assessment in a Competency-Based Curriculum: Preliminary Findings

Introduction: The introduction of the ACGME core competency framework brought challenges of developing appropriate evaluation tools (i.e. self assessment) to provide evidence of competency. Baylor College of Medicine has 43 competency goals organized within the 6 ACGME domains, each domain having 4-10 goals. [See PDF for complete abstract]

A Model for Family Preservation Case Assessment

The outcomes of family preservation practice have been researched and debated. The effectiveness of family preservation is still inconclusive and many of the findings may only be inferred to specific situations. Few studies have addressed the assessment techniques or outcome factors from a qualitative perspective. This article synthesizes current literature, research and practice, and proposes a practice framework with questioning techniques to assist practitioners in assessing the strengths and characteristics of a family, and making decisions on whether or not familybased services are appropriate for the family. Two actual cases are presented to illustrate how the worker can benefit from having the assessment data derived from this model.

The evolution and assessment of pharmaceutical care: Structure, processes, and outcomes

The evolution of pharmaceutical care is identified through a complete review of the literature published in the American Journal of Health-System Pharmacy, the sole comprehensive publication of institutional pharmacy practice. The evolution is categorized according to characteristics of structure (organizational structure, the role of the pharmacist), process (drug delivery systems, formulary management, acquiring drug products, methods to impact drug therapy decisions), and outcomes (cost of drug delivery, cost of drug acquisition and use, improved safety, improved health outcomes) recorded from the 1950s through the 1990s. While significant progress has been made in implementing basic drug distribution systems, levels of pharmacy involvement with direct patient care is still limited.^ A new practice framework suggests enhanced direct patient care involvement through increase in the efficiency and effectiveness of traditional pharmacy services. Recommendations advance internal and external organizational structure relationships that position pharmacists to fully use their unique skills and knowledge to impact drug therapy decisions and outcomes. Specific strategies facilitate expansion of the breadth and scope of each process component in order to expand the depth of integration of pharmacy and pharmaceutical care within the broad healthcare environment. Economic evaluation methods formally evaluate the impact of both operational and clinical interventions.^ Outcome measurements include specific recommendations and methods to increase efficiency of drug acquisition, emphasizing pharmacists' roles that impact physician prescribing decisions. Effectiveness measures include those that improve safety of drug distribution systems, decrease the potential of adverse drug therapy events, and demonstrate that pharmaceutical care can significantly contribute to improvement in overall health status.^ The implementation of the new framework is modeled on a case study at the M.D. Anderson Cancer Center. The implementation of several new drug distribution methods facilitated the redeployment of personnel from distributive functions to direct patient care activities with significant personnel and drug cost reduction. A cost-benefit analysis illustrates that framework process enhancements produced a benefit-to-cost ratio of 7.9. In addition, measures of effectiveness demonstrated significant levels of safety and enhanced drug therapy outcomes. ^

The application of latent variable models to the assessment of determinants of HIV risk behavior

Studies on the relationship between psychosocial determinants and HIV risk behaviors have produced little evidence to support hypotheses based on theoretical relationships. One limitation inherent in many articles in the literature is the method of measurement of the determinants and the analytic approach selected. ^ To reduce the misclassification associated with unit scaling of measures specific to internalized homonegativity, I evaluated the psychometric properties of the Reactions to Homosexuality scale in a confirmatory factor analytic framework. In addition, I assessed the measurement invariance of the scale across racial/ethnic classifications in a sample of men who have sex with men. The resulting measure contained eight items loading on three first-order factors. Invariance assessment identified metric and partial strong invariance between racial/ethnic groups in the sample. ^ Application of the updated measure to a structural model allowed for the exploration of direct and indirect effects of internalized homonegativity on unprotected anal intercourse. Pathways identified in the model show that drug and alcohol use at last sexual encounter, the number of sexual partners in the previous three months and sexual compulsivity all contribute directly to risk behavior. Internalized homonegativity reduced the likelihood of exposure to drugs, alcohol or higher numbers of partners. For men who developed compulsive sexual behavior as a coping strategy for internalized homonegativity, there was an increase in the prevalence odds of risk behavior. ^ In the final stage of the analysis, I conducted a latent profile analysis of the items in the updated Reactions to Homosexuality scale. This analysis identified five distinct profiles, which suggested that the construct was not homogeneous in samples of men who have sex with men. Lack of prior consideration of these distinct manifestations of internalized homonegativity may have contributed to the analytic difficulty in identifying a relationship between the trait and high-risk sexual practices. ^

Environmental sustainability and the human element: Decision making in National Cancer Institute-designated cancer centers and Practice Greenhealth subscribing institutions

Background. Various aspects of sustainability have taken root in the hospital environment; however, decisions to pursue sustainable practices within the framework of a master plan are not fully developed in National Cancer Institute (NCI) -designated cancer centers and subscribing institutions to the Practice Greenhealth (PGH) listserv.^ Methods. This cross sectional study was designed to identify the organizational characteristics each study group pursed to implement sustainability practices, describe the barriers they encountered and reasons behind their choices for undertaking certain sustainability practices. A web-based questionnaire was pilot tested, and then sent out to 64 NCI-designated cancer centers and 1638 subscribing institutions to the PGH listserv.^ Results. Complete responses were received from 39 NCI-designated cancer centers and 58 subscribing institutions to the PGH listserv. NCI-designated cancer centers reported greater progress in integrating sustainability criteria into design and construction projects than hospitals of institutions subscribing to the PHG listserv (p-value = <0.05). Statistically significant differences were also identified between these two study groups in undertaking work life options, conducting energy usage assessments, developing energy conservation and optimization plans, implementing solid waste and hazardous waste minimization programs, using energy efficient vehicles and reporting sustainability progress to external stakeholders. NCI-designated cancer centers were further along in implementing these programs (p-value = <0.05). In comparing the self-identified NCI-designated cancer centers to centers that indicated they were both and NCI and PGH, the later had made greater progress in using their collective buying power to pursue sustainable purchasing practices within the medical community (p-value = <0.05). In both study groups, recycling programs were well developed.^ Conclusions. Employee involvement was viewed as the most important reason for both study groups to pursue recycling initiatives and incorporated environmental criteria into purchasing decisions. A written sustainability commitment did not readily translate into a high percentage that had developed a sustainability master plan. Coordination of sustainability programs through a designated sustainability professional was not being undertaken by a large number of institutions within each study group. This may be due to the current economic downturn or management's attention to the emerging health care legislation being debated in congress. ^ Lifecycle assessments, an element of a carbon footprint, are seen as emerging areas of opportunity for health care institutions that can be used to evaluate the total lifecycle costs of products and services.^

A qualitative and quantitative assessment of cancer patients' perceptions of barriers to treatment

This study examined barriers that cancer patients experience in obtaining treatment. The principal aim of the study was to conduct a comprehensive quantitative and qualitative assessment of barriers to cancer treatment for Texas cancer patients. The three specific aims of the study were to: (1) conduct a review and critique of published and unpublished research on barriers to cancer treatment; (2) conduct focus groups for the qualitative assessment of cancer patients' perceived barriers to cancer treatment; and (3) survey a representative sample of cancer patients regarding perceived barriers to treatment. The study was guided by the Aday and Andersen access framework of predisposing, enabling, and need determinants of care-seeking.^ To address the first specific aim, a total of 732 abstracts were examined, from which 154 articles were selected for review. Of these 154 articles, 57 that related directly to research on barriers to cancer treatment were chosen for subsequent analysis. Criteria were applied to each article to evaluate the strength of the study design, sampling and measurement procedures. The major barriers that were consistently documented to influence whether or not cancer patients sought or continued required treatment included problems with communication between the patient and provider, lack of information on side effects, the cost of treatment and associated difficulties in obtaining and maintaining insurance coverage, and the absence of formal and informal networks of social support. Access barriers were generally greater for older, minority women, and patients of lower socioeconomic status.^ To address the second specific aim, a total of eight focus groups (n = 44) were conducted across the State of Texas with cancer patients identified by the Texas Community Oncology Network, American Cancer Society, and community health centers. One important finding was that cost is the greatest hurdle that patients face. Another finding was that with the health care/insurance crisis, an increasing number of physicians are working with their patients to develop individually-tailored payment plans. For people in rural areas, travel to treatment sites is a major barrier due to the travel costs as well as work time forfeited by patients and their family members. A third major finding was the patients' family and church play important roles in providing social and emotional support for cancer patients.^ To address the third aim, a total of 910 cancer patients were surveyed during October and November, 1993. Approximately 65% of the cancer patients responded to the survey. The findings showed that the major barriers to treatment included costs of medications and diagnostic tests, transportation, lack of social support, problems understanding the written information regarding their disease as well as losing coverage or having higher premiums or copayments once they were diagnosed (particularly among blacks).^ Significant differences in reported barriers were found between racial groups. The minority respondents (i.e., blacks and Hispanics) tended to experience more barriers to treatment compared to the white respondents. More specifically, Hispanics were more likely to report transportation as a barrier to treatment than both white and blacks. Future research is needed to better understand the problems that minority cancer patients experience in receiving treatment. (Abstract shortened by UMI.) ^

Academic medical centers: A framework for strategic repositioning

This study sought to understand the elements affecting the success or failure of strategic repositioning efforts by academic medical centers (AMC). The research question was: What specific elements in the process appear to be most important in determining the success or failure of an AMC.s strategic repositioning? Where success is based on the longterm sustainability of the new position.^ "An organization's strategic position is its perceptual location relative to others" (Gershon, 2003). Hence, strategic repositioning represents a shift from one strategic position within an environment to another (H. Mintzberg, 1987a). A deteriorating value proposition coupled with an unsustainable national health care financing system is forcing AMCs to change their strategic position. Where the value proposition is defined as the health outcome per dollar spent. ^ AMCs are of foundational importance to our health care system. They educate our new physicians, generate significant scientific breakthroughs, and care for our most difficult patients. Yet, their strategic, financial and business acumen leaves them particularly vulnerable in a changing environment. ^ After a literature review revealed limited writing on this subject, the research question was addressed using three separate but parallel exploratory case study inquiries of AMCs that recently underwent a strategic repositioning. Participating in the case studies were the Baylor College of Medicine, the University of Texas M. D. Anderson Cancer Center, and the University of Texas Medical Branch.^ Each case study consisted of two major research segments; a thorough documentation review followed by semi-structured interviews of selected members of their governance board, executive and faculty leadership teams. While each case study.s circumstances varied, their response to the research question, as extracted through thematic coding and analysis of the interviews, had a high degree of commonality.^ The results identified managing the strategic risk surrounding the repositioning and leadership accountability as the two foundational elements of success or failure. Metrics and communication were important process elements. They both play a major role in managing the strategic repositioning risk communication loop. Sustainability, the final element, was the outcome sought.^ Factors leading to strategic repositioning included both internal and external pressures and were primarily financial or mission based. Timing was an important consideration as was the selection of the strategic repositioning endpoint.^ In conclusion, a framework for the strategic repositioning of AMCs was offered that integrates the findings of this study; the elements of success, the factors leading to strategic repositioning, and the risk communication loop. ^