A framework for developing evaluation capacity in health care settings.

The purpose of this paper is to provide a framework for developing an effective evaluation practice within health care settings. Three features are reviewed; capacity building, the application of evaluation to program activities and the utilization of evaluation recommendations. First, the organizational elements required to establish effective evaluation practice are reviewed emphasizing that an organization's capacity for evaluation develops over time and in stages. Second, a comprehensive evaluation framework is presented which demonstrates how evaluation practice can be applied to all aspects of a program's life cycle, thus promoting the scope of evidence-based decision making within an organization. Finally, factors which influence the adoption of evaluation recommendations by decision makers are reviewed accompanied by strategies to promote the utilization of evaluation recommendations in organization decision making.

Understanding the collaborative experience between researchers and health care practitioners:Implications for gerontological nursing practice

The health care field is a new arena for collaborative research carried out by practitioner-researcher teams. Although the current literature discusses factors supportive of such teams, most evidence is anecdotal or descriptive of pilot projects. In this article, the authors use survey and interview data to document health care practitioners' views on collaborative research with an experienced researcher/ mentor. Topics covered include a description of the research project and process, positive and negative aspects of doing research, expectations, recommendations to colleagues starting research, and desirable characteristics in practitioners and researchers on collaborative research teams. Of all attributes mentioned, personal traits and skills were among the most frequently mentioned for both practitioners and researchers, followed by research knowledge and attitudes for practitioners, and teaching skills for researchers. The article also addresses factors important to the success of collaborative research: how to develop a project, characteristics of collaborative team members, team functioning, and institutional support. Copyright © 2000 Taylor & Francis.

A comparison of self-report and health care provider data to assess surveillance definitions of influenza-like illness in outpatients

Objective: Several surveillance definitions of influenza-like illness (ILI) have been proposed, based on the presence of symptoms. Symptom data can be obtained from patients, medical records, or both. Past research has found that agreements between health record data and self-report are variable depending on the specific symptom. Therefore, we aimed to explore the implications of using data on influenza symptoms extracted from medical records, similar data collected prospectively from outpatients, and the combined data from both sources as predictors of laboratory-confirmed influenza. Methods: Using data from the Hutterite Influenza Prevention Study, we calculated: 1) the sensitivity, specificity and predictive values of individual symptoms within surveillance definitions; 2) how frequently surveillance definitions correlated to laboratory-confirmed influenza; and 3) the predictive value of surveillance definitions. Results: Of the 176 participants with reports from participants and medical records, 142 (81%) were tested for influenza and 37 (26%) were PCR positive for influenza. Fever (alone) and fever combined with cough and/or sore throat were highly correlated with being PCR positive for influenza for all data sources. ILI surveillance definitions, based on symptom data from medical records only or from both medical records and self-report, were better predictors of laboratory-confirmed influenza with higher odds ratios and positive predictive values. Discussion: The choice of data source to determine ILI will depend on the patient population, outcome of interest, availability of data source, and use for clinical decision making, research, or surveillance. © Canadian Public Health Association, 2012.

Resource utilisation and costs of palliative cancer care in an interdisciplinary health care model

This paper presents a detailed description of health care resource utilisation and costs of a pilot interdisciplinary health care model of palliative home care in Ontario, Canada. The descriptive evaluation entailed examining the use of services and costs of the pilot program: patient demographics, length of stay broken down by disposition (discharged, alive, death), access to services/resources, use of family physician and specialist services, and drug use. There were 434 patients included in the pilot program. Total costs were approximately CAN$2.4 million, and the cost per person amounted to approximately CAN$5586.33 with average length of stay equal to over 2 months (64.22 days). One may assume that length of stay would be influenced by the amount of service and support available. Future research might investigate whether in-home palliative home care is the most cost effective and suitable care setting for those patients requiring home care services for expected periods of time. © 2009 SAGE Publications.

Health care needs of community-dwelling older adults

Objective. To identify, assess, and rank the importance of health care needs of community-dwelling older adults. Method. A structured telephone interview with 107 respondents (physicians, direct service providers and administrators) about the importance of a list of 31 health care needs of older adults. Respondents also identified the single most important health issue facing local older adults now and in the next 5 to 10 years. Results. The five most important health care needs, in descending order, are: care-giver support services, community long-term care services services for people with demential/Alzheimer's disease, palliative/end-of-life care, and services for cancer patients and their families. Community long-term care services were identified as the single most important health issue both now and in the next 5 to 10 years. Conclusion. The study findings should be of value to health and social service researchers, planners, providers and administrators regarding the needs of community-dwelling older adults.

Late-stage, primary open-angle glaucoma in Europe:Social and health care maintenance costs and quality of life of patients from 4 countries

Objective: The purpose of this study was to estimate costs and quality of life (QoL) of late-stage glaucoma patients in 4 European countries. Methods: Retrospective review of medical charts of patients with POAG who were followed in a low-vision or vision rehabilitation center in one of 4 countries for at least 1 year was used to determine patient characteristics, health status, and health care resource use. Visual impairment was measured by best-corrected visual acuity (Snellen score). Patients were also interviewed over the telephone in order to assess their health-related QoL (using EuroQol EQ-5D) and use of resources including: the number of visits to rehabilitation centers, visits to hospital and non-hospital specialists, the use of low-vision devices, medication, tests, and the use of hired home help. The costs associated with resource use were calculated from the perspective of a third-party payer of health and social care based on resource usage and unit costs in each country. Results: Patients undergoing visual rehabilitation in France (n=21), Denmark (n=59), Germany (n=60), and the United Kingdom (n=22) were identified, interviewed and had their medical charts reviewed. Annual maintenance costs of late-stage glaucoma amounted to €830 (±445) on average. Average home help costs were more than 3 times higher. QoL, on average, was 0.65 (±0.28). QoL was positively correlated with the level of visual acuity in the patients' best eye. On the other hand, visual acuity was also positively correlated to health care costs, but negatively correlated to costs of home help. Conclusions: The study was limited by its observational, uncontrolled design. The finding that late-stage glaucoma is associated with higher home help costs than health care maintenance costs suggests that potential savings from a better preventive treatment are to be found for social care payers rather than health care payers. © 2008 Informa UK Ltd All rights reserved.

The effects of new topical treatments on management of glaucoma in Scotland:An examination of ophthalmological health care

Background: The management of glaucoma has been changed in the past decade by the introduction of new drugs. The impact of these changes on clinical care of patients was examined by examining operation and prescribing rates for glaucoma in four geographical areas of Scotland for the years 1994 to 1999. Methods: A retrospective analysis of national health statistics: primary care prescribing data, hospital derived operation rates, consultant numbers, optometrist numbers, and eye test data, expressed by estimated population at risk of glaucoma. The outcome measures were prescribing volume and cost for glaucoma medications, and operation rates, corrected for population estimated to be at risk of glaucoma (PEG), for trabeculectomy, for Scotland as a whole, and for four geographical "regions" (north east, south east, central, and south west Scotland). Results: Prescribed items per 1000 population estimated to have glaucoma (PEG) increased by 24.9% between 1994 and 1999. This was above the general increase in prescribing in Scotland (17.8%). This increase varied in the four health regions evaluated (14.3% to 31.9%). Prescribing of topical ß blockers increased little (6.4%), but there was a large increase in the use of new products (topical prostaglandins, carbonic anhydrase inhibitors, and a agonists), at the expense of miotics (47.7% fall), and older sympathomimetics. This change in prescribing pattern was accompanied by a 61.5% increase in cost (range 42.2% to 73.4% in the four regions). New drugs accounted for more than half of total glaucoma expenditure in 1999. Operation rates (corrected for PEG) fell by 45.9% (range 43.1 to 58.6%) between 1994 and 1999. Other indicators suggested increased activity in ophthalmic areas (for example, cataract operations, eye tests, numbers of optometrists and ophthalmic surgeons all increased). Within north east Scotland operation rates decreased and prescribing increased less than in other regions, both from lowest regional baseline in 1994. Conclusions: The introduction of new drug classes has had dramatic effects on the prescribing of glaucoma treatments. There has been a decline in older treatments and an increase in new agents, which has been associated with a large reduction in operation rates for glaucoma in Scotland over 6 years. Comparison of prescribing and operation data indicates regional differences in healthcare delivery for glaucoma.

What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews

Background

An evidence-based approach to health care is recognized internationally as a key competency for healthcare practitioners. This overview systematically evaluated and organized evidence from systematic reviews on teaching evidence-based health care (EBHC).

Methods/Findings

We searched for systematic reviews evaluating interventions for teaching EBHC to health professionals compared to no intervention or different strategies. Outcomes covered EBHC knowledge, skills, attitudes, practices and health outcomes. Comprehensive searches were conducted in April 2013. Two reviewers independently selected eligible reviews, extracted data and evaluated methodological quality. We included 16 systematic reviews, published between 1993 and 2013. There was considerable overlap across reviews. We found that 171 source studies included in the reviews related to 81 separate studies, of which 37 are in more than one review. Studies used various methodologies to evaluate educational interventions of varying content, format and duration in undergraduates, interns, residents and practicing health professionals. The evidence in the reviews showed that multifaceted, clinically integrated interventions, with assessment, led to improvements in knowledge, skills and attitudes. Interventions improved critical appraisal skills and integration of results into decisions, and improved knowledge, skills, attitudes and behaviour amongst practicing health professionals. Considering single interventions, EBHC knowledge and attitude were similar for lecture-based versus online teaching. Journal clubs appeared to increase clinical epidemiology and biostatistics knowledge and reading behavior, but not appraisal skills. EBHC courses improved appraisal skills and knowledge. Amongst practicing health professionals, interactive online courses with guided critical appraisal showed significant increase in knowledge and appraisal skills. A short workshop using problem-based approaches, compared to no intervention, increased knowledge but not appraisal skills.

Conclusions

EBHC teaching and learning strategies should focus on implementing multifaceted, clinically integrated approaches with assessment. Future rigorous research should evaluate minimum components for multifaceted interventions, assessment of medium to long-term outcomes, and implementation of these interventions.