Food Values Pilot Programme Evaluation - Summary Report

Food Values is a short programme showing how to get better nutritional value for money when shopping for food.

El uso de los precios de cuenta en la evaluación de programas = The use of shadow prices in programme evaluation

Incluye Bibliografía

The use of shadow prices in programme evaluation

Includes bibliography

Policy and programme evaluation in the English-speaking Caribbean: conceptual and practical issues

Includes bibliography

Virtual Mobility and Learning for PhD students of six European Countries: students’ programme evaluation

In this paper, the authors, as teachers of the Virtual Mobility and Learning ERASMUS Intensive Programme (VML–IP), put forward an analysis of the student’s final evaluation of the Programme as to the most important competences they have developed. In terms of methodology, this study has an exploratory and descriptive nature; hence, being based on empiric evidence. Thus, in the last face-to-face session, students were asked by the Programme’s coordination to present an overall evaluation of their experience in the VML–IP. Data were collected in loco, i.e. through the posters created by each group, as well as the video of the students’ oral presentations. They were later analysed using content analysis as data analysis technique. The results unveil that, although the main goal was fulfilled – i.e. to be able to design and implement a course on a ‘Virtual Mobility and Learning’ topic underpinned by solid theoretical background in the area –, the fact is that every group also pointed out several soft competences as a very important part of their experiences, and crucial for their development as students and future professionals.

Evaluation of the Heart of Birmingham teaching Primary Care Trust (HoBtPCT): My Choice Weight Management Programme:report commissioned by Heart of Birmingham teaching Primary Care Trust

This report details an evaluation of the My Choice Weight Management Programme undertaken by a research team from the School of Pharmacy at Aston University. The My Choice Weight Management Programme is delivered through community pharmacies and general practitioners (GPs) contracted to provide services by the Heart of Birmingham teaching Primary Care Trust. It is designed to support individuals who are ‘ready to change’ by enabling the individual to work with a trained healthcare worker (for example, a healthcare assistant, practice nurse or pharmacy assistant) to develop a care plan designed to enable the individual to lose 5-10% of their current weight. The Programme aims to reduce adult obesity levels; improve access to overweight and obesity management services in primary care; improve diet and nutrition; promote healthy weight and increased levels of physical activity in overweight or obese patients; and support patients to make lifestyle changes to enable them to lose weight. The Programme is available for obese patients over 18 years old who have a Body Mass Index (BMI) greater than 30 kg/m2 (greater than 25 kg/m2 in Asian patients) or greater than 28 kg/m2 (greater than 23.5 kg/m2 in Asian patients) in patients with co-morbidities (diabetes, high blood pressure, cardiovascular disease). Each participant attends weekly consultations over a twelve session period (the final iteration of these weekly sessions is referred to as ‘session twelve’ in this report). They are then offered up to three follow up appointments for up to six months at two monthly intervals (the final of these follow ups, taking place at approximately nine months post recruitment, is referred to as ‘session fifteen’ in this report). A review of the literature highlights the dearth of published research on the effectiveness of primary care- or community-based weight management interventions. This report may help to address this knowledge deficit. A total of 451 individuals were recruited on to the My Choice Weight Management Programme. More participants were recruited at GP surgeries (n=268) than at community pharmacies (n=183). In total, 204 participants (GP n=102; pharmacy n=102) attended session twelve and 82 participants (GP n=22; pharmacy 60) attended session fifteen. The unique demographic characteristics of My Choice Weight Management Programme participants – participants were recruited from areas with high levels of socioeconomic deprivation and over four-fifths of participants were from Black and Minority Ethnic groups; populations which are traditionally underserved by healthcare interventions – make the achievements of the Programme particularly notable. The mean weight loss at session 12 was 3.8 kg (equivalent to a reduction of 4.0% of initial weight) among GP surgery participants and 2.4 kg (2.8%) among pharmacy participants. At session 15 mean weight loss was 2.3 kg (2.2%) among GP surgery participants and 3.4 kg (4.0%) among pharmacy participants. The My Choice Weight Management Programme improved the general health status of participants between recruitment and session twelve as measured by the validated SF-12 questionnaire. While cost data is presented in this report, it is unclear which provider type delivered the Programme more cost-effectively. Attendance rates on the Programme were consistently better among pharmacy participants than among GP participants. The opinions of programme participants (both those who attended regularly and those who failed to attend as expected) and programme providers were explored via semi-structured interviews and, in the case of the participants, a selfcompletion postal questionnaire. These data suggest that the Programme was almost uniformly popular with both the deliverers of the Programme and participants on the Programme with 83% of questionnaire respondents indicating that they would be happy to recommend the Programme to other people looking to lose weight. Our recommendations, based on the evidence provided in this report, include: a. Any consideration of an extension to the study also giving comparable consideration to an extension of the Programme evaluation. The feasibility of assigning participants to a pharmacy provider or a GP provider via a central allocation system should also be examined. This would address imbalances in participant recruitment levels between provider type and allow for more accurate comparison of the effectiveness in the delivery of the Programme between GP surgeries and community pharmacies by increasing the homogeneity of participants at each type of site and increasing the number of Programme participants overall. b. Widespread dissemination of the findings from this review of the My Choice Weight Management Project should be undertaken through a variety of channels. c. Consideration of the inclusion of the following key aspects of the My Choice Weight Management Project in any extension to the Programme: i. The provision of training to staff in GP surgeries and community pharmacies responsible for delivery of the Programme prior to patient recruitment. ii. Maintaining the level of healthcare staff input to the Programme. iii. The regular schedule of appointments with Programme participants. iv. The provision of an increased variety of printed material. d. A simplification of the data collection method used by the Programme commissioners at the individual Programme delivery sites.

The role of economic evaluation in mental health care

Objective: A consequence of the integration of psychiatry into acute and public health medicine is that psychiatrists are being asked to evaluate their services. There is pressure on mental health-care systems because it is recognized that funds should be directed where they can provide the best health outcomes, and also because there are resource constraints which limit our capacity to meet all demands for health care. This pressure can be responded to by evaluation which demonstrates the effectiveness and efficiency of psychiatric treatment. This paper seeks to remind psychiatrists of the fundamental principles of economic evaluation in the hope that these will enable psychiatrists to understand the methods used in evaluation and to work comfortably with evaluators. Method: The paper reviews the basic principles behind economic evaluation, illustrating these with reference to case studies. It describes: (i) the cost of the burden of illness and treatment, and how these costs are measured; (ii) the measurement of treatment outcomes, both as changes in health status and as resources saved; and (iii) the various types of economic evaluation, including cost-minimization, cost-effectiveness, cost-utility and cost-benefit analysis. Results: The advice in the paper provides psychiatrists with the necessary background to work closely with evaluators. A checklist of the critical questions to be addressed is provided as a guide for those undertaking economic evaluations. Conclusions: If psychiatrists are willing to learn the basic principles of economic evaluation and to apply these, they can respond to the challenges of evaluation.

Evaluation of quality improvement for cesarean sections caesarean section programmes through mixed methods.

BACKGROUND The rate of avoidable caesarean sections (CS) could be reduced through multifaceted strategies focusing on the involvement of health professionals and compliance with clinical practice guidelines (CPGs). Quality improvements for CS (QICS) programmes (QICS) based on this approach, have been implemented in Canada and Spain. OBJECTIVES Their objectives are as follows: 1) Toto identify clusters in each setting with similar results in terms of cost-consequences, 2) Toto investigate whether demographic, clinical or context characteristics can distinguish these clusters, and 3) Toto explore the implementation of QICS in the 2 regions, in order to identify factors that have been facilitators in changing practices and reducing the use of obstetric intervention, as well as the challenges faced by hospitals in implementing the recommendations. METHODS Descriptive study with a quantitative and qualitative approach. 1) Cluster analysis at patient level with data from 16 hospitals in Quebec (Canada) (n = 105,348) and 15 hospitals in Andalusia (Spain) (n = 64,760). The outcome measures are CS and costs. For the cost, we will consider the intervention, delivery and complications in mother and baby, from the hospital perspective. Cluster analysis will be used to identify participants with similar patterns of CS and costs based, and t tests will be used to evaluate if the clusters differed in terms of characteristics: Hospital level (academic status of hospital, level of care, supply and demand factors), patient level (mother age, parity, gestational age, previous CS, previous pathology, presentation of the baby, baby birth weight). 2) Analysis of in-depth interviews with obstetricians and midwives in hospitals where the QICS were implemented, to explore the differences in delivery-related practices, and the importance of the different constructs for positive or negative adherence to CPGs. Dimensions: political/management level, hospital level, health professionals, mothers and their birth partner. DISCUSSION This work sets out a new approach for programme evaluation, using different techniques to make it possible to take into account the specific context where the programmes were implemented.

La formation linguistique des professionnels en administration à l'université : ce que nous apprennent les évaluations de programme

Cette recherche avait pour objectif d’analyser les évaluations de programmes d’études en langues de spécialité de 1er cycle universitaire afin de dégager les enjeux et la pertinence de ces formations. Trois questions de recherche sont poursuivies : • Quels établissements d’enseignement supérieur canadiens offrent des programmes d’études professionnalisant intégrant des compétences langagières sur objectifs spécifiques et le savoir-faire professionnel? • Compte tenu de la nature et de la fonction des programmes et des cours de langues de spécialité au sein des établissements d’enseignement supérieur, - quels sont les enjeux principaux ? - quelles sont les recommandations les plus fréquentes dans les rapports des évaluateurs externes ? L’analyse révèle que les enjeux principaux sont l’apport des formations aux besoins d’emploi ; la correspondance aux besoins des bénéficiaires ; l’évaluation systématique et justifiée lors de la prise de décisions ; la révision, mise à jour et évaluation systématique des programmes ; la collaboration interdisciplinaire et interuniversitaire ; l’enseignement des compétences langagières de la discipline professionnelle sous-jacente ; l’enseignement de la perspective interculturelle ; l’objectif constitutif ou instrumental de l’acquisition des langues ; la professionnalisation de la discipline au lieu de la fonction « service » ; la promotion de programmes, de collaborations et d’échanges internationaux ; l’intégration des TIC ; et la certification en langue de spécialité. Les évaluateurs externes recommandent la modernisation et la réorganisation des cours, la mise sur pied des collaborations, l’amélioration des formules et de l’offre des échanges internationaux, l’élaboration des stratégies pour étudier et planifier le lancement des initiatives, la promotion des bénéfices des connaissances langagières auprès des autres disciplines et facultés, la création des stratégies de révision de programme, et la mise en place des dispositifs pour profiter de nouvelles ressources technologiques. Ainsi, dans un premier temps, les résultats permettent d’apporter à la didactique des langues un éclairage sur la valeur de la fonction formative des mécanismes d’évaluation de programme. Dans un deuxième temps, ils apportent aux praticiens un éclairage sur la qualité, la pertinence et les enjeux des formations en langue de spécialité et un éclairage sur l’importance et l’impact des pratiques évaluatives sur les décisions prises.

An Educational international partnership responding to local needs: Process evaluation of the Brazil FAIMER Regional Institute

The Brazilian public health system requires competent professionals sensitive to the needs of the population. The Foundation for Advancement of International Medical Education and Research (FAIMER) provides a two-year faculty development programme for health professions educators, aiming to build leadership in education to improve health. A partnership with governmental initiatives and FAIMER was established for meeting these needs. This paper describes the initial process evaluation results of the Brazilian FAIMER Institute Fellowship (FAIMER BR). Methods: Data were analysed for the classes 2007-2010 regarding: application processes; innovation project themes; retrospective post-pre self-ratings of knowledge acquisition; and professional development portfolios. Results: Seventeen of 26 Brazilian states were represented among 98 Fellows, predominantly from public medical schools (75.5%) and schools awarded Ministry of Health grants to align education with public health services (89.8%). One-third (n = 32) of Fellows' innovation projects were related to these grants. Significant increases occurred in all topic subscales on self-report of knowledge acquisition (eff ect sizes, 1.21-2.77). In the follow up questionnaire, 63% of Fellows reported that their projects were incorporated into the curriculum or institutional policies. The majority reported that the programme deepened their knowledge (98%), provided new ideas about medical education (90%) and provided skills for conflict management (63%). One-half of the Fellows reported sustained benefits from the programme listserv and other communications, including breadth of expertise, establishment of research collaboration and receiving emotional support. Conclusion: Contributors to initial programme success included alignment of curriculum with governmental initiatives, curriculum design merging educational technology, leadership and management skills and central role of an innovation educational project responding to local needs.