Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Explicit, latent and meta-criteria : types of criteria at play in professional judgement practice

This paper engages with debates about whether comprehensive prior specification of criteria and standards is sufficient for informed professional judgement. A preoccupation has emerged with the specificity and explication of criteria intended to regulate judgement. This has resulted in criteria-compliance in the use of defined standards to validate judgements and improve reliability and consistency. Compliance has become a priority, the consequence being the prominence of explicit criteria, to the lack of acknowledgement of the operation of latent and meta-criteria within judgement practice. This paper examines judgement as a process involving three categories of assessment criteria in the context of standards-referenced systems: explicit, latent and meta-criteria. These are understood to be wholly interrelated and interdependent. A conceptualisation of judgement involving the interplay of the three criteria types is presented with an exploration of how they function to focus or alter assessments of quality in judgements of achievement in English and Mathematics.

Prevalence and trends of the diabetes epidemic in South Asia : a systematic review and meta-analysis

Background Diabetes mellitus has reached epidemic proportions worldwide. South Asians are known to have an increased predisposition for diabetes which has become an important health concern in the region. We discuss the prevalence of pre-diabetes and diabetes in South Asia and explore the differential risk factors reported. Methods Prevalence data were obtained by searching the Medline® database with; ‘prediabetes’ and ‘diabetes mellitus’ (MeSH major topic) and ‘Epidemology/EP’ (MeSH subheading). Search limits were articles in English, between 01/01/1980–31/12/2011, on human adults (≥19 years). The conjunction of the above results was narrowed down with country names. Results The most recent reported prevalence of pre-diabetes:diabetes in regional countries were; Bangladesh–4.7%:8.5% (2004–2005;Rural), India–4.6%:12.5% (2007;Rural); Maldives–3.0%:3.7% (2004;National), Nepal–19.5%:9.5% (2007;Urban), Pakistan–3.0%:7.2% (2002;Rural), Sri Lanka–11.5%:10.3% (2005–2006;National). Urban populations demonstrated a higher prevalence of diabetes. An increasing trend in prevalence of diabetes was observed in urban/rural India and rural Sri Lanka. The diabetes epidemicity index decreased with the increasing prevalence of diabetes in respective countries. A high epidemicity index was seen in Sri Lanka (2005/2006–52.8%), while for other countries, the epidemicity index was comparatively low (rural India 2007–26.9%; urban India 2002/2005–31.3%, and urban Bangladesh–33.1%). Family history, urban residency, age, higher BMI, sedentary lifestyle, hypertension and waist-hip ratio were associated with an increased risks of diabetes. Conclusion A significant epidemic of diabetes is present in the South Asian region with a rapid increase in prevalence over the last two decades. Hence there is a need for urgent preventive and curative strategies .

Efficacy of oral or intrauterine device-delivered progestin in patients with complex endometrial hyperplasia with atypia or early endometrial adenocarcinoma : a meta-analysis and systematic review of the literature

Objectives: To investigate the efficacy of progestin treatment to achieve pathological complete response (pCR) in patients with complex atypical endometrial hyperplasia (CAH) or early endometrial adenocarcinoma (EC). Methods: A systematic search identified 3245 potentially relevant citations. Studies containing less than ten eligible CAH or EC patients in either oral or intrauterine treatment arm were excluded. Only information from patients receiving six or more months of treatment and not receiving other treatments was included. Weighted proportions of patients achieving pCR were calculated using R software. Results: Twelve studies met the selection criteria. Eleven studies reported treatment of patients with oral (219 patients, 117 with CAH, 102 with grade 1 Stage I EC) and one reported treatment of patients with intrauterine progestin (11 patients with grade 1 Stage IEC). Overall, 74% (95% confidence interval [CI] 65-81%) of patients with CAH and 72% (95% CI 62-80%) of patients with grade 1 Stage I EC achieved a pCR to oral progestin. Disease progression while on oral treatment was reported for 6/219 (2.7%), and relapse after initial complete response for 32/159 (20.1%) patients. The weighted mean pCR rate of patients with grade 1 Stage I EC treated with intrauterine progestin from one prospective pilot study and an unpublished retrospective case series from the Queensland Centre of Gynaecologic Oncology (QCGC) was 68% (95% CI 45- 86%). Conclusions: There is a lack of high quality evidence for the efficacy of progestin in CAH or EC. The available evidence however suggests that treatment with oral or intrauterine progestin is similarly effective. The risk of progression during treatment is small but longer follow-up is required. Evidence from prospective controlled clinical trials is warranted to establish how the efficacy of progestin for the treatment of CAH and EC can be improved further.

Subacute effects of ecstasy on mood : an exploration of associated risk factors

Ecstasy use may result in lowered mood, anxiety or aggression in the days following use. Yet, few studies have investigated what factors increase the risk of experiencing such symptoms. Ecstasy users (at least once in the last 12 months) who subsequently took ecstasy (n=35) over the next week, were compared on measures of mood, sleep, stress and drug use, with those who abstained (n=21) that week. Measures were administered the week prior to ecstasy use and 1 and 3 days following use, or the equivalent day for abstainers. Mood symptoms were assessed using the Kessler-10 self-report psychological distress scale, a subjective mood rating (1-10), and the depression, anxiety and hostility items of the clinician-rated Brief Psychiatric Rating Scale. Timeline followback methods were used to collect information on drug use and life stress in the past month. Self-reported sleep quality was also assessed. Ecstasy use was not associated with subacute depressive, anxiety or aggressive symptoms. Rather, lowered mood and increased psychological distress were associated with self-reported hours and quality of sleep obtained during the 3-day follow up. These findings highlight the importance of considering sleep disruption in understanding the short-term mood effects of ecstasy use.

Craving as a predictor of treatment outcomes in heavy drinkers with comorbid depressed mood

Alcohol and depression comorbidity is high and is associated with poorer outcomes following treatment. The ability to predict likely treatment response would be advantageous for treatment planning. Craving has been widely studied as a potential predictor, but has performed inconsistently. The effect of comorbid depression on craving's predictive performance however, has been largely neglected, despite demonstrated associations between negative affect and craving. The current study examined the performance of craving, measured pretreatment using the Obsessive subscale of the Obsessive Compulsive Drinking Scale, in predicting 18-week and 12-month post-treatment alcohol use outcomes in a sample of depressed drinkers. Data for the current study were collected during a randomized controlled trial (Baker, Kavanagh, Kay-Lambkin, Hunt, Lewin, Carr, & Connolly, 2010) comparing treatments for comorbid alcohol and depression. A subset of 260 participants from that trial with a Timeline Followback measure of alcohol consumption was analyzed. Pre-treatment craving was a significant predictor of average weekly alcohol consumption at 18 weeks and of frequency of alcohol binges at 18 weeks and 12months, but pre-treatment depressive mood was not predictive, and effects of Baseline craving were independent of depressive mood. Results suggest a greater ongoing risk from craving than from depressive mood at Baseline.

Response to “Topical agent therapy for prevention and treatment of radiodermatitis : a meta-analysis”

To the Editor; It was with interest that I read the recent article by Zhang et al. published in Supportive Care in Cancer [1]. This paper highlighted the importance of radiodermatitis (RD) being an unresolved and distressing clinical issue in patients with cancer undergoing radiation therapy. However, I am concerned with a number of clinical and methodological issues within this paper: (i) the clinical and operational definition of prophylaxis and treatment of RD; (ii) the accuracy of the identification of trials; and (iii) the appropriateness of the conduct of the meta-analyses...

A meta-analysis of genome-wide association studies to identify prostate cancer susceptibility loci associated with aggressive and non-aggressive disease

Genome-wide association studies (GWAS) have identified multiple common genetic variants associated with an increased risk of prostate cancer (PrCa), but these explain less than one-third of the heritability. To identify further susceptibility alleles, we conducted a meta-analysis of four GWAS including 5953 cases of aggressive PrCa and 11 463 controls (men without PrCa). We computed association tests for approximately 2.6 million SNPs and followed up the most significant SNPs by genotyping 49 121 samples in 29 studies through the international PRACTICAL and BPC3 consortia. We not only confirmed the association of a PrCa susceptibility locus, rs11672691 on chromosome 19, but also showed an association with aggressive PrCa [odds ratio = 1.12 (95% confidence interval 1.03-1.21), P = 1.4 × 10(-8)]. This report describes a genetic variant which is associated with aggressive PrCa, which is a type of PrCa associated with a poorer prognosis.

Nutritional support and functional capacity in chronic obstructive pulmonary disease: A systematic review and meta-analysis

Currently there is confusion about the value of using nutritional support to treat malnutrition and improve functional outcomes in chronic obstructive pulmonary disease (COPD). This systematic review and meta-analysis of randomised controlled trials (RCTs) aimed to clarify the effectiveness of nutritional support in improving functional outcomes in COPD. A systematic review identified 12 RCTs (n = 448) in stable COPD patients investigating the effects of nutritional support [dietary advice (1 RCT), oral nutritional supplements (ONS; 10 RCTs), enteral tube feeding (1 RCT)] versus control on functional outcomes. Meta-analysis of the changes induced by intervention found that whilst respiratory function (FEV(1,) lung capacity, blood gases) was unresponsive to nutritional support, both inspiratory and expiratory muscle strength (PI max +3.86 SE 1.89 cm H(2) O, P = 0.041; PE max +11.85 SE 5.54 cm H(2) O, P = 0.032) and handgrip strength (+1.35 SE 0.69 kg, P = 0.05) were significantly improved, and associated with weight gains of ≥ 2 kg. Nutritional support produced significant improvements in quality of life in some trials, although meta-analysis was not possible. It also led to improved exercise performance and enhancement of exercise rehabilitation programmes. This systematic review and meta-analysis demonstrates that nutritional support in COPD results in significant improvements in a number of clinically relevant functional outcomes, complementing a previous review showing improvements in nutritional intake and weight.

Preliminary evaluation of a primary care intervention for cry-fuss behaviours in the first 3-4 months of life (‘The Possums Approach’) : effects on cry-fuss behaviours and maternal mood

Problem crying in the first few months of life is both common and complex, arising out of multiple interacting and co-evolving factors. Parents whose babies cry and fuss a lot receive conflicting advice as they seek help from multiple health providers and emergency departments, and may be admitted into tertiary residential services. Conflicting advice is costly, and arises out of discipline-specific interpretations of evidence. An integrated, interdisciplinary primary care intervention (‘The Possums Approach’) for cry-fuss problems in the first months of life was developed from available peer-reviewed evidence. This study reports on preliminary evaluation of delivery of the intervention. A total of 20 mothers who had crying babies under 16 weeks of age (average age 6.15 weeks) completed questionnaires, including the Crying Patterns Questionnaire and the Edinburgh Postnatal Depression Scale, before and 3-4 weeks after their first consultation with trained primary care practitioners. Preliminary evaluation is promising. The Crying Patterns Questionnaire showed a significant decrease in crying and fussing duration, by 1 h in the evening (P = 0.001) and 30 min at night (P = 0.009). The median total amount of crying and fussing in a 24-h period was reduced from 6.12 to 3 h. The Edinburgh Postnatal Depression Scale showed a significant improvement in depressive symptoms, with the median score decreasing from 11 to 6 (P = 0.005). These findings are corroborated by an analysis of results for the subset of 16 participants whose babies were under 12 weeks of age (average age 4.71 weeks). These preliminary results demonstrate significantly decreased infant crying in the evening and during the night and improved maternal mood, validating an innovative interdisciplinary clinical intervention for cry-fuss problems in the first few months of life. This intervention, delivered by trained health professionals, has the potential to mitigate the costly problem of health professionals giving discipline-specific and conflicting advice post-birth.

Depression among Holocaust survivors : a meta-analytic review

The publication of the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV; American Psychiatric Association, 1994) introduced the notion that a life-threatening illness can be a stressor and catalyst for Posttraumatic Stress Disorder (PTSD). Since then a solid body of research has been established investigating the post-diagnosis experience of cancer. These studies have identified a number of short and long-term life changes resulting from a diagnosis of cancer and associated treatments. In this chapter, we discuss the psychosocial response to the cancer experience and the potential for cancer-related distress. Cancer can represent a life-threatening diagnosis that may be associated with aggressive treatments and result in physical and psychological changes. The potential for future trauma through the lasting effects of the disease and treatment, and the possibility of recurrence, can be a source of continued psychological distress. In addition to the documented adverse repercussions of cancer, we also outline the recent shift that has occurred in the psycho-oncology literature regarding positive life change or posttraumatic growth that is commonly reported after a diagnosis of cancer. Adopting a salutogenic framework acknowledges that the cancer experience is a dynamic psychosocial process with both negative and positive repercussions. Next, we describe the situational and individual factors that are associated with posttraumatic growth and the types of positive life change that are prevalent in this context. Finally, we discuss the implications of this research in a therapeutic context and the directions of future posttraumatic growth research with cancer survivors. This chapter will present both quantitative and qualitative research that indicates the potential for personal growth from adversity rather than just mere survival and return to pre-diagnosis functioning. It is important to emphasise however, that the presence of growth and prevalence of resilience does not negate the extremely distressing nature of a cancer diagnosis for the patient and their families and the suffering that can accompany treatment regimes. Indeed, it will be explained that for growth to occur, the experience must be one that quite literally shatters previously held schemas in order to act as a catalyst for change.