Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

Explicit, latent and meta-criteria : types of criteria at play in professional judgement practice

This paper engages with debates about whether comprehensive prior specification of criteria and standards is sufficient for informed professional judgement. A preoccupation has emerged with the specificity and explication of criteria intended to regulate judgement. This has resulted in criteria-compliance in the use of defined standards to validate judgements and improve reliability and consistency. Compliance has become a priority, the consequence being the prominence of explicit criteria, to the lack of acknowledgement of the operation of latent and meta-criteria within judgement practice. This paper examines judgement as a process involving three categories of assessment criteria in the context of standards-referenced systems: explicit, latent and meta-criteria. These are understood to be wholly interrelated and interdependent. A conceptualisation of judgement involving the interplay of the three criteria types is presented with an exploration of how they function to focus or alter assessments of quality in judgements of achievement in English and Mathematics.

A hybrid approach to combining CART and logistic regression for stock ranking

The benefits of applying tree-based methods to the purpose of modelling financial assets as opposed to linear factor analysis are increasingly being understood by market practitioners. Tree-based models such as CART (classification and regression trees) are particularly well suited to analysing stock market data which is noisy and often contains non-linear relationships and high-order interactions. CART was originally developed in the 1980s by medical researchers disheartened by the stringent assumptions applied by traditional regression analysis (Brieman et al. [1984]). In the intervening years, CART has been successfully applied to many areas of finance such as the classification of financial distress of firms (see Frydman, Altman and Kao [1985]), asset allocation (see Sorensen, Mezrich and Miller [1996]), equity style timing (see Kao and Shumaker [1999]) and stock selection (see Sorensen, Miller and Ooi [2000])...

Quantile regression without the curse of unsmoothness

We consider quantile regression models and investigate the induced smoothing method for obtaining the covariance matrix of the regression parameter estimates. We show that the difference between the smoothed and unsmoothed estimating functions in quantile regression is negligible. The detailed and simple computational algorithms for calculating the asymptotic covariance are provided. Intensive simulation studies indicate that the proposed method performs very well. We also illustrate the algorithm by analyzing the rainfall–runoff data from Murray Upland, Australia.

Prevalence and trends of the diabetes epidemic in South Asia : a systematic review and meta-analysis

Background Diabetes mellitus has reached epidemic proportions worldwide. South Asians are known to have an increased predisposition for diabetes which has become an important health concern in the region. We discuss the prevalence of pre-diabetes and diabetes in South Asia and explore the differential risk factors reported. Methods Prevalence data were obtained by searching the Medline® database with; ‘prediabetes’ and ‘diabetes mellitus’ (MeSH major topic) and ‘Epidemology/EP’ (MeSH subheading). Search limits were articles in English, between 01/01/1980–31/12/2011, on human adults (≥19 years). The conjunction of the above results was narrowed down with country names. Results The most recent reported prevalence of pre-diabetes:diabetes in regional countries were; Bangladesh–4.7%:8.5% (2004–2005;Rural), India–4.6%:12.5% (2007;Rural); Maldives–3.0%:3.7% (2004;National), Nepal–19.5%:9.5% (2007;Urban), Pakistan–3.0%:7.2% (2002;Rural), Sri Lanka–11.5%:10.3% (2005–2006;National). Urban populations demonstrated a higher prevalence of diabetes. An increasing trend in prevalence of diabetes was observed in urban/rural India and rural Sri Lanka. The diabetes epidemicity index decreased with the increasing prevalence of diabetes in respective countries. A high epidemicity index was seen in Sri Lanka (2005/2006–52.8%), while for other countries, the epidemicity index was comparatively low (rural India 2007–26.9%; urban India 2002/2005–31.3%, and urban Bangladesh–33.1%). Family history, urban residency, age, higher BMI, sedentary lifestyle, hypertension and waist-hip ratio were associated with an increased risks of diabetes. Conclusion A significant epidemic of diabetes is present in the South Asian region with a rapid increase in prevalence over the last two decades. Hence there is a need for urgent preventive and curative strategies .

Therapeutic immunisation of rabbits with cottontail rabbit papillomavirus (CRPV) virus-like particles (VLP) induces regression of established papillomas

There is overwhelming evidence that persistent infection with high-risk human papillomaviruses (HR-HPV) is the main risk factor for invasive cancer of the cervix. Due to this global public health burden, two prophylactic HPV L1 virus-like particles (VLP) vaccines have been developed. While these vaccines have demonstrated excellent type-specific prevention of infection by the homologous vaccine types (high and low risk HPV types), no data have been reported on the therapeutic effects in people already infected with the low-risk HPV type. In this study we explored whether regression of CRPV-induced papillomas could be achieved following immunisation of out-bred New Zealand White rabbits with CRPV VLPs. Rabbits immunised with CRPV VLPs had papillomas that were significantly smaller compared to the negative control rabbit group (P ≤ 0.05). This data demonstrates the therapeutic potential of PV VLPs in a well-understood animal model with potential important implications for human therapeutic vaccination for low-risk HPVs. © 2008 Govan et al; licensee BioMed Central Ltd.

Efficacy of oral or intrauterine device-delivered progestin in patients with complex endometrial hyperplasia with atypia or early endometrial adenocarcinoma : a meta-analysis and systematic review of the literature

Objectives: To investigate the efficacy of progestin treatment to achieve pathological complete response (pCR) in patients with complex atypical endometrial hyperplasia (CAH) or early endometrial adenocarcinoma (EC). Methods: A systematic search identified 3245 potentially relevant citations. Studies containing less than ten eligible CAH or EC patients in either oral or intrauterine treatment arm were excluded. Only information from patients receiving six or more months of treatment and not receiving other treatments was included. Weighted proportions of patients achieving pCR were calculated using R software. Results: Twelve studies met the selection criteria. Eleven studies reported treatment of patients with oral (219 patients, 117 with CAH, 102 with grade 1 Stage I EC) and one reported treatment of patients with intrauterine progestin (11 patients with grade 1 Stage IEC). Overall, 74% (95% confidence interval [CI] 65-81%) of patients with CAH and 72% (95% CI 62-80%) of patients with grade 1 Stage I EC achieved a pCR to oral progestin. Disease progression while on oral treatment was reported for 6/219 (2.7%), and relapse after initial complete response for 32/159 (20.1%) patients. The weighted mean pCR rate of patients with grade 1 Stage I EC treated with intrauterine progestin from one prospective pilot study and an unpublished retrospective case series from the Queensland Centre of Gynaecologic Oncology (QCGC) was 68% (95% CI 45- 86%). Conclusions: There is a lack of high quality evidence for the efficacy of progestin in CAH or EC. The available evidence however suggests that treatment with oral or intrauterine progestin is similarly effective. The risk of progression during treatment is small but longer follow-up is required. Evidence from prospective controlled clinical trials is warranted to establish how the efficacy of progestin for the treatment of CAH and EC can be improved further.

Response to “Topical agent therapy for prevention and treatment of radiodermatitis : a meta-analysis”

To the Editor; It was with interest that I read the recent article by Zhang et al. published in Supportive Care in Cancer [1]. This paper highlighted the importance of radiodermatitis (RD) being an unresolved and distressing clinical issue in patients with cancer undergoing radiation therapy. However, I am concerned with a number of clinical and methodological issues within this paper: (i) the clinical and operational definition of prophylaxis and treatment of RD; (ii) the accuracy of the identification of trials; and (iii) the appropriateness of the conduct of the meta-analyses...