Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a study protocol

BACKGROUND The Cochrane risk of bias (RoB) tool has been widely embraced by the systematic review community, but several studies have reported that its reliability is low. We aim to investigate whether training of raters, including objective and standardized instructions on how to assess risk of bias, can improve the reliability of this tool. We describe the methods that will be used in this investigation and present an intensive standardized training package for risk of bias assessment that could be used by contributors to the Cochrane Collaboration and other reviewers. METHODS/DESIGN This is a pilot study. We will first perform a systematic literature review to identify randomized clinical trials (RCTs) that will be used for risk of bias assessment. Using the identified RCTs, we will then do a randomized experiment, where raters will be allocated to two different training schemes: minimal training and intensive standardized training. We will calculate the chance-corrected weighted Kappa with 95% confidence intervals to quantify within- and between-group Kappa agreement for each of the domains of the risk of bias tool. To calculate between-group Kappa agreement, we will use risk of bias assessments from pairs of raters after resolution of disagreements. Between-group Kappa agreement will quantify the agreement between the risk of bias assessment of raters in the training groups and the risk of bias assessment of experienced raters. To compare agreement of raters under different training conditions, we will calculate differences between Kappa values with 95% confidence intervals. DISCUSSION This study will investigate whether the reliability of the risk of bias tool can be improved by training raters using standardized instructions for risk of bias assessment. One group of inexperienced raters will receive intensive training on risk of bias assessment and the other will receive minimal training. By including a control group with minimal training, we will attempt to mimic what many review authors commonly have to do, that is-conduct risk of bias assessment in RCTs without much formal training or standardized instructions. If our results indicate that an intense standardized training does improve the reliability of the RoB tool, our study is likely to help improve the quality of risk of bias assessments, which is a central component of evidence synthesis.

Quality of polyunsaturated fatty acids in Nile tilapias (Oreochromis niloticus) fed with vitamin E supplementation

Freshwater fish are an important source of protein, but they also contain other highly nutritive components such as fats. Polyunsaturated fatty acids (PUFAs) are essential for normal growth, development and reproduction of vertebrates. The antioxidant role of vitamin E in cell membranes prevents fatty acid and cholesterol oxidation, thereby promoting PUFA and subcellular particle stabilization. The effects of vitamin E supplementation on the quality of Nile tilapia (Oreochromis niloticus) carcass were investigated. The experiments were carried out in an experimental laboratory over 106 d. After sex reversal, 400 early juvenile O. niloticus were tested in a completely randomized experiment with 5 treatments (4 repetitions each), consisting of vitamin E monophosphate supplementation at 0, 50, 100, 150 or 200 mg/kg of a base diet. Treatment diets contained equal amounts of protein and energy. Tilapias supplemented with vitamin E contained arachidonic acid (20:4 omega-6; AA) which participates in inflammatory response. Nile tilapia carcasses that received vitamin E at 100 and 150 mg/kg diet had improved carcass quality by increasing the PUFA:SFA ratio and had the highest levels of polyunsaturated fatty acids from the omega-3 (linolenic acid; 18:3 omega-3) and omega-6 (linoleic acid; 18:2 omega-6) series. (C) 2012 Elsevier Ltd. All rights reserved.

Impacto del Programa de Alimentación Escolar en el Trabajo Infantil: Una aproximación desde la toma de decisiones familiares

Esta investigación analiza el impacto del Programa de Alimentación Escolar en el trabajo infantil en Colombia a través de varias técnicas de evaluación de impacto que incluyen emparejamiento simple, emparejamiento genético y emparejamiento con reducción de sesgo. En particular, se encuentra que este programa disminuye la probabilidad de que los escolares trabajen alrededor de un 4%. Además, se explora que el trabajo infantil se reduce gracias a que el programa aumenta la seguridad alimentaria, lo que consecuentemente cambia las decisiones de los hogares y anula la carga laboral en los infantes. Son numerosos los avances en primera infancia llevados a cabo por el Estado, sin embargo, estos resultados sirven de base para construir un marco conceptual en el que se deben rescatar y promover las políticas públicas alimentarias en toda la edad escolar.

Promoting rule compliance in daily-life: Evidence from a randomized field experiment in the public libraries of Barcelona

We study how to promote compliance with rules in everyday situations. Having access to unique data on the universe of users of all public libraries inBarcelona, we test the effect of sending email messages with dierent contents.We find that users return their items earlier if asked to do so in a simple email.Emails reminding users of the penalties associated with late returns are more effective than emails with only a generic reminder. We find differential treatmenteffects by user types. The characteristics we analyze are previous compliance,gender, age, and nationality.

Psychological pressure in competitive environments: Evidence from a randomized natural experiment

Much like cognitive abilities, emotional skills can have major effects on performance and economic outcomes. This paper studies the behavior of professionalsubjects involved in a dynamic competition in their own natural environment. Thesetting is a penalty shoot-out in soccer where two teams compete in a tournamentframework taking turns in a sequence of five penalty kicks each. As the kicking order is determined by the random outcome of a coin flip, the treatment and control groups are determined via explicit randomization. Therefore, absent any psychological effects, both teams should have the same probability of winning regardless of the kicking order. Yet, we find a systematic first-kicker advantage. Using data on 2,731 penalty kicks from 262 shoot-outs for a three decade period, we find that teams kicking first win the penalty shoot-out 60.5% of the time. A dynamic panel data analysis shows that the psychological mechanism underlying this result arises from the asymmetry in the partial score. As most kicks are scored, kicking first typically means having the opportunity to lead in the partial score, whereas kicking second typically means lagging in the score and having the opportunity to, at most, get even. Having a worse prospect than the opponent hinders subjects' performance.Further, we also find that professionals are self-aware of their own psychological effects. When a recent change in regulations gives winners of the coin toss the chance to choose the kicking order, they rationally react to it by systematically choosing to kick first. A survey of professional players reveals that when asked to explain why they prefer to kick first, they precisely identify the psychological mechanism for which we find empirical support in the data: they want to lead in the score inorder to put pressure on the opponent.

Creative credits:a randomized controlled industrial policy experiment

This report examines the results of a pilot study, which used a method of evaluation called randomised control trials (RCTs) to see if a popular business support scheme called Creative Credits worked effectively. The pilot study, which began in Manchester in 2009, was structured so that vouchers, or 'Creative Credits', would be randomly allocated to small and medium-sized businesses applying to invest in creative projects such as developing websites, video production and creative marketing campaigns, to see if they had a real effect on innovation. The research found that the firms who were awarded Creative Credits enjoyed a short-term boost in their innovation and sales growth in the six months following completion of their creative projects. However, the positive effects were not sustained, and after 12 months there was no longer a statistically significant difference between the groups that received the credits and those that didn’t. The report argues that these results would have remained hidden using the normal evaluation methods used by government, and calls for RCTs to be used more widely when evaluating policies to support business growth.

Effects of isoflavone-supplemented soy yogurt on lipid parameters and atherosclerosis development in hypercholesterolemic rabbits: a randomized double-blind study

Background: There is increasing interest in natural treatments to control dyslipidemia and reduce the risk of cardiovascular disease. Previous studies have demonstrated the beneficial effects of soy yogurt fermented with Enterococcus faecium CRL 183 and of dietary isoflavones on the lipid profile. The purpose of the present study was to investigate the effects of isoflavone-supplemented soy yogurt, fermented with E. faecium CRL183, on lipid parameters and atherosclerosis development in rabbits with induced hypercholesterolemia. Methods: Forty-eight rabbits were randomly assigned to eight groups fed on the following diets for 60 days: C - control; IY - isoflavone-supplemented soy yogurt; H - hypercholesterolemic (1.0% cholesterol wt/wt diet); HY - hypercholesterolemic plus soy yogurt; HIY - hypercholesterolemic plus isoflavone-supplemented soy yogurt; HP - hypercholesterolemic plus placebo; HI hypercholesterolemic plus isoflavone and HE - hypercholesterolemic plus pure culture of E. faecium CRL 183. Serum lipids and autoantibodies against oxLDL (oxLDL Ab) were analyzed on days 0, 30 and 60 of the treatment and the atherosclerotic lesions were quantified at the end of the experiment. Results: Soy yogurt, soy yogurt supplemented with isoflavones and placebo promoted significant reductions in total cholesterol level (38.1%, 27.0% and 26.6%, respectively). Significant increases in serum HDL-C concentration relative to group H were detected in animals that ingested soy yogurt, with or without the isoflavone supplement (55.2%), E. faecium culture (43.3%) or placebo (35.8%). Intake of soy yogurt and soy yogurt supplemented with isoflavones prevented the rise of oxLDL Ab during the study period. The extent of atherosclerosis in the thoracic and abdominal aortas was reduced in the HIY, HY and HP groups. However, when the whole aorta was analyzed, animals treated with soy yogurt supplemented with isoflavones exhibited the greatest reduction (51.4%, P < 0.05) in atherosclerotic lesion area, compared to group H. Conclusion: Soy yogurt could be consumed as an alternative means of reducing the risk of cardiovascular disease by improving the lipid profile and inhibiting oxLDL Ab formation. Our findings also suggest that isoflavone supplementation may enhance the antiatherosclerotic effect of soy yogurt.

Introducing Mobile Money in Rural Mozambique: Evidence from a Field Experiment*

The limitations of access to finance in Africa, together with the recent boom in cell phone use in that continent, created high expectations regarding the introduction of mobile money in many African countries. The success story of M-PESA in Kenya raised the bar further. We designed and conducted a field experiment to assess the impact of randomized mobile money dissemination in rural Mozambique. For this purpose we benefit from the fact that mobile money was only recently launched in the country, allowing for the identification of a pure control group. This paper reports on the first results of this ongoing project after the first wave of dissemination efforts in rural locations, which included the recruitment and training of mobile money agents, community meetings and theaters, as well as individual rural campaigning. Administrative and behavioral data both show clear adherence to the services in the treatment group. Financial literacy and trust outcomes are also positively affected by the treatment. We present behavioral evidence that the marginal willingness to remit was increased by the availability of mobile money. Finally, we observe a tendency for mobile money to substitute traditional alternatives for both savings and remittances.

Vitamin A Deficiency and Training to Farmers: Evidence from a Field Experiment in Mozambique

Vitamin A deficiency is a widespread public health problem in Sub-Saharan Africa. This paper analyzes the impact of a food-based intervention to fight vitamin A deficiency using orange-fleshed sweet potato (OFSP). We conducted a randomized evaluation of OFSP-related training to female farmers in Mozambique, in which the treatment group was taught basic concepts of nutrition, and OFSP-planting and cooking skills. We found encouraging evidence of changes in behavior and attitudes towards OFSP consumption and planting, and considerable increases in nutrition-related knowledge, as well as knowledge on cooking and planting OFSP.

Migrant Remittances and Information Flows: Evidence from a Field Experiment*

Do information flows matter for remittance behavior? We design and implement a randomized control trial to quantitatively assess the role of communication between migrants and their contacts abroad on the extent and value of remittance flows. In the experiment, a random sample of 1,500 migrants residing in Ireland was offered the possibility of contacting their networks outside the host country for free over a varying number of months. We find a sizable, positive impact of our intervention on the value of migrant remittances sent. Our results exclude that the remittance effect we identify is a simple substitution effect. Instead, our analysis points to this effect being a likely result of improved information via factors such as better migrant control over remittance use, enhanced trust in remittance channels due to experience sharing, or increased remittance recipients’ social pressure on migrants.

Vitamin A deficiency and training to farmers: Evidence from a field experiment in Mozambique

A Work Project, presented as part of the requirements for the Award of a Masters Degree in Economics from the NOVA – School of Business and Economics

Audit risk and rent extraction: Evidence from a randomized evaluation in Brazil

We report results from a randomized policy experiment designed to test whether increasedaudit risk deters rent extraction in local public procurement and service delivery in Brazil. Ourestimates suggest that temporarily increasing annual audit risk by about 20 percentage pointsreduced the proportion of irregular local procurement processes by about 17 percentage points.This reduction was driven entirely by irregularities involving mismanagement or corruption. Incontrast, we find no evidence that increased audit risk affected the quality of publicly providedpreventive and primary health care services -measured based on user satisfaction surveys- orcompliance with national regulations of the conditional cash transfer program "Bolsa Família".

Effect of albumin dialysis on intracranial pressure increase in pigs with acute liver failure: a randomized study.

BACKGROUND: Increased intracranial pressure (ICP) worsens the outcome of acute liver failure (ALF). This study investigates the underlying pathophysiological mechanisms and evaluates the therapeutic effect of albumin dialysis in ALF with use of the Molecular Adsorbents Recirculating System without hemofiltration/dialysis (modified, M-MARS). METHODS: Pigs were randomized into three groups: sham, ALF, and ALF + M-MARS. ALF was induced by hepatic devascularization (time = 0). M-MARS began at time = 2 and ended with the experiment at time = 6. ICP, arterial ammonia, brain water, cerebral blood flow (CBF), and plasma inflammatory markers were measured. RESULTS: ICP and arterial ammonia increased significantly over 6 hrs in the ALF group, in comparison with the sham group. M-MARS attenuated (did not normalize) the increased ICP in the ALF group, whereas arterial ammonia was unaltered by M-MARS. Brain water in the frontal cortex (grey matter) and in the subcortical white matter at 6 hrs was significantly higher in the ALF group than in the sham group. M-MARS prevented a rise in water content, but only in white matter. CBF and inflammatory mediators remained unchanged in all groups. CONCLUSION: The initial development of cerebral edema and increased ICP occurs independently of CBF changes in this noninflammatory model of ALF. Factor(s) other than or in addition to hyperammonemia are important, however, and may be more amenable to alteration by albumin dialysis.

Effects of isoflavone-supplemented soy yogurt on lipid parameters and atherosclerosis development in hypercholesterolemic rabbits: a randomized double-blind study

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)