A Randomized Controlled Trial Evaluation of Time to Read, a Volunteer Tutoring Program for 8-9 Year Olds

Tutoring is commonly employed to prevent early reading failure, and evidence suggests that it can have a positive effect. This article presents findings from a large-scale (n = 734) randomized controlled trial evaluation of the effect of Time to Read—a volunteer tutoring program aimed at children aged 8 to 9 years—on reading comprehension, self-esteem, locus of control, enjoyment of learning, and future aspirations. The study found that the program had only a relatively small effect on children’s aspirations (effect size +0.17, 95% confidence interval [0.015, 0.328]) and no other outcomes. It is suggested that this lack of evidence found may be due to misspecification of the program logic model and outcomes identified and program-related factors, particularly the low dosage of the program.

Peer tutoring in reading: The effects of role and organization on two dimensions of self-esteem

Background. Paired reading (PR) is an application of peer tutoring. It has been extensively researched, and its efficacy across a range of outcomes has been established. Benefits include improvements in key reading skills, and also in affective aspects of learning. Several studies have shown gains in self-esteem, although measurement methods have varied, and the model of self-esteem has rarely been clearly articulated.
Aims. To investigate the changes in self-esteem of children participating in a randomized trial of PR over a 15-week treatment period. To investigate the relative contribution of self-worth and self-competence to any gains in self-esteem. To investigate whether the pattern of change differs in children who take on different roles in the PR process.
Participants. The participants comprised a subset of a large-scale randomized trial of peer learning (The Fife Peer Learning Project). Four schools were randomly selected from schools allocated to the same-age PR condition, and four schools from those allocated to the cross-age PR condition. The same-age group consisted of 87 primary 6 children (10–11 years old). The cross-age group consisted of 81 primary 6 children. The controls, from schools randomly selected from a neighbouring authority, consisted of 92 primary 6 children.
Method. A pre–post design employing self-report measures of self-esteem. Rosenberg’s Self-Esteem Scale was used, with scores analysed for worth and competence. The treatment period was 15 weeks, with the participants following a prescribed PR process.
Results. Significant pre–post gains were noted in self-esteem, driven predominantly by improved beliefs about competence, in both same-age and cross-age conditions, but not for controls. Gains were also seen in self-worth in the cross-age condition. Further analyses of the influence of organizational condition (same-age or cross-age) and role played (tutor vs. tutee) showed significant differences between same-age tutors and cross-age tutors in relation to self-worth. Effect sizes were generally small or moderate.
Conclusions. The findings provide further support for the belief that PR can enhance self-esteem. Importantly, the use of a two-dimensional model provides extra information about self-perceptions in PR contexts: first, the central role of self- competence; and second, the gains in self-worth which are associated with tutoring younger children (but not same-age peers). This new information has educational significance for schools considering the potential of peer tutoring and the benefits of different organizational conditions.

Improving the educational achievement of young people in out-of-home care

A strong link between research and practice is essential to ensure
that the best available evidence gets into the hands of child welfare
practitioners, who are faced with the daunting task of making decisions
about vulnerable children on a daily basis. In 2007, a group of
senior child welfare leaders in the province of Ontario (Canada) created
a research dissemination model that replicated the worldrenowned
UK program, Research in Practice (http://www.rip.org.
uk). Practice and Research Together (PART; www.partontario.org) is
an Ontario consortium of 45 child welfare organizations whose mandate
is to disseminate research to its member agencies, which include
85% of the local child welfare organizations in the province. Each
member pays an annual membership-fee that is based on its size
(Dill & Shera, 2011). A key factor in PART's success has been its ability
to link its program offerings (i.e., webinars, literature reviews, conferences,
and publications) to issues of real-world relevance to child
welfare practitioners and senior leaders. A central and highly anticipated
program offering is PART's annual conference (learning
event). These conferences bring evidence to bear on practice in priority
areas in child welfare.
On May 31 and June 1 and 2, 2011, PART, in collaboration with the
Centre for Research on Educational and Community Services (CRECS)
at the University of Ottawa, co-hosted an international conference in
Ottawa that was focused on improving the educational achievement
of young people in out-of-home care (hereafter, in care). Speakers
from five countries – Canada, USA, Germany, Sweden, and UK – presented
the results of their research at the conference. The speakers
addressed three main topic areas: the disadvantaged socio-political
status of young people in care, many of whom do not complete secondary
or post-secondary education; innovative interventions to improve
their educational outcomes; and the effectiveness of tutoring,
which is the most common educational intervention for young people
in care.

Outcomes and process in reading tutoring

Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers.Purpose: A two-year study of peer tutoring in reading was undertaken in one local education authority in Scotland. The relative effectiveness of cross-age versus same-age tutoring, light versus intensive intervention, and reading versus reading and mathematics tutoring were investigated.Programme description (if relevant): The intervention was Paired Reading, a freely available cross-ability tutoring method applied to books of the pupils' choice but above the tutee's independent readability level. It involves Reading Together and Reading Alone, and switching from one to the other according to need.Sample: Eighty-seven primary schools of overall average socio-economic status, ability and gender in one council in Scotland. There were few ethnic minority students. Proportions of students with special needs were low. Children were eight and 10 years old as the intervention started. Macro-evaluation n = 3520. Micro-evaluation Year 1 15 schools n = 592, Year 2 a different 15 schools n = 591, compared with a comparison group of five schools n = 240.Design and methods: Almost all the primary schools in the local authority participated and were randomly allocated to condition. A macro-evaluation tested and retested over a two-year period using Performance Indicators in Primary Schools. A micro-evaluation tested and retested within each year using norm-referenced tests of reading comprehension. Macro-evaluation was with multi-level modelling, micro-evaluation with descriptive statistics and effect sizes, analysis of variance (ANOVA) and multivariate analysis of variance (MANOVA).Results: Macro-evaluation yielded significant pre-post gains in reading attainment for cross-age tutoring over both years. No other differences were significant. Micro-evaluation yielded pre-post changes in Year 1 (selected) and Year 2 (random) greater than controls, with no difference between same-age and cross-age tutoring. Light and intensive tutoring were equally effective. Tutoring reading and mathematics together was more effective than only tutoring reading. Lower socio-economic and lower reading ability students did better. Girls did better than boys. Regarding observed implementation quality, some factors were high and others low. Few implementation variables correlated with attainment gain.Conclusions: Paired Reading tutoring does lead to better reading attainment compared with students not participating. This is true in the long term (macro-evaluation) for cross-age tutoring, and in the short term (micro-evaluation) for both cross-age and same-age tutoring. Tutors and tutees benefited. Intensity had no effect but dual tutoring did have an effect. Low-socio-economic status, low-ability and female students did better. The results of the different forms of evaluation were indeed different. There are implications for practice and for future research. © 2012 Copyright Taylor and Francis Group, LLC.

Meta-analysis of the influence of experimental design on effect size in peer tutoring outcomes in elementary, middle and high school settings.

A meta-analysis was undertaken on a form of cooperative learning, peer tutoring. The effects of experimental design on outcomes were explored, as measured by Effect Size (ES). 185 studies were included in the meta-analysis. Highest ES were reported for quasi-experimental studies. ES reduced as experimental design moved from single pre-test factor matched, to multiple-factor matched randomized controlled trials. ES reduced when designs used standardised, rather than self-designed measures, The implications for future meta-analyses and research in cooperative learning are explored.

Cross-age tutoring in kindergarten and elementary school settings: A systematic review and meta-analysis

This systematic review summarizes effects of peer tutoring delivered to children between 5 and 11 years old by non-professional tutors, such as classmates, older children and adult community peer volunteers. Inclusion criteria for the review included tutoring studies with a randomized controlled trial design, reliable measures of academic outcomes, and duration of at least 12 weeks. Searches of electronic databases, previous reviews, and contacts with researchers yielded 11,564 titles. After screening, 15 studies were included in the analysis. Cross-age tutoring showed small significant effects for tutees on the composite measure of reading (g = 0.18, 95% CI: 0.08, 0.27, N = 8251), decoding skills (g = 0.29, 95% CI: 0.13, 0.44, N = 7081), and reading comprehension (g = 0.11, 95% CI: 0.01, 0.21, N = 6945). No significant effects were detected for other reading sub-skills or for mathematics. The benefits to tutees of non-professional cross-age peer tutoring can be given a positive, but weak recommendation. Effect Sizes were modest and in the range −0.02 to 0.29. Questions regarding study limitations, lack of cost information, heterogeneity of effects, and the relatively small number of studies that have used a randomized controlled trial design means that the evidence base is not as strong as it could be. Subgroup analyses of included studies indicated that highly-structured reading programmes were of more benefit than those that were loosely-structured. Large-scale replication trials using factorial designs, reliable outcome measures, process evaluations and logic models are needed to better understand under what conditions, and for whom, cross-age non-professional peer tutoring may be most effective.

The influence of experimental design on the magnitude of the effect size -peer tutoring for elementary, middle and high school settings: A meta-analysis

A meta-analysis was undertaken on a form of cooperative learning, peer tutoring. The effects of experimental design on outcomes were explored, as measured by Effect Size (ES). Forty three articles with 82 effect size studies were included in the meta-analysis. Highest ES were reported for quasi-experimental studies. ES reduced as experimental design moved from single pre-test factor matched, to multiple-factor matched randomized controlled trials. ES reduced when designs used standardised, rather than self-designed measures. The implications for future meta-analyses and research in cooperative learning are explored.

Summary statistics, educational achievement gaps and the ecological fallacy

Summary statistics continue to play an important role in identifying and monitoring patterns and trends in educational inequalities between differing groups of pupils over time. However, this article argues that their uncritical use can also encourage the labelling of whole groups of pupils as ‘underachievers’ or ‘overachievers’ as the findings of group-level data are simply applied to individual group members, a practice commonly termed the ‘ecological fallacy’. Some of the adverse consequences of this will be outlined in relation to current debates concerning gender and ethnic differences in educational attainment. It will be argued that one way of countering this uncritical use of summary statistics and the ecological fallacy that it tends to encourage, is to make much more use of the principles and methods of what has been termed ‘exploratory data analysis’. Such an approach is illustrated through a secondary analysis of data from the Youth Cohort Study of England and Wales, focusing on gender and ethnic differences in educational attainment. It will be shown that, by placing an emphasis on the graphical display of data and on encouraging researchers to describe those data more qualitatively, such an approach represents an essential addition to the use of simple summary statistics and helps to avoid the limitations associated with them.

Constructions of locality and gender and their impact on the educational aspirations of working class children

Over recent years the moral panic that has surrounded 'boys' underachievement' has tended to encourage crude and essentialist comparisons between all boys and all girls and to eclipse the continuing and more profound effects on educational achievement exerted by social class and 'race'/ethnicity. While there are differences in educational achievement between working class boys and girls, these differences are relatively minor when comparing the overall achievement levels of working class children with those from higher, professional social class backgrounds. This paper argues that a need exists therefore for researchers to fully contextualise the gender differences that exist in educational achievement within the over-riding contexts provided by social class and 'race'/ethnicity. The paper provides an example of how this can be done through a case study of 11-year-old children from a Catholic, working class area in Belfast. The paper shows how the children's general educational aspirations are significantly mediated by their experiences of the local area in which they live. However, the way in which the children come to experience and construct a sense of locality differs between the boys and girls and this, it is argued, helps to explain the more positive educational aspirations held by some of the girls compared to the boys. The paper concludes by considering the relevance of locality for understanding its effects on educational aspirations among other working class and/or minority ethnic communities.

Teachers and pupils: educational experiences and school based responses to the conflict in Northern Ireland

This article describes a study which examined (a) the impact of the political conflict on teachers' and ppils' experiences of education in Northern Ireland and (b) the impact of curricular-based interventions designed to support the ppils and reduce prejudice. The focus of the second part of the article is on the prejudice reduction initiatives identified. A total of 44 staff and 78 pupils spread across 8 schools participated and both teachers' and ppils' perspectives were identified, the latter being an extremely important dimension which has rarely been addressed in previous studies of this area. The findings, which highlight the complexity of the impact of the political conflict, are considered to have both practical and theoretical implications for prejudice reduction programs.