A Randomized Controlled Trial Evaluation of Time to Read, a Volunteer Tutoring Program for 8-9 Year Olds

Tutoring is commonly employed to prevent early reading failure, and evidence suggests that it can have a positive effect. This article presents findings from a large-scale (n = 734) randomized controlled trial evaluation of the effect of Time to Read—a volunteer tutoring program aimed at children aged 8 to 9 years—on reading comprehension, self-esteem, locus of control, enjoyment of learning, and future aspirations. The study found that the program had only a relatively small effect on children’s aspirations (effect size +0.17, 95% confidence interval [0.015, 0.328]) and no other outcomes. It is suggested that this lack of evidence found may be due to misspecification of the program logic model and outcomes identified and program-related factors, particularly the low dosage of the program.

Improving attainment across a whole district: school reform through peer tutoring in a randomized controlled trial

Districts are an important unit for administrative purposes, but they vary little in their impact on students’ attainment, at least in the UK. Further, government attempts to raise attainment are often disappointing. The project described in this article aimed to engage schools in reform to change students’ attainment and attitudes in schools across a whole district. The intervention, peer tutoring, has a good research pedigree in small-scale studies, but scaling it up to district-level implementation has not been rigorously evaluated. Over 2 years, 129 elementary schools in 1 Scottish district were randomly assigned to different interventions. The implementation was not perfect, but the results were positive with respect to cross-age tutoring, which had effect sizes of about 0.2. Despite limitations, the study demonstrates that it is possible to carry out a clustered randomized controlled trial (RCT) on a large scale working with districts and suggests that peer tutoring has promise when scaled up.

International on-line reciprocal peer tutoring to promote modern language development in primary schools

The paper reports data from an on-line peer tutoring project. In the project 78, 9–12-year-old students from Scotland and Catalonia peer tutored each other in English and Spanish via a managed on-line envi- ronment. Significant gains in first language (Catalonian pupils) modern language (Scottish pupils) and attitudes towards modern languages (both Catalonian and Scottish pupils) were reported for the exper- imental group as compared to the control group. Results indicated that pupils tutored each other in using Piagetian techniques of error correction during the project. Error correction provided by tutors to tutees focussed on morph syntaxys, more specifically the correction of verbs. Peer support provided via the on- line environment was predominantly based on the tutor giving the right answer to the tutee. High rates of impact on tutee corrected messages were observed. The implications for peer tutoring initiative taking place via on-line environments are discussed. Implications for policy and practice are explored

Peer tutoring in reading: The effects of role and organization on two dimensions of self-esteem

Background. Paired reading (PR) is an application of peer tutoring. It has been extensively researched, and its efficacy across a range of outcomes has been established. Benefits include improvements in key reading skills, and also in affective aspects of learning. Several studies have shown gains in self-esteem, although measurement methods have varied, and the model of self-esteem has rarely been clearly articulated.
Aims. To investigate the changes in self-esteem of children participating in a randomized trial of PR over a 15-week treatment period. To investigate the relative contribution of self-worth and self-competence to any gains in self-esteem. To investigate whether the pattern of change differs in children who take on different roles in the PR process.
Participants. The participants comprised a subset of a large-scale randomized trial of peer learning (The Fife Peer Learning Project). Four schools were randomly selected from schools allocated to the same-age PR condition, and four schools from those allocated to the cross-age PR condition. The same-age group consisted of 87 primary 6 children (10–11 years old). The cross-age group consisted of 81 primary 6 children. The controls, from schools randomly selected from a neighbouring authority, consisted of 92 primary 6 children.
Method. A pre–post design employing self-report measures of self-esteem. Rosenberg’s Self-Esteem Scale was used, with scores analysed for worth and competence. The treatment period was 15 weeks, with the participants following a prescribed PR process.
Results. Significant pre–post gains were noted in self-esteem, driven predominantly by improved beliefs about competence, in both same-age and cross-age conditions, but not for controls. Gains were also seen in self-worth in the cross-age condition. Further analyses of the influence of organizational condition (same-age or cross-age) and role played (tutor vs. tutee) showed significant differences between same-age tutors and cross-age tutors in relation to self-worth. Effect sizes were generally small or moderate.
Conclusions. The findings provide further support for the belief that PR can enhance self-esteem. Importantly, the use of a two-dimensional model provides extra information about self-perceptions in PR contexts: first, the central role of self- competence; and second, the gains in self-worth which are associated with tutoring younger children (but not same-age peers). This new information has educational significance for schools considering the potential of peer tutoring and the benefits of different organizational conditions.

Outcomes and process in reading tutoring

Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers.Purpose: A two-year study of peer tutoring in reading was undertaken in one local education authority in Scotland. The relative effectiveness of cross-age versus same-age tutoring, light versus intensive intervention, and reading versus reading and mathematics tutoring were investigated.Programme description (if relevant): The intervention was Paired Reading, a freely available cross-ability tutoring method applied to books of the pupils' choice but above the tutee's independent readability level. It involves Reading Together and Reading Alone, and switching from one to the other according to need.Sample: Eighty-seven primary schools of overall average socio-economic status, ability and gender in one council in Scotland. There were few ethnic minority students. Proportions of students with special needs were low. Children were eight and 10 years old as the intervention started. Macro-evaluation n = 3520. Micro-evaluation Year 1 15 schools n = 592, Year 2 a different 15 schools n = 591, compared with a comparison group of five schools n = 240.Design and methods: Almost all the primary schools in the local authority participated and were randomly allocated to condition. A macro-evaluation tested and retested over a two-year period using Performance Indicators in Primary Schools. A micro-evaluation tested and retested within each year using norm-referenced tests of reading comprehension. Macro-evaluation was with multi-level modelling, micro-evaluation with descriptive statistics and effect sizes, analysis of variance (ANOVA) and multivariate analysis of variance (MANOVA).Results: Macro-evaluation yielded significant pre-post gains in reading attainment for cross-age tutoring over both years. No other differences were significant. Micro-evaluation yielded pre-post changes in Year 1 (selected) and Year 2 (random) greater than controls, with no difference between same-age and cross-age tutoring. Light and intensive tutoring were equally effective. Tutoring reading and mathematics together was more effective than only tutoring reading. Lower socio-economic and lower reading ability students did better. Girls did better than boys. Regarding observed implementation quality, some factors were high and others low. Few implementation variables correlated with attainment gain.Conclusions: Paired Reading tutoring does lead to better reading attainment compared with students not participating. This is true in the long term (macro-evaluation) for cross-age tutoring, and in the short term (micro-evaluation) for both cross-age and same-age tutoring. Tutors and tutees benefited. Intensity had no effect but dual tutoring did have an effect. Low-socio-economic status, low-ability and female students did better. The results of the different forms of evaluation were indeed different. There are implications for practice and for future research. © 2012 Copyright Taylor and Francis Group, LLC.

Peer tutoring in reading in Scotland:Thinking big

A large-scale randomised-controlled trial of reading tutoring in 80 schools in Scotland used the Paired Reading (PR) technique. On long-term evaluation, cross-age PR was significantly better than regular teaching, but same-age was not. On short-term evaluation, PR pupils did significantly better than control pupils in both years, and cross-age and same-age were similarly effective. Low socio-economic pupils, lower reading ability pupils, girls and reading with maths tutoring groups did significantly better. Implementation was good in parts, but some important aspects of technique were rare. Reading gains were significantly greater for those with mistakes about every 2 minutes and those who stopped reading to talk every 5 to 7 minutes. Significant gains in self-esteem were seen in same-age and cross-age groups, and for tutees and tutors, but not for controls. The relationship of achievement gain to quality of technique and socio-emotional gains is discussed, with implications for practice. Copyright © 2011 UKLA.

A randomized trial of paired tutoring in elementary schools:effects on self-esteem

This paper reports data on self-esteem collected during a large-scale randomized trial of paired reading and Duolog Maths with primary school children (The Fife Peer-Learning Project). Self-report measures were analysed to assess the effect of a range of organisational variables on measured self-esteem. The presentation reports findings from a sample of reading-only schools in the first year of the project. Statistically significant gains in self-esteem were found across a range of conditions. Patterns of scores pointed to differences between same-age and cross-age conditions, and highlighted the influence of role played (tutor v tutee). In addition to the findings summarized here, it is hoped that preliminary findings from year two of the project - with an increased sample size - will also be shared. © 2009.

Meta-analysis of the influence of experimental design on effect size in peer tutoring outcomes in elementary, middle and high school settings.

A meta-analysis was undertaken on a form of cooperative learning, peer tutoring. The effects of experimental design on outcomes were explored, as measured by Effect Size (ES). 185 studies were included in the meta-analysis. Highest ES were reported for quasi-experimental studies. ES reduced as experimental design moved from single pre-test factor matched, to multiple-factor matched randomized controlled trials. ES reduced when designs used standardised, rather than self-designed measures, The implications for future meta-analyses and research in cooperative learning are explored.

Cross-age tutoring in kindergarten and elementary school settings: a systmeatic review and meta-analysis

Background: Qualified teaching staffs are neither available nor affordable to provide large numbers of children with individual attention. One solution to providing individual tuition has been the development of tutoring programs that are delivered by nonprofessional tutors, such as classmates, older children and community volunteers. Objectives: We have conducted a systematic review of cross-age tutoring interventions delivered by non-professional tutors to children between 5 and 11 years old. Only randomized controlled trials with reliable measures of academic outcomes, and continuing for at least 12 weeks, compared to instruction as usual, were included. Results: Searches of electronic databases and previous reviews, and contacts with researchers yielded 11,564 titles; after screening, 15 studies were included in the analysis. Cross-age tutoring showed small significant effects for tutees on the composite measure of reading (g=0.18, 95% CI: 0.08, 0.27, N=8251), decoding skills (g=0.29, 95% CI: 0.13, 0.44, N=7081), and reading comprehension (g=0.11, 95% CI: 0.01, 0.21, N=6945). No significant effects were detected for other reading sub-skills or for mathematics. The quality of evidence is decreased by study limitations and high heterogeneity of effects. Conclusions: The benefits for tutees of non-professional peer and cross-age tutoring can be given a positive but weak recommendation, considering the low quality of evidence and lack of cost information. Subgroup analyses suggested that highly-structured reading programs may be more useful than loosely-structured programs. Large-scale replication trials using factorial design, process evaluations, reliable outcome measures and logic models are needed to better understand under what conditions, and for whom, cross-age non-professional tutoring may be effective.

Cross-age tutoring in kindergarten and elementary school settings: A systematic review and meta-analysis

This systematic review summarizes effects of peer tutoring delivered to children between 5 and 11 years old by non-professional tutors, such as classmates, older children and adult community peer volunteers. Inclusion criteria for the review included tutoring studies with a randomized controlled trial design, reliable measures of academic outcomes, and duration of at least 12 weeks. Searches of electronic databases, previous reviews, and contacts with researchers yielded 11,564 titles. After screening, 15 studies were included in the analysis. Cross-age tutoring showed small significant effects for tutees on the composite measure of reading (g = 0.18, 95% CI: 0.08, 0.27, N = 8251), decoding skills (g = 0.29, 95% CI: 0.13, 0.44, N = 7081), and reading comprehension (g = 0.11, 95% CI: 0.01, 0.21, N = 6945). No significant effects were detected for other reading sub-skills or for mathematics. The benefits to tutees of non-professional cross-age peer tutoring can be given a positive, but weak recommendation. Effect Sizes were modest and in the range −0.02 to 0.29. Questions regarding study limitations, lack of cost information, heterogeneity of effects, and the relatively small number of studies that have used a randomized controlled trial design means that the evidence base is not as strong as it could be. Subgroup analyses of included studies indicated that highly-structured reading programmes were of more benefit than those that were loosely-structured. Large-scale replication trials using factorial designs, reliable outcome measures, process evaluations and logic models are needed to better understand under what conditions, and for whom, cross-age non-professional peer tutoring may be most effective.