Protocol: A randomised controlled trial evaluation of Cancer Focus NI’s ‘Dead Cool’ smoking prevention programme in post-primary schools

This paper presents a research protocol for a randomised controlled efficacy trial of the ‘Dead Cool’ smoking prevention programme. Dead Cool is a three to four-hour programme designed to be used by teachers with Year 9 students in Northern Ireland. The main outcome of the programme is to prevent students from starting to smoke. The protocol reports a research design intended to test the efficacy of the programme in 20 post-primary school settings. Selected schools included those from secondary /grammar/integrated/single sex/coeducational, rural and urban schools from both the maintained and controlled state sector and independent sector schools. Outcome measures include self-reported behaviours, monitoring of carbon monoxide (CO) in exhaled breath and focus groups designed to assess implementation fidelity and opinions on efficacy in intervention schools and explore the ‘counterfactual’ potential treatments in control schools.

Improving E-Assessment Systems With A focus On Adaptive Feedback And Marking

Institutions involved in the provision of tertiary education across Europe are feeling the pinch. European universities, and other higher education (HE) institutions, must operate in a climate where the pressure of government spending cuts (Garben, 2012) is in stark juxtaposition to the EU’s strategy to drive forward and maintain a growth of student numbers in the sector (eurostat, 2015).

In order to remain competitive, universities and HE institutions are making ever-greater use of electronic assessment (E-Assessment) systems (Chatzigavriil et all, 2015; Ferrell, 2012). These systems are attractive primarily because they offer a cost-effect and scalable approach for assessment. In addition to scalability, they also offer reliability, consistency and impartiality; furthermore, from the perspective of a student they are most popular because they can offer instant feedback (Walet, 2012).

There are disadvantages, though.

First, feedback is often returned to a student immediately on competition of their assessment. While it is possible to disable the instant feedback option (this is often the case during an end of semester exam period when assessment scores must be can be ratified before release), however, this option tends to be a global ‘all on’ or ‘all off’ configuration option which is controlled centrally rather than configurable on a per-assessment basis.

If a formative in-term assessment is to be taken by multiple groups of
students, each at different times, this restriction means that answers to each question will be disclosed to the first group of students undertaking the assessment. As soon as the answers are released “into the wild” the academic integrity of the assessment is lost for subsequent student groups.

Second, the style of feedback provided to a student for each question is often limited to a simple ‘correct’ or ‘incorrect’ indicator. While this type of feedback has its place, it often does not provide a student with enough insight to improve their understanding of a topic that they did not answer correctly.

Most E-Assessment systems boast a wide range of question types including Multiple Choice, Multiple Response, Free Text Entry/Text Matching and Numerical questions. The design of these types of questions is often quite restrictive and formulaic, which has a knock-on effect on the quality of feedback that can be provided in each case.

Multiple Choice Questions (MCQs) are most prevalent as they are the most prescriptive and therefore most the straightforward to mark consistently. They are also the most amenable question types, which allow easy provision of meaningful, relevant feedback to each possible outcome chosen.
Text matching questions tend to be more problematic due to their free text entry nature. Common misspellings or case-sensitivity errors can often be accounted for by the software but they are by no means fool proof, as it is very difficult to predict in advance the range of possible variations on an answer that would be considered worthy of marks by a manual marker of a paper based equivalent of the same question.

Numerical questions are similarly restricted. An answer can be checked for accuracy or whether it is within a certain range of the correct answer, but unless it is a special purpose-built mathematical E-Assessment system the system is unlikely to have computational capability and so cannot, for example, account for “method marks” which are commonly awarded in paper-based marking.

From a pedagogical perspective, the importance of providing useful formative feedback to students at a point in their learning when they can benefit from the feedback and put it to use must not be understated (Grieve et all, 2015; Ferrell, 2012).

In this work, we propose a number of software-based solutions, which will overcome the limitations and inflexibilities of existing E-Assessment systems.

The influence of experimental design on the magnitude of the effect size -peer tutoring for elementary, middle and high school settings: A meta-analysis

A meta-analysis was undertaken on a form of cooperative learning, peer tutoring. The effects of experimental design on outcomes were explored, as measured by Effect Size (ES). Forty three articles with 82 effect size studies were included in the meta-analysis. Highest ES were reported for quasi-experimental studies. ES reduced as experimental design moved from single pre-test factor matched, to multiple-factor matched randomized controlled trials. ES reduced when designs used standardised, rather than self-designed measures. The implications for future meta-analyses and research in cooperative learning are explored.

Education for global citizenship in Scotland: reciprocal partnership or politics of benevolence?

Links between schools in the United Kingdom and partner schools in developing countries are an increasingly popular approach to teaching global citizenship. This study addresses the limited empirical research to date on the influence of such links on pupils' learning and understanding. Following an overview of the curricular theme of global citizenship in the Scottish curriculum and in the context of a partnership between Scotland and Malawi, challenges and potential pitfalls of teaching global citizenship are illustrated by the voices of pupils at four schools. Data is analysed through the themes of knowledge and understanding, concerns about fairness, and giving and helping. We reflect on whether our study indicates the intended reciprocal partnership or a 'politics of benevolence'.

The Effect of Seat Location in Lecture Theatres on Academic Performance

The purpose of this research study was to investigate and identify possible patterns relating to academic performance on the effects of university students self-selecting where to sit in a lecture theatre.
The key research questions are:
1. Does seating position affect student performance?
2. Do the most academically able and engaged students regularly sit at the front of lecture theatres?
Academic achievement
Preliminary results suggest significant assessment score differences between those that sit at the front and those that sit further the back. Of those that received a grade of 75%+ (Grade A) 6.67% regularly sat at the back. With the same group 46.67% regularly sat at the front. Of the group that scored less than 50% (Grade D) 0% of students regularly sat at the front. 12.50% regularly sat in the middle zones with 37.50% sitting at the back. It was also observed that the remaining numbers did not consistently sit in the same zone.

Temporal movement
There is little evidence of movement between seating zones of the Grade A group throughout the 24 week period. However there was considerable movement with the Grade D group. Although still under analysis there appears be a pattern of students in this group graduating towards the back seating positions over the course of the programme.

Engagement
The frequency of completed entries on PinPoint was also used as an indicator of engagement. With the Grade A group 75% of them regularly completed an entry whereas in the Grade D group this drops to less than 50%.
Further analysis on the attitudinal factors in relational to seating position and performance are ongoing, but preliminary results suggest that those students that scored highly in attitude tended to sit at the front and middle sections.
It would indeed appear that the more highly engaged and academically capable students voluntarily sit at the front for most lectures. Interestingly as the course progresses those who had lesser engagement and below average midterm results tend to began to sit progressively toward the back. If this is a repeatable pattern then a linear regression analysis of the seating positions and midterm results could help predict students in danger of failing.

Applied behaviour analysis: What do teachers of students with autism spectrum disorder know

With rising numbers of school-aged children with autism educated in mainstream classrooms and applied behaviour analysis (ABA) considered the basis of best practice, teachers’ knowledge in this field has become a key concern for inclusion. Self-reported knowledge of ABA of special needs teachers (n=165) was measured and compared to their actual knowledge of ABA demonstrated in accurate responses to a multiple-choice test. Findings reported here show that teachers’ self-perceived knowledge exceeded actual knowledge and that actual knowledge of ABA was not related to training received by government agency. Implications for teacher training are discussed.

A Design & Feasibility Study of the Spaced Learning Programme

Objectives There is evidence from neuroscience, cognitive psychology and educational research that the delivery of a stimulus in a spaced format (over time) rather than a massed format (all at once) leads to more effective learning. This project aimed to pilot spaced learning materials using various spacing lengths for GCSE science by exploring the feasibility of introducing spaced leaning into regular classrooms and by evaluating teacher fidelity to the materials. The spaced learning methods will then be compared with traditional science revision techniques and a programme manual will be produced. Design A feasibility study. Methods A pilot study (4 schools) was carried out to examine the feasibility and teacher fidelity to the materials, using pupil workshops and teacher interviews. A subsequent random assignment experimental study (12 schools) will involve pre and post testing of students on a science attainment measure and a post-test implementation questionnaire. Results The literature review found that longer spacing intervals between repetitions of material (>24 hours) may be optimal for long term memory formation than shorter intervals. A logic model was developed to inform the design of various programme variants for the pilot and experimental study. This paper will report qualitative data from the initial pilot study. Conclusions The paper uses this research project as an example to explain the importance of conducting pilot work and small scale experimental studies to explore the feasibility and inform the design of educational interventions, rather than prematurely moving to RCT type studies.