Exploring the conditions to support assessment for more equitable learning outcomes

NAPLAN RESULTS HAVE gained socio-political prominence and have been used as indicators of educational outcomes for all students, including Indigenous students. Despite the promise of open and in-depth access to NAPLAN data as a vehicle for intervention, we argue that the use of NAPLAN data as a basis for teachers and schools to reduce variance in learning outcomes is insufficient. NAPLAN tests are designed to show statistical variance at the level of the school and the individual, yet do not factor in the sociocultural and cognitive conditions Indigenous students’ experience when taking the tests. We contend that further understanding of these influences may help teachers understand how to develop their classroom practices to secure better numeracy and literacy outcomes for all students. Empirical research findings demonstrate how teachers can develop their classroom practices from an understanding of the extraneous cognitive load imposed by test taking. We have analysed Indigenous students’ experience of solving mathematical test problems to discover evidence of extraneous cognitive load. We have also explored conditions that are more supportive of learning derived from a classroom intervention which provides an alternative way to both assess and build learning for Indigenous students. We conclude that conditions to support assessment for more equitable learning outcomes require a reduction in cognitive load for Indigenous students while maintaining a high level of expectation and participation in problem solving.

Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

Place value, multiplicativity, reunitizing and effective classroom teaching of decimal numeration

Student understanding of decimal number is poor (e.g., Baturo, 1998; Behr, Harel, Post & Lesh, 1992). This paper reports on a study which set out to determine the cognitive complexities inherent in decimal-number numeration and what teaching experiences need to be provided in order to facilitate an understanding of decimal-number numeration. The study gave rise to a theoretical model which incorporated three levels of knowledge. Interview tasks were developed from the model to probe 45 students’ understanding of these levels, and intervention episodes undertaken to help students construct the baseline knowledge of position and order (Level 1 knowledge) and an understanding of multiplicative structure (Level 3 knowledge). This paper describes the two interventions and reports on the results which suggest that helping students construct appropriate mental models is an efficient and effective teaching strategy.

A problem-posing intervention in the development of problem-solving competence of underachieving, middle-year students

This study reported on the issues surrounding the acquisition of problem-solving competence of middle-year students who had been ascertained as above average in intelligence, but underachieving in problem-solving competence. In particular, it looked at the possible links between problem-posing skills development and improvements in problem-solving competence. A cohort of Year 7 students at a private, non-denominational, co-educational school was chosen as participants for the study, as they undertook a series of problem-posing sessions each week throughout a school term. The lessons were facilitated by the researcher in the students’ school setting. Two criteria were chosen to identify participants for this study. Firstly, each participant scored above the 60th percentile in the standardized Middle Years Ability Test (MYAT) (Australian Council for Educational Research, 2005) and secondly, the participants all scored below the cohort average for Criterion B (Problem-solving Criterion) in their school mathematics tests during the first semester of Year 7. Two mutually exclusive groups of participants were investigated with one constituting the Comparison Group and the other constituting the Intervention Group. The Comparison Group was chosen from a Year 7 cohort for whom no problem-posing intervention had occurred, while the Intervention Group was chosen from the Year 7 cohort of the following year. This second group received the problem-posing intervention in the form of a teaching experiment. That is, the Comparison Group were only pre-tested and post-tested, while the Intervention Group was involved in the teaching experiment and received the pre-testing and post-testing at the same time of the year, but in the following year, when the Comparison Group have moved on to the secondary part of the school. The groups were chosen from consecutive Year 7 cohorts to avoid cross-contamination of the data. A constructionist framework was adopted for this study that allowed the researcher to gain an “authentic understanding” of the changes that occurred in the development of problem-solving competence of the participants in the context of a classroom setting (Richardson, 1999). Qualitative and quantitative data were collected through a combination of methods including researcher observation and journal writing, video taping, student workbooks, informal student interviews, student surveys, and pre-testing and post-testing. This combination of methods was required to increase the validity of the study’s findings through triangulation of the data. The study findings showed that participation in problem-posing activities can facilitate the re-engagement of disengaged, middle-year mathematics students. In addition, participation in these activities can result in improved problem-solving competence and associated developmental learning changes. Some of the changes that were evident as a result of this study included improvements in self-regulation, increased integration of prior knowledge with new knowledge and increased and contextualised socialisation.

Inquiry-based science in a primary classroom : professional development impacting practice

The critical factor in determining students' interest and motivation to learn science is the quality of the teaching. However, science typically receives very little time in primary classrooms, with teachers often lacking the confidence to engage in inquiry-based learning because they do not have a sound understanding of science or its associated pedagogical approaches. Developing teacher knowledge in this area is a major challenge. Addressing these concerns with didactic "stand and deliver" modes of Professional Development (PD) has been shown to have little relevance or effectiveness, yet is still the predominant approach used by schools and education authorities. In response to that issue, the constructivist-inspired Primary Connections professional learning program applies contemporary theory relating to the characteristics of effective primary science teaching, the changes required for teachers to use those pedagogies, and professional learning strategies that facilitate such change. This study investigated the nature of teachers' engagement with the various elements of the program. Summative assessments of such PD programs have been undertaken previously, however there was an identified need for a detailed view of the changes in teachers' beliefs and practices during the intervention. This research was a case study of a Primary Connections implementation. PD workshops were presented to a primary school staff, then two teachers were observed as they worked in tandem to implement related curriculum units with their Year 4/5 classes over a six-month period. Data including interviews, classroom observations and written artefacts were analysed to identify common themes and develop a set of assertions related to how teachers changed their beliefs and practices for teaching science. When teachers implement Primary Connections, their students "are more frequently curious in science and more frequently learn interesting things in science" (Hackling & Prain, 2008). This study has found that teachers who observe such changes in their students consequently change their beliefs and practices about teaching science. They enhance science learning by promoting student autonomy through open-ended inquiries, and they and their students enhance their scientific literacy by jointly constructing investigations and explaining their findings. The findings have implications for teachers and for designers of PD programs. Assertions related to teaching science within a pedagogical framework consistent with the Primary Connections model are that: (1) promoting student autonomy enhances science learning; (2) student autonomy presents perceived threats to teachers but these are counteracted by enhanced student engagement and learning; (3) the structured constructivism of Primary Connections resources provides appropriate scaffolding for teachers and students to transition from didactic to inquiry-based learning modes; and (4) authentic science investigations promote understanding of scientific literacy and the "nature of science". The key messages for designers of PD programs are that: (1) effective programs model the pedagogies being promoted; (2) teachers benefit from taking the role of student and engaging in the proposed learning experiences; (3) related curriculum resources foster long-term engagement with new concepts and strategies; (4) change in beliefs and practices occurs after teachers implement the program or strategy and see positive outcomes in their students; and (5) implementing this study's PD model is efficient in terms of resources. Identified topics for further investigation relate to the role of assessment in providing evidence to support change in teachers' beliefs and practices, and of teacher reflection in making such change more sustainable.

Primary classroom teachers' use of social and emotional wellbeing programs and the factors influencing program use

There has been a rapid escalation in the development and evaluation of social and emotional well-being (SEW) programs in primary schools over the last few decades. Despite the plethora of programs available, primary teachers’ use of SEW programs is not well documented in Australian schools, with even less consideration of the factors influencing program use. A cross-sectional survey was undertaken with primary classroom teachers across twelve schools in the Brisbane and Sunshine Coast Education Districts in Queensland, Australia, during 2005. A checklist of SEW programs and an audit of SEW practices in schools were employed to investigate the number, range and types of SEW programs used by primary classroom teachers and the contextual factors influencing program use. Whilst the majority of implementation studies have been conducted under intervention conditions, this study was designed to capture primary classroom teachers’ day-to-day use of SEW programs and the factors influencing program use under real-world conditions. The findings of this research indicate that almost three quarters of the primary classroom teachers involved in the study reported using at least one SEW program during 2005. Wide variation in the number and range of programs used was evident, suggesting that teachers are autonomous in their use of SEW programs. Evidence-based SEW programs were used by a similar proportion of teachers to non-evidence-based programs. However, irrespective of the type of program used, primary teachers overwhelmingly reported using part of a SEW program rather than the whole program. This raises some issues about the quality of teachers’ program implementation in real-world practice, especially with respect to programs that are evidence-based. A content analysis revealed that a wide range of factors have been examined as potential influences on teachers’ implementation of health promotion programs in schools, including SEW programs, despite the limited number of studies undertaken to date. However, variation in the factors examined and study designs employed both within and across health promotion fields limited the extent to which studies could be compared. A methodological and statistical review also revealed substantial variation in the quality of reporting of studies. A variety of factors were examined as potential influences on primary classroom teachers’ use of SEW programs across multiple social-ecological levels of influence (ranging from community to school and individual levels). In this study, parent or caregiver involvement in class activities and the availability of wellbeing-related policies in primary schools were found to be influential in primary classroom teachers’ use of SEW programs. Teachers who often or always involve parents or caregivers in class activities were at a higher odds of program use relative to teachers who never or rarely involved parents or caregivers in class activities. However, teachers employed in schools with the highest number of wellbeing-related policies available were at a lower odds of program use relative to teachers employed in schools with fewer wellbeing-related policies available. Future research should investigate primary classroom teachers’ autonomy and motivations for using SEW programs and the reasons behind the selection and use of particular types of programs. A larger emphasis should also be placed upon teachers not using SEW programs to identify valid reasons for non-use. This would provide another step towards bridging the gap between the expectations of program developers and the needs of teachers who implement programs in practice. Additionally, the availability of wellbeing-related school policies and the types of activities that parents and caregivers are involved with in the classroom warrant more in-depth investigation. This will help to ascertain how and why these factors influence primary classroom teachers’ use of SEW programs on a day-to-day basis in schools.

Development and formative evaluation of a motorcycle rider training intervention to address risk taking

The need to address on-road motorcycle safety in Australia is important due to the disproportionately high percentage of riders and pillions killed and injured each year. One approach to preventing motorcycle-related injury is through training and education. However, motorcycle rider training lacks empirical support as an effective road safety countermeasure to reduce crash involvement. Previous reviews have highlighted that risk-taking is a contributing factor in many motorcycle crashes, rather than merely a lack of vehicle-control skills (Haworth & Mulvihill, 2005; Jonah, Dawson & Bragg, 1982; Watson et al, 1996). Hence, though the basic vehicle-handling skills and knowledge of road rules that are taught in most traditional motorcycle licence training programs may be seen as an essential condition of safe riding, they do not appear to be sufficient in terms of crash reduction. With this in mind there is considerable scope for the improvement of program focus and content for rider training and education. This program of research examined an existing traditional pre-licence motorcycle rider training program and formatively evaluated the addition of a new classroom-based module to address risky riding; the Three Steps to Safer Riding program. The pilot program was delivered in the real world context of the Q-Ride motorcycle licensing system in the state of Queensland, Australia. Three studies were conducted as part of the program of research: Study 1, a qualitative investigation of delivery practices and student learning needs in an existing rider training course; Study 2, an investigation of the extent to which an existing motorcycle rider training course addressed risky riding attitudes and motives; and Study 3, a formative evaluation of the new program. A literature review as well as the investigation of learning needs for motorcyclists in Study 1 aimed to inform the initial planning and development of the Three Steps to Safer Riding program. Findings from Study 1 suggested that the training delivery protocols used by the industry partner training organisation were consistent with a learner-centred approach and largely met the learning needs of trainee riders. However, it also found that information from the course needs to be reinforced by on-road experiences for some riders once licensed and that personal meaning for training information was not fully gained until some riding experience had been obtained. While this research informed the planning and development of the new program, a project team of academics and industry experts were responsible for the formulation of the final program. Study 2 and Study 3 were conducted for the purpose of formative evaluation and program refinement. Study 2 served primarily as a trial to test research protocols and data collection methods with the industry partner organisation and, importantly, also served to gather comparison data for the pilot program which was implemented with the same rider training organisation. Findings from Study 2 suggested that the existing training program of the partner organisation generally had a positive (albeit small) effect on safety in terms of influencing attitudes to risk taking, the propensity for thrill seeking, and intentions to engage in future risky riding. However, maintenance of these effects over time and the effects on riding behaviour remain unclear due to a low response rate upon follow-up 24 months after licensing. Study 3 was a formative evaluation of the new pilot program to establish program effects and possible areas for improvement. Study 3a examined the short term effects of the intervention pilot on psychosocial factors underpinning risky riding compared to the effects of the standard traditional training program (examined in Study 2). It showed that the course which included the Three Steps to Safer Riding program elicited significantly greater positive attitude change towards road safety than the existing standard licensing course. This effect was found immediately following training, and mean scores for attitudes towards safety were also maintained at the 12 month follow-up. The pilot program also had an immediate effect on other key variables such as risky riding intentions and the propensity for thrill seeking, although not significantly greater than the traditional standard training. A low response rate at the 12 month follow-up unfortunately prevented any firm conclusions being drawn regarding the impact of the pilot program on self-reported risky riding once licensed. Study 3a further showed that the use of intermediate outcomes such as self-reported attitudes and intentions for evaluation purposes provides insights into the mechanisms underpinning risky riding that can be changed by education and training. A multifaceted process evaluation conducted in Study 3b confirmed that the intervention pilot was largely delivered as designed, with course participants also rating most aspects of training delivery highly. The complete program of research contributed to the overall body of knowledge relating to motorcycle rider training, with some potential implications for policy in the area of motorcycle rider licensing. A key finding of the research was that psychosocial influences on risky riding can be shaped by structured education that focuses on awareness raising at a personal level and provides strategies to manage future riding situations. However, the formative evaluation was mainly designed to identify areas of improvement for the Three Steps to Safer Riding program and found several areas of potential refinement to improve future efficacy of the program. This included aspects of program content, program delivery, resource development, and measurement tools. The planned future follow-up of program participants' official crash and traffic offence records over time may lend further support for the application of the program within licensing systems. The findings reported in this thesis offer an initial indication that the Three Steps to Safer Riding is a useful resource to accompany skills-based training programs.

Disengaged and disruptive : behaviour intervention for boys from year four to year seven

Disengaged and disruptive students have been an ongoing concern for teachers for many years. Teaching is complex—complex students with complex lives and complex behaviours. How best to help these students is an ever-present question without a simple answer. Solutions need to be found. Under a positive behaviour support framework when serious, disruptive behaviour requires intervention, an individualised positive behaviour support plan (PBS plan) is developed and implemented. This multicase study (Stake, 2006) investigated how task engagement was changed for boys from year four to year seven who demonstrated serious, disruptive behaviour. The individualised PBS plan was the primary tool of behaviour intervention in each of the five cases. Using the Behaviour Support Plan Quality Evaluation Scoring Guide II (BSP-QE) (Browning- Wright, Saren & Mayer, 2003) the five PBS plans were evaluated prior to implementation and rated highly in terms of technical quality. Positive changes in student task engagement were forthcoming in all five cases. Eleven advisory visiting teachers in behaviour and eleven classroom teachers, five of whom were case-study participants, took part in this study. The classroom teachers were employed in south-east Queensland primary schools located in suburbs of economic disadvantage. All 22 participants expressed very similar perceptions of serious, disruptive behaviour emphasising the collateral impact upon the teaching and learning. Data obtained through direct observations, surveys and semi-structured interviews confirmed previous research to reveal a strong link between integrity of PBS plan implementation and student behaviour change. While classroom teachers, in the main, effectively managed the implementation of the PBS plan, social validity of goals, procedures and effects; in-class technical assistance and performance feedback were identified as three enablers to effective teacher implementation of the PBS plan. While the purpose of each PBS plan was to influence change in student behaviour, this study found that changing teacher behaviour was also instrumental in achieving positive student outcomes. Changing teacher behaviour and building capacity was facilitated by trusting, collaborative partnerships established between the Advisory Visiting Teacher-Behaviour and the classroom teacher responsible for the plan implementation. The Advisory Visiting Teacher-Behaviour provides assistance to teachers dealing with students who demonstrate ongoing, problematic behaviour. The inclusion of a teaching component as part of the implementation stage of the consultation process appeared to have considerable influence upon successful intervention. Results substantiated earlier understandings of the importance of teacher instruction highlighting the value of explicit teaching and performance feedback to the delivery of effective behaviour intervention. Conclusions drawn from this study have had a major impact upon the work of a regional team of Advisory Visiting Teachers-Behaviour. The focus of behaviour intervention has moved from being primarily upon the individual student to include a greater emphasis upon the critical role of the teacher. Procedures and processes are being re-evaluated to align with evidence-based practice and to include a collaborative consultation approach to improve teacher assistance. The framework and content of staff development and training is being created directly from the findings of this study. This practical application of the results has informed better ways of providing behaviour intervention for students demonstrating serious, disruptive behaviour. What this study has clearly shown is that when it comes to behaviour intervention, the important role of the teacher cannot be underestimated.

Ordering within moral orders to manage classroom trouble

This paper demonstrates how classroom trouble warranting teacher intervention can stem from transgressions in different layers of the complex moral order regulating classroom interactions. The paper builds from Durkheim’s treatment of schooling as the institution responsible for the inculcation of a shared moral order, Bernstein’s distinction between the instructional and regulative discourses in any pedagogic setting, and the concept of verticality in the instructional discourse to illuminate how curricular knowledge might apply across different contexts. This paper proposes a similar vertical dimension of moral gravity in the regulative discourse, such that some moral expectations apply across any context, while others are highly contextualized. This paper then applies this frame to data from classroom observations conducted in prevocational pathways for 16 years olds created under Australia’s “earning or learning till 17” policy. This paper describes the variety of moral premises teachers invoked in different teacher/class combinations, according to their level of moral gravity to display the dominant use of highly contextualized moral premises seeking institutional compliance, and minimal use of broader moral frames for these students on the brink of entry to the adult world.

Reducing the global burden of depression : population level analysis of intervention cost-effectiveness in 14 world regions

International evidence on the cost and effects of interventions for reducing the global burden of depression remain scarce. Aims: To estimate the population-level cost-effectiveness of evidence-based depression interventions and their contribution towards reducing current burden. Method: Primary-care-based depression interventions were modelled at the level of whole populations in 14 epidemiological subregions of the world. Total population-level costs (in international dollars or I$) and effectiveness (disability adjusted life years (DALYs) averted) were combined to form average and incremental cost-effectiveness ratios. Results: Evaluated interventions have the potential to reduce the current burden of depression by 10–30%. Pharmacotherapy with older antidepressant drugs, with or without proactive collaborative care, are currently more cost-effective strategies than those using newer antidepressants, particularly in lower-income subregions. Conclusions: Even in resource-poor regions, each DALYaverted by efficient depression treatments in primary care costs less than 1 year of average per capita income, making such interventions a cost-effective use of health resources. However, current levels of burden can only be reduced significantlyif there is a substantialincrease substantial increase intreatment coverage.