Principal led school improvement and teacher capacity building in the Barwon South Network : final report, May 2013

The period of interest for this report is the beginning of 2011 to the end of 2012. The period commenced when the Regional Network Leader of the Barwon South Network of schools in the Barwon South Region of the Department of Education and Early Childhood contacted the School of Education at Deakin University, Waurn Ponds Campus Geelong. The Regional Network Leader outlined a desire to engage with Deakin University to research a short-term-cycle model of school improvement to be implemented in the region. While the model was expected to be taken on by all schools in the region the research was limited to the 23 schools in the Barwon South Network with four schools to be investigated more closely for each of two years (2001 & 2012) – eight focus schools in total.

Many positive outcomes flowed from the implementation of short-term-cycle school improvement plans and their associated practices but there was wide variation in the nature and degrees of success and of the perception of the process. The research team asked the following questions of the data:

1. What aspects of the School Improvement Plan (SIP) approach were important for initiating and supporting worthwhile change?
2. What might we take from this, to provide guidance on how best to support change in teaching and learning processes in schools?

The School Improvement Plan (SIP) worked in a range of ways. At one level it was strongly focused on school leadership, and a need to improve principals’ capacity to initiate worthwhile teaching and learning processes in their schools. Underlying this intent, one might think an assumption is operation is that the leadership process involves top down decision-making and a willingness to hold staff accountable for the quality of their practice.

The second strong focus was on the translation into practice and the consequent effect on student learning, involving an emphasis on data and evidence led practice. Hence, along with the leadership focus there was a demand for the process of school improvement to reach down into students and classrooms. Thus, the SIP process inevitably involved a chain of decision-making by which student learning quality drove the intervention, and teachers responsible for this had a common view. The model therefore should not be seen as an intervention only on the principal, but rather on the school decision-making system and focus. Even though it was the principal receiving the SIP planning template, and reporting to the network, the reporting was required to include description of the operation of the school processes, of classroom processes, and of student learning. This of course placed significant constraints on principals, which may help explain the variation in responses and outcomes described above.

The findings from this study are based on multiple data sources: analysis of both open and closed survey questions which all teachers in the 23 schools in the network were invited to complete; interviews with principals, teachers and leaders in the eight case study schools; some interviews with students in the case study schools; and interviews with leaders who worked in the regional network office; and field notes from network meetings including the celebrations days. Celebrations days occurred each school term when groups of principals came together to share and celebrate the improvements and processes happening in their schools. Many of the themes emerging from the analysis of the different data sources were similar or overlapping, providing some confidence in the evidence-base for the findings.

The study, conducted over two years of data collection and analysis, has demonstrated a range of positive outcomes in at the case study schools relating to school communication and collaboration processes, professional learning of principals, leadership teams and classroom teachers. There was evidence in the survey responses and field notes from ‘celebration days’ that these outcomes were also represented in other schools in the network. The key points of change concerned the leadership processes of planning for improvement, and the rigorous attention to student data in framing teaching and learning processes. This latter point of change had the effect of basing SIP processes on a platform of evidence-based change. The research uncovered considerable anecdotal and observational evidence of improvements in student learning, in teacher accounts in interview, and presentations of student work. Interviews with students, although not as representative as the team would have liked, showed evidence of student awareness of learning goals, a key driver in the SIP improvement model. It was, however, not possible over this timescale to collect objective comparative evidence of enhanced learning outcomes.

A number of features of the short-term-cycle SIP were identified that supported positive change across the network. These were: 1) the support structures represented by the network leader and support personnel within schools, 2) the nature of the SIP model – focusing strongly on change leadership but within a collaborative structure that combined top-down and bottom-up elements, 3) the focus on data-led planning and implementation that helped drill down to explicit elements of classroom practice, and 4) the accountability regimes represented by network leader presence, and the celebration days in which principals became effectively accountable to their peers. We found that in the second year of the project, momentum was lost in the case study schools, as the network was dismantled. This raised issues also for the conduct of research in situations of systemic change.

Alongside the finding of evidence of positive outcomes in the case study schools overall, was the finding that the SIP processes and outcomes varied considerably across schools. A number of contextual factors were identified that led to this variation, including school histories of reform, principal management style, and school size and structure that made the short-term-cycle model unmanageable. In some cases there was overt resistance to the SIP model, at least in some part, and this led to an element of performativity in which the language of the SIP was conscripted to other purposes. The study found that even with functioning schools the SIP was understood differently and the processes performed differently, raising the question of whether in the study we are dealing with one SIP or many. The final take home message from the research is that schools are complex institutions, and models of school improvement need to involve both strong principled features, and flexibility in local application, if all schools’ interests in improving teaching and learning processes and outcomes are to be served.

The relationship between the density of alcohol outlets and parental supply of alcohol to adolescents

This study investigated whether the number of alcohol outlets per 10,000 population in a given area (density) influenced parental supply of alcohol to adolescents; differences in Australian born and acculturating parents were also examined. A state-representative student survey in Victoria identified that the majority of adolescents (55%) reported that they had used alcohol in the past 12 months; 34 % of those who had consumed alcohol reported that it had been supplied by their parents. Multilevel modelling identified that there were no overall effects of density, however there were different effects based on parent country of birth and type of license. Specifically, each unit increase in the density of takeaway liquor stores increased the likelihood by 2.03 that children with both Australian-born parents would be supplied alcohol. Adolescents with both migrant parents on the other hand, had a 1.36 increased risk of being supplied alcohol as the density of outlets requiring at-venue consumption increased. The findings of this study suggest that in Australia, alcohol outlet density is associated with parental supply of alcohol to children, with this effect moderated by the cultural background of the parent and type of outlet density. Future research should investigate the association between the density of alcohol outlets and public approval of parents supplying alcohol to adolescents.

Student self-assessment in higher education: a meta-analysis

Quantitative self-assessment studies that compared self- and teacher marks were subjected to a meta-analysis. Predictions stemming from the results of an earlier critical review of the literature (Boud & Falchikov, 1989) were tested, and salient variables were identified. Factors that seem to be important with regard to the closeness of correspondence between self- and teacher marks were found to include the following: the quality of design of the study (with better designed studies having closer correspondence between student and teacher than poorly designed ones); the level of the course of which the assessment was a part (with students in advanced courses appearing to be more accurate assessors than those in introductory courses); and the broad area of study (with studies within the area of science appearing to produce more accurate self-assessment generally than did those from other areas of study). Results of the analysis are discussed and differences signaled by the results of the three common metrics examined. The distinction between relative and absolute judgment of performance is drawn. It is recommended that researchers give attention to both good design and to adequate reporting of self-assessment studies.

TESOL professional standards in the "Asian century": dilemmas facing Australian TESOL teacher education

Australian teacher education programmes that prepare teachers of English to speakers of other languages (TESOL) are confronting the nexus of two facets of globalization: transformations in the Asian region, captured in the notion of the "Asian century", and shifting conceptions of professionalism in TESOL in non-compulsory education. In booming Asian economies, English language learning is integral to the demand for high-quality education. This has produced increases in TESOL Teacher Education Programme (TTEP) enrolments of both domestic Australian students and international students from Asia. Growth in demand for TTEPs has necessitated that they cater to student diversity, and the intended contexts of practice. This demand has coincided with a concurrent movement towards professional standards for TESOL that, we argue, confronts complexities around quality, accountability, and professional identity and achieving conceptual and contextual coherence. Drawing on discourses of managerialism and performativity, this paper explores tensions between increased student demands for TTEPs, professional standards discourses which are part of the global policy discourses on teacher quality, and the achievement of programmatic conceptual and contextual coherence from the perspective of Australian TTEPs.

Developing teacher competencies through videos for facilitation of mathematical modelling in Singapore primary schools

Mathematical modelling tasks which are situated in real-world contexts encourage students to draw connections between school-based mathematics and the real-world, enhancing their engagement in learning. Such tasks often require varied interpretations of the real-world problem context resulting in multiple pathways of solutions. Although mathematical modelling has been introduced in the Singapore mathematics curriculum since 2007, its incorporation in schools has been limited. One reason for this could be that teachers are challenged by how best to facilitate for rich student mathematisation processes during such tasks. This chapter reports how a multi-tiered teaching experiment using design research methodology was conducted to build teachers’ capacity in designing, facilitating, and evaluating student mathematisation during mathematical modelling tasks with an intact class of Primary 5 students (aged 10-11). The use of videos was critical because grounded images helped capture the dynamics and complexity of authentic classroom interactions. This chapter highlights how video recordings of teacher-student interactions during a modelling task were harnessed during design methodology cycles, particularly during the Retrospective Analysis phase, to activate critical moments of learning for the teacher towards developing her competencies in facilitating students’ mathematisation processes.

Longitudinal Teacher Education Workforce Study [LTEWS] final report. November 2013

The Longitudinal Teacher Education Workforce Study (LTEWS) investigated the career progression of graduate teachers from teacher education into teaching employment in all states and territories across Australia in 2012 and the first half of 2013, and tracked their perceptions, over time, of the relevance and effectiveness of their teacher education programs. Specifically, it investigated: The career progression of the 2011 teacher education graduates from teacher education into, andpossible exit from, teaching employment, including their utilisation into teaching, their retention and attrition in teaching in their early years, and their geographic and schools sector mobility; and, The views of teacher education graduates over time on the relevance and effectiveness of their teacher education for their teaching employment, including the relationship between their views of their teacher education and their early career teaching career.LTEWS was conducted concurrently with the Studying the Effectiveness of Teacher Education (SETE) project, which is a three-year project investigating these issues in Queensland and Victoria. SETE is funded by the Australian Research Council, the Victorian Department of Education and Early Childhood Development (DEECD), the Queensland Department of Education, Training and Employment (QDETE), the Victorian Institute of Teaching (VIT), and the Queensland College of Teachers (QCT). LTEWS focused on data collection in states and territories other than Queensland and Victoria. The findings from the SETE study were incorporated with the LTEWS findings to provide a national data set.

Promoting African music and enhancing intercultural understanding in teacher education

Australia is a culturally diverse nation. The Arts provide a pathway that contributes to the rich tapestry of its people. Tertiary music educators have the responsibility to provide opportunities to effectively prepare and engage pre-service teachers in becoming culturally responsive. The authors discuss the importance and need to include guest music educators as culture bearers when preparing pre-service teachers to teach multicultural music. Drawing on data from student questionnaires, author participant observation and reflective practice in 2014, the findings highlight the experiences and practical engagement of an African music workshop in teacher education courses. Generalisations cannot be made, however, the findings revealed the need, importance and benefits of incorporating guest music educators as culture bearers who have the knowledge, skills and understandings to contribute to multicultural music education. This experience may be similar to other educational settings and it is hoped that the findings may provide a platform for further dialogue in other teaching and learning areas.

Investigating the effectiveness of teacher education for early career teachers in diverse settings: the longitudinal research we have to have

There have been more than 100 reports focusing on the effectiveness of teacher education in Australia over the last 35 years with many positioning teacher education as flawed and in need of reform. These frequent criticisms have drawn attention to the difficulty teacher educators can experience when trying to interrupt or contest this representation: a situation not unique to Australia. In the United States, for example, Pam Grossman has suggested that those in teacher education “seem ill prepared to respond to critics who question the value of professional education for teachers with evidence of our effectiveness” (Grossman in J Teach Educ 59(1):10–23, 2008). A key question facing teacher educators, therefore, concerns the kinds of research that will most effectively allow us to lead debates about teacher preparation. This paper outlines an approach to the conceptualization and conduct of research into the effectiveness of teacher education that seeks to move debates in new directions. Drawing upon the theoretical resources of Soja (Thirdspace: journeys to Los Angeles and other real-and-imagined places, 1996) and Lefebre (The production of space, 1991) we outline the ways in which a spatial approach to conceptualizing teacher education influenced the design and conduct of a large scale, longitudinal project that investigated the question of the effectiveness of teacher education in Australia. In exploring the design features of this ARC linkage grant the paper demonstrates how research changes when teacher education is conceptualised from a spatial point of view and illustrates the ways in which consideration of the conceived, perceived and lived spaces of teacher education can move research about effectiveness into new directions.

A systematic review of how researchers characterize the school environment in determining its effect on student obesity

BACKGROUND: Obesity in early childhood is a robust predictor of obesity later in life. Schools provide unparalleled access to children and have subsequently become major intervention sites. However, empirical evidence supporting the effectiveness of school-based interventions against childhood obesity is of limited scope and unknown quality. The aim of this systematic review is to critically assess how researchers have characterized the school environment in determining its effect on childhood weight status in order to improve the quality and consistency of research in this area. We conducted a narrative review with a systematic search of the literature in line with PRISMA guidelines (2009). Original peer-reviewed research articles in English were searched from Medline, EMBASE, CENTRAL, CINAHL and PsycINFO databases from earliest record to January 2014. We included empirical research that reported at least one measure of the primary/elementary school environment and its relationship with at least one objective adiposity-related variable for students aged 4-12 years. Two authors independently extracted data on study design, school-level factors, student weight status, type of analysis and effect. RESULTS: Five studies met the inclusion criteria. Each study targeted different parts of the school environment and findings across the studies were not comparable. The instruments used to collect school-level data report no validity or reliability testing. CONCLUSIONS: Our review shows that researchers have used instruments of unknown quality to test if the school environment is a determinant of childhood obesity, which raises broader questions about the impact that schools can play in obesity prevention.

Teacher agency and participation in professional learning for new literacies

The proliferation of digital technologies is influencing the relational as well as the technological and meaning-making aspects of literacy learning. There is a renewed focus on student learning that promotes agency and enables new literacies mindsets. However a lack of clarity persists as to the form and content of effective professional learning for teachers of new literacies. Combining elements from various models of professional learning to foster teacher agency and participation mobilises transformed processes and conditions. This article draws on literature from the areas of new literacies, student agency and teacher professional learning to argue for approaches to teacher professional learning that support new literacy learning. It explores the characteristics of models of professional learning for teachers; describes a professional learning program offered to teachers of literacy; outlines a mixed methods research study in the form of a survey of participants engaged in the professional learning program; and analyses teacher perceptions of their experiences of professional learning and how key characteristics influenced their learning.

Studying mathematics teacher education: analysing the process of task variation on learning

Self-study of variations to task design offers a way of analysing how learning takes place. Over several years, variations were made to improve an assessment task completed by final-year teacher candidates in a primary mathematics teacher education subject. This article describes how alterations to a task informed on-going developments in self-study of one assessment task employed in an online subject. Analysis of my journal, notes from conversations with colleagues, teacher candidates’ work on the task and responses to online forums, and survey data inspired variations focused on better exploration of key concepts involved in the task, raising of focal awareness, developing a stronger professional eye in the students and the author, adaptations for multiple curriculum levels, and explorations of dual teacher–student perspectives. The overall challenge has been to support teacher candidates to learn to design effective open-ended tasks with a critical professional eye. Descriptions of the changes made to the task and the development of my own professional eye as a consequence of the application of self-study are included. Data show that variations to the task increased teacher candidates’ understanding of mathematics problem posing and generated pedagogical insights for task design.

Student knowledge: curriculum, assessment and reporting

At a time when national and international high-stakes testing has assumed such prominence, one might begin to wonder about the status of teacher judgement when assessing and reporting on children’s knowledge and skills against the descriptors specified in curriculum standards. Were standardised test results congruent with the judgements that teachers make when reporting on students’ achievement, concern about how one type of judgement might compare with another would perhaps be unwarranted. This article draws on research that has investigated whether standardised assessments in the state of Victoria, Australia are actually comparable with teacher’s judgements about their students’ work to illustrate that discrepancies do exist. These results have been interpreted within an analytical framework that derives from Aristotle’s (350BC/2000) distinction between three types of knowledge, namely epistemic, technical and phronetic knowledge.

Physical education teacher training in fundamental movement skills makes a difference to instruction and assessment practices

The purpose of this study was to investigate instruction and assessment of fundamental movement skills (FMSs) by Physical Education (PE) teachers of Year 7 girls. Of 168 secondary school PE teachers, many had received little FMSs professional development, and although most assessed student FMSs proficiency, the quality of assessment was variable. Neither years of experience nor confidence influenced the quality of assessment tools used; however, greater FMSs training improved assessment practice regularity. Teachers more recently out of preservice were more confident in demonstrating FMSs. The results suggest that FMSs education for teachers should be a priority inclusion in both the training of preservice teachers and the ongoing professional development of in-service teachers.

Assessment of student development and learning in IB PYP schools

The aim of this study is to examine how International Baccalaureate (IB) Primary Years Programme (PYP) schools define the purpose of educational assessment in their assessment policies and practices. Educational assessment in this study is broadly defined to include standardized tests, and formative and summative assessment. This investigation offers a deeper understanding of the assessment cultures of eight PYP schools and provides insights into the current assessment literacy of teachers. The researchers employed a multiple case-study approach, with two phases of data collection: an online survey of teachers and detailed teacher focus groups and coordinator interviews to follow-up on themes identified in the survey. Assessment in the PYP case-study schools was described as holistic and ongoing, and involved a wide range of assessment strategies. Assessment as learning, however, emerged as an approach still in development in the schools. Teachers enthusiastically supported the development of learner profile attributes, although assessing progress in any particular attribute was regarded as challenging. Finally, while teacher feedback and student self-assessment were common practices, teachers were more equivocal about peer assessment. The authors conclude the report with a number of recommendations for further improving PYP assessment practices.