Data-driven accountability in Australia : an unfolding story with lessons for leaders

Throughout the world, state and nation standardised testing of children, has become a "huge industry" (English, 2002). Although English is referring to the American system which has been involved in standardised testing for over half a century, the same could be said of many other countries, including Australia. It has been only in recent years that Australia has embraced national testing as part of a wider reform effort to bring about increased accountability in schooling. The results of high-stakes tests in Australia are now published in newspapers and electronically on the Australian federal government's MySchool website (www.myschoold.edu.au). MySchool provides results on the National Assessment Program - Literacy and Numeracy (NAPLAN) for students in Years 3,5, 7 and 9. Data are available that compare schools to statistically similar schools. This more recent publication of national testing results in Australia is a visible example of "contractual accountability", described by Mulford, Edmunds, Kendall, Kendall and Bishop (2008) as " the degree to which [actors] are fulfilling the expectations of particular audiences in terms of standards, outcomes and results" (p.20).

A case for addressing the literacy demands of student assessment

The development and implementation of the Australian Curriculum together with national testing of students and the publication of school results place new demands on teachers. In this article we address the importance of teachers becoming attuned to the silent assessors in assessment generally and in the National Literacy and Numeracy Program (NAPLAN) more specifically. Using the concept of literacies, we develop a method to conduct a literacy audit of assessment tasks that teachers can use to help both themselves and their students. Providing assistance to students as a consequence of such an audit is imperative to improve the outcomes for students and to address issues of equity.

…Where did I lose you? Accessing the literacy demands of assessment

In this study we sought to find out how teachers could make assessment fairer for Indigenous students in learning mathematics, given the context of the high stakes of the National Assessment Program Literacy and Numeracy (NAPLAN). Today, teachers are experiencing the full range of demands from their own students who require individual attention, through to system level expectations of improved performances for all students. Many staff experience reform fatigue with limited time for critical reflection and a reduction in support for the use and the analysis of the overwhelming amount of data that has become available in recent years. Over the past three years we worked with teachers in seven schools to gradually refine our research focus to centre on how we might best support teachers in this demanding context with the important outcome of improved teaching and learning of mathematics with particular consideration of how to respond to the cultural needs of Indigenous (Aboriginal and Torres Strait Islander) students.

Listening skill requires a further look into second/foreign language learning

Current English-as-a-second and foreign-language (ESL/EFL) research has encouraged to treat each communicative macroskill separately due to space constraint, but the interrelationship among these skills (listening, speaking, reading, and writing) is not paid due attention. This study attempts to examine first the existing relationship among the four dominant skills, second the potential impact of reading background on the overall language proficiency, and finally the relationship between listening and overall language proficiency as listening is considered an overlooked/passive skill in the pedagogy of the second/foreign language classroom. However, the literature in language learning has revealed that listening skill has salient importance in both first and second language learning. The purpose of this study is to investigate the role of each of four skills in EFL learning and their existing interrelationships in an EFL setting. The outcome of 701 Iranian applicants undertaking International English Language Testing System (IELTS) in Tehran demonstrates that all communicative macroskills have varied correlations from moderate (reading and writing) to high (listening and reading). The findings also show that the applicants’ reading history assisted them in better performing at high stakes tests, and what is more, listening skill was strongly correlated with the overall language proficiency.

Low SES primary school students engaging in an after-school robotics program

Recent attention in education within many western contexts has focused on improved outcomes for students, with a particular focus on closing the gap between those who come from disadvantaged backgrounds and the rest of the student population. Much of this attention has supported a set of simplistic solutions to improving scores on high stakes standardized tests. The collateral damage (Nichols & Berliner, 2007) of such responses includes a narrowing of the curriculum, plateaus in gain scores on the tests, and unproductive blame games aimed by the media and politicians at teachers and communities (Nichols & Berliner, 2007; Synder, 2008). Alternative approaches to improving the quality and equity of schooling remain as viable alternatives to these measures. As an example in a recent study of school literacy reform in low SES schools, Luke, Woods and Dooley (2011) argued for the increase of substantive content and intellectual quality of the curriculum as a necessary means to re-engaging middle school students, improving outcomes of schooling and achieving a high quality, high equity system. The MediaClub is an afterschool program for students in years 4 to 7 (9-12 year old) at a primary school in a low SES area of a large Australian city. It is run as part of an Australian Research Council funded research project. The aim of the program has been to provide an opportunity for students to gain expertise in digital technologies and media literacies in an afterschool setting. It was hypothesized that this expertise might then be used to shift the ways of being literate that these students had to call on within classroom teaching and learning events. Each term, there is a different focus on digital media, and information and communication technology (ICT) activities in the MediaClub. The work detailed in this chapter relates to a robotics program presented as one of the modules within this afterschool setting. As part of the program, the participants were challenged to find creative solutions to problems in a constructivist-learning environment.

Researching quality and equity in assessment for improved learner outcomes

Quality and equity issues as they relate to assessment practices and policy are becoming increasingly important as Australia introduces a national curriculum and achievement standards. In a context of high-stakes accountability, concerns regarding equity and quality have important implications for teachers‘ practice for the improvement of learner outcomes. This article is based on three research projects that were conducted over the past four years and were funded by the Australian Federal Government. The research focus, emergent questions, the educational contexts, and the rationale for the studies are discussed prior to the presentation of the analysis of the research findings and the implications for teachers‘ practice and policy reform.

Creativity is as important as literacy : making a film trailer responding to literature

The first part of the title is from Sir Ken Robinson (Robinson, 2009), the esteemed educator and champion of creativity in schools. Sometimes in the face of meeting the demands of time, timetabling, demanding administration tasks and teaching for high stakes testing accountability, we can find ourselves desperate for time to remember that English has always been one of the places in schools where creativity can flourish. English is a place for the play of the imagination. English teachers are the purveyors of narrative; the keepers and teachers of stories. The new Australian Curriculum: English, (Australian Curriculum and Assessment Reporting Authority (ACARA), 2012) asks us to be using ICT technologies in creative ways to tell those stories. The curriculum asks students to access texts receptively and to then speak about, write and create texts productively. There are so many interesting things to do with texts beyond word processing of print based resources. Responding to literature through media is always an alternative option to writing or simply speaking about it. In this paper my QUT pre-service student Chrystal Armitage describes how she made a mini story via a film trailer in response to a short story, ‘Turned’ (Gilman, 1987) in the unit, Literature in Secondary Teaching.

School culture matters

Schools today are subjected to a vast array of accountability measures including professional standards and high-stakes testing, to name but two. These measures and the implementation of new curricula inevitably result in change and put pressure on schools and teachers to perform. During these times of change, a positive school culture can make a difference for all school stakeholders: staff, students and parents. As a school leader, what can you do to ensure a positive school culture is maintained in your school environment during these changing times?

Assessing the damage caused by deepwater horizon : not just another Exxon Valdez

In light of the high stakes of the deepwater horizon civil trial and the important precedent-setting role that the case will have on the assessment of future marine disasters, the methodologies underpinning the calculations of damage on both sides will be subjected to considerable scrutiny. Despite the importance of the case, however, there seems to be a pronounced lack of convergence about it in the academic literature. Contributions from scientific journals frequently make comparisons to the Ixtoc I oil spill off the coast of Mexico in 1979; the legal literature, by stark contrast, seems to be much more focused on the Exxon Valdez spill that occurred off the shores of Alaska in 1989. This paper accordingly calls for a more thorough consideration of other analogs beyond the Exxon Valdez spill—most notably, the Ixtoc I incident—in arriving at an assessment of the damage caused by the Deepwater Horizon disaster.

Over time assessment data analysis tracking a school's on-going performance

In Australia, as in some other western nations, governments impose accountability measures on educational institutions (Earl, 2005). One such accountability measure is the National Assessment Program - Literacy and Numeracy (NAPLAN) from which high-stakes assessment data is generated. In this article, a practical method of data analysis known as the Over Time Assessment Data Analysis (OTADA) is offered as an analytical process by which schools can monitor their current and over time performances. This analysis developed by the author, is currently used extensively in schools throughout Queensland. By Analysing in this way, teachers, and in particular principals, can obtain a quick and insightful performance overview. For those seeking to track the achievements and progress of year level cohorts, the OTADA should be considered.

Incongruence between self-reported and observed senior physical education teaching styles : an analysis using Mosston and Ashworth’s spectrum

Pedagogical styles, methods, models, practices or strategies are valued for what they claim they can achieve. In recent times curriculum documents and governments have called for a range of teaching approaches to meet the variety of learner differences and allow students to make more independent decision making in physical education (Hardy and Mawer, 1999). One well known system of categorizing teaching styles is the Mosston and Ashworth’s Spectrum of Teaching Styles (2002). In Queensland, prior to 2005, no research had been conducted on the teaching styles used by teachers of Physical Education. However, many teachers self-reported that they employed a variety of teaching styles depending on the aims and content of the material to be taught (Cothran, et al., 2005). This research, for the first time, collected teacher’s self-reported use of teaching styles and through observations verify the styles that were being used to teach Senior Physical Education in Queensland. More specifically the aims of the research were to determine: a) What teaching styles teachers of Senior Physical Education in Queensland believe they use? i) Were they using a range of teaching styles? ii) Were teachers of Senior Physical Education in Queensland using teaching styles that the Queensland Senior Physical Education Syllabus (2004) required? b) If Mosston and Ashworth’s (2002) Spectrum of Teaching Styles were used to categorise styles observed during the teaching of Senior Physical Education did the styles being used provide opportunities for evaluating as described by the Queensland Senior Physical Education Syllabus (2004)? The research was conducted in two phases. Part A involved use of a questionnaire to determine the teaching styles Queensland teachers of Senior Physical Education reported using and how often they reported using them. The questionnaire was administered to 110 teachers throughout Queensland. The sample was determined from 346 schools teaching Senior Physical Education (in 2006) across the state of Queensland, Australia. 286 questionnaires were sent to 77 non-randomised schools. There were 66 male and 44 female respondents in the sample. A wide range of teaching styles were reportedly used by teachers of Senior Physical Education with Practice Style-Style B, Command Style-Style A and Divergent Discovery Style-Style H, the most reportedly used. The Self-Teaching Style-Style K was reportedly used the least by teachers involved in this study. From the respondents a group of teachers were identified to form the participants for Part B. Part B of the study involved observation of a group of volunteer participants (from those who had completed the questionnaire) who displayed many of the ‘typical’ characteristics, and a cross-section of backgrounds, of teachers of Senior Physical Education in Queensland. In the case of this study, the criteria used to select the group of teachers to be observed teaching were, teaching experience (number of years: 0-4, 5-10 and 11 years and over), gender, geographical location of schools (focused on Brisbane and near area for travel/access purposes), profile of the students at schools (girls, boys or co-educational), nature of school (Government or Private) and the physical activities being taught in a school (activities to reflect all the areas of physical activity outlined within the syllabus). A total of 27 questionnaire respondents from Part A indicated that they were willing to be observed teaching practical lessons. The respondents who volunteered to be involved in Part B of the study came from different regions across the state of Queensland and was not confined to the Brisbane metropolitan area or large cities. From the group of people who volunteered for Part B four came from outside Brisbane and 23 from the Brisbane area. The final observation group of nine participants included eight teachers from the Brisbane area and one from a rural area. The characteristics of the final group included three females and six males from private and public schools with a range of teaching experience in years and a range of physical activities. Four year 12 and five year 11 teachers and their classes were videoed on three occasions as they progressed through an eight – nine week unit of work. This resulted in 24 hours 48 minutes and 20 seconds (or 4465 observations) of video teaching data which was subsequently coded by several researchers (99% interobserver reliability) to determine the teaching styles employed by the participants. This research indicated that, based on Mosston and Ashworth’s (2002) Spectrum of Teaching Styles, teachers of Senior Physical Education in Queensland used predominantly one style to teach 27 observed lessons. This is in sharp contrast to the variety of styles 110 teachers self- reportedly used and in spite of the Queensland Senior Physical Education Syllabus (2004) suggesting a range of specific styles be used. These results are discussed in the context of the Queensland Senior Physical Education Syllabus (2004), teacher knowledge of teaching styles and high-stakes curriculum and external pressures such as national testing and the publication of data from schools in tabloid newspapers. The data and findings in this research provide a rationale for improving teacher knowledge regarding teaching styles and the need for a clear definition of terminology in syllabus documents. Careful examination of the effects that the publishing of school data may have on teaching styles is advised. This research not only collected teacher’s perceptions of the teaching styles they believed they used it also verified these claims through direct observations of the teachers while teaching. These findings are relevant to syllabus writers, teacher educators, policy makers within education and teachers.

Professional development on-site and in context at Narangba Valley SHS

The implementation of the National Professional Standards for Teachers (Australian Institute for Teaching and School Leadership (AITSL), 2011) will require all teachers to undertake 30 hours per year of professional development (PD) to maintain thei registration. However, defining what constitutes effective PD s complex. This article discusses an approach used by Narangba Valley State High School (SHS) in Queensland which involves effective on-site PD, resulting in improved student outcomes. In addition to the school-administered growth and learning (GAL) plans for each teacher, the school worked collaboratively with an external person (university lecturer) and implemented an effective, sustainable, whole-school approach to PD which was ongoing, on time, on task, on the mark, and on-the-spot (Jetnikoff & Smeed, 2012). The article unpacks an interview with Ross Mackay, the Narangba Valley SHS executive-principal and one of the authors of this paper, and provides practical advice for other school leaders wishing to implement a similar approach to PD.

Towards fairer assessment

Drawing on the largest Australian collection and analysis of empirical data on multiple facets of Aboriginal and Torres Strait Islander education in state schools to date, this article critically analyses the systemic push for standardized testing and improved scores, and argues for a greater balance of assessment types by providing alternative, inclusive, participatory approaches to student assessment. The evidence for this article derives from a major evaluation of the Stronger Smarter Learning Communities. The first large-scale picture of what is occurring in classroom assessment and pedagogy for Indigenous students is reported in this evaluation yet the focus in this article remains on the issue of fairness in student assessment. The argument presented calls for “a good balance between formative and summative assessment” (OECD, Synergies for Better Learning An International Perspective on Evaluation and Assessment, Pointers for Policy Development, 2013) at a time of unrelenting high-stakes, standardized testing in Australia with a dominance of secondary as opposed to primary uses of NAPLAN data by systems, schools and principals. A case for more “intelligent accountability in education” (O’Neill, Oxford Review of Education 39(1):4–16, 2013) together with a framework for analyzing efforts toward social justice in education (Cazden, International Journal of Educational Psychology 1(3):178–198, 2012) and fairer assessment make the case for more alternative assessment practices in recognition of the need for teachers’ pedagogic practice to cater for increased diversity.

The spatialized practices of teaching writing in Australian elementary schools : diverse students shaping discoursal selves

This paper discusses the teaching of writing within the competing and often contradictory spaces of high-stakes testing and the practices and priorities around writing pedagogy in diverse school communities. It uses socio-spatial theory to examine the real-and-imagined spaces (Soja, 1996) that influence and are influenced by teachers’ pedagogical priorities for writing in two linguistically diverse elementary school case studies. Methods of critical discourse analysis are used to examine rich data sets to make visible the discourses and power relations at play in the case schools. Findings show that when teachers’ practices focus on the teaching of structure and skills alongside identity building and voice, students with diverse linguistic backgrounds can produce dramatic, authoritative and resonant texts. The paper argues that “thirdspaces” can be forged that both attend to accountability requirements, yet also give the necessary attention to more complex aspects of writing necessary for students from diverse and multilingual backgrounds to invest in writing as a creative and critical form of communication for participation in society and the knowledge economy.

Bilingualism, literacy and NAPLAN : ongoing challenges for EAL/D education [Editorial]

Advocacy is integral to the work of many TESOL specialists. For several decades, ACTA and the state TESOL associations, along with other professional associations, and individual teachers, researchers and administrators have all engaged with conversations about EAL/D education in public forums. These advocates have drawn attention to implications of policy developments for EAL/D students; they have proffered alternative forms of curriculum, pedagogy and assessment to better account for the particularity of EAL/D learning pathways; they have argued the necessity of specialist EAL/D teaching. In response to the Australian Language and Literacy Policy of the early 1990s, for example, there was “a frenzy of writing responses… a conference… and attempts to publicise what was going on through the press and television” (Moore, 1995, p. 6). It is in this spirit that this double issue of TESOL in Context has been compiled...