Producing the NAPLAN Machine: A Schizoanalytic Cartography

Everything revolves around desiring-machines and the production of desire… Schizoanalysis merely asks what are the machinic, social and technical indices on a socius that open to desiring-machines (Deleuze & Guattari, 1983, pp. 380-381). Achievement tests like NAPLAN are fairly recent, yet common, education policy initiatives in much of the Western world. They intersect with, use and change pre-existing logics of education, teaching and learning. There has been much written about the form and function of these tests, the ‘stakes’ involved and the effects of their practice. This paper adopts a different “angle of vision” to ask what ‘opens’ education to these regimes of testing(Roy, 2008)? This paper builds on previous analyses of NAPLAN as a modulating machine, or a machine characterised by the increased intensity of connections and couplings. One affect can be “an existential disquiet” as “disciplinary subjects attempt to force coherence onto a disintegrating narrative of self”(Thompson & Cook, 2012, p. 576). Desire operates at all levels of the education assemblage, however our argument is that achievement testing manifests desire as ‘lack’; seen in the desire for improved results, the desire for increased control, the desire for freedom, the desire for acceptance to name a few. For Deleuze and Guattari desire is irreducible to lack, instead desire is productive. As a productive assemblage, education machines operationalise and produce through desire; “Desire is a machine, and the object of the desire is another machine connected to it”(Deleuze & Guattari, 1983, p. 26). This intersection is complexified by the strata at which they occur, the molar and molecular connections and flows they make possible. Our argument is that when attention is paid to the macro and micro connections, the machines built and disassembled as a result of high-stakes testing, a map is constructed that outlines possibilities, desires and blockages within the education assemblage. This schizoanalytic cartography suggests a new analysis of these ‘axioms’ of testing and accountability. It follows the flows and disruptions made possible as different or altered connections are made and as new machines are brought online. Thinking of education machinically requires recognising that “every machine functions as a break in the flow in relation to the machine to which it is connected, but at the same time is also a flow itself, or the production of flow, in relation to the machine connected to it”(Deleuze & Guattari, 1983, p. 37). Through its potential to map desire, desire-production and the production of desire within those assemblages that have come to dominate our understanding of what is possible, Deleuze and Guattari’s method of schizoanalysis provides a provocative lens for grappling with the question of what one can do, and what lines of flight are possible.

Manipulating the data: Teaching and NAPLAN in the control society

High-stakes testing is changing what it means to be a ‘good teacher’ in the contemporary school. This paper uses Deleuze and Guattari's ideas on the control society and dividuation in the context of National Assessment Program Literacy and Numeracy (NAPLAN) testing in Australia to suggest that the database generates new understandings of the ‘good teacher’. Media reports are used to look at how teachers are responding to the high-stakes database through manipulating the data. This article argues that manipulating the data is a regrettable, but logical, response to manifestations of teaching where only the data counts.

Spinning in the NAPLAN ether: 'Postscript on the Control Societies' and the seduction of education in Australia

This paper applies concepts Deleuze developed in his ‘Postscript on the Societies of Control’, especially those relating to modulatory power, dividuation and control, to aspects of Australian schooling to explore how this transition is manifesting itself. Two modulatory machines of assessment, NAPLAN and My Schools, are examined as a means to better understand how the disciplinary institution is changing as a result of modulation. This transition from discipline to modulation is visible in the declining importance of the disciplinary teacher–student relationship as a measure of the success of the educative process. The transition occurs through seduction because that which purports to measure classroom quality is in fact a serpent of modulation that produces simulacra of the disciplinary classroom. The effect is to sever what happens in the disciplinary space from its representations in a luminiferous ether that overlays the classroom.

NAPLAN, MySchool and accountability: Teacher perceptions of the effects of testing

This paper explores Rizvi and Lingard’s (2010) idea of the “local vernacular” of the global education policy trend of using high-stakes testing to increase accountability and transparency, and by extension quality, within schools and education systems in Australia. In the first part of the paper a brief context of the policy trajectory of National Assessment Program – Literacy and Numeracy (NAPLAN) is given in Australia. In the second part, empirical evidence drawn from a survey of teachers in Western Australia (WA) and South Australia (SA) is used to explore teacher perceptions of the impacts a high-stakes testing regime is having on student learning, relationships with parents and pedagogy in specific sites. After the 2007 Australian Federal election, one of Labor’s policy objectives was to deliver an “Education Revolution” designed to improve both the equity and excellence in the Australian school system1 (Rudd & Gillard, 2008). This reform agenda aims to “deliver real changes” through: “raising the quality of teaching in our schools” and “improving transparency and accountability of schools and school systems” (Rudd & Gillard, 2008, p. 5). Central to this linking of accountability, the transparency of schools and school systems and raising teaching quality was the creation of a regime of testing (NAPLAN) that would generate data about the attainment of basic literacy and numeracy skills by students in Australian schools.

A preliminary analysis of teacher perceptions of the effects of NAPLAN on pedagogy and curriculum

This paper reports preliminary survey findings of Western Australian and South Australian teacher perceptions of the impact of NAPLAN on curriculum and pedagogy in their classroom and school. The paper examines how teachers perceive the effects of NAPLAN on curriculum and pedagogy and whether these perceptions mediated by the teacher’s gender, the socioeconomics of the school, the State and the school system in which the teacher works. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way to the class environment and the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus, a return to teacher-centred instruction and a decrease in motivation. Analysis suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum based on the characteristics of which State the teacher taught in, the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).

Performance pay for Australian teachers: A critical policy historiography

In May 2011, the Australian Federal Education Minister announced there would be a unique, innovative and new policy of performance pay for teachers, Rewards for Great Teachers (Garrett, 2011a). In response, this paper uses critical policy historiography to argue that the unintended consequences of performance pay for teachers makes it unlikely it will deliver improved quality or efficiency in Australian schools. What is new, in the Australian context, is that performance pay is one of a raft of education policies being driven by the federal government within a system that constitutionally and historically has placed the responsibility for schooling with the states and territories. Since 2008, a key platform of the Australian federal Labor government has been a commitment to an Education Revolution that would promote quality, equity and accountability in Australian schools. This commitment has resulted in new national initiatives impacting on Australian schools including a high-stakes testing regime 14 National Assessment Program 13 Literacy and Numeracy (NAPLAN) 14a mandated national curriculum (the Australian Curriculum), professional standards for teachers and teacher accreditation 14Australian Institute for Teaching and School Leadership (AITSL) 14and the idea of rewarding excellent teachers through performance pay (Garrett, 2011b). These reforms demonstrate the increased influence of the federal government in education policy processes and the growth of a 1Ccoercive federalism 1D that pits the state and federal governments against each other (Harris-Hart, 2010). Central to these initiatives is the measuring, or auditing, of educational practices and relationships. While this shift in education policy hegemony from state to federal governments has been occurring in Australia at least since the 1970s, it has escalated and been transformed in more recent times with a greater emphasis on national human capital agendas which link education and training to Australia 19s international economic competitiveness (Lingard & Sellar, in press). This paper uses historically informed critical analysis to critique claims about the effects of such policies. We argue that performance pay has a detailed and complex historical trajectory both internationally and within Australian states. Using Gale 19s (2001) critical policy historiography, we illuminate some of the effects that performance pay policies have had on education internationally and in particular within Australia. This critical historical lens also provides opportunities to highlight how teachers have, in the past, tactically engaged with such policies.

The effects of NAPLAN: Teacher perceptions of the impact of NAPLAN on pedagogy and curriculum

This paper reports preliminary findings of a survey of in-service teachers in WA and SA conducted in 2012. Participants completed an online survey open to all teachers in WA and SA. The survey ran for three months from April to June 2012. One section of the survey asked teachers to report their perceptions of the impact that NAPLAN has had on the curriculum and pedagogy of their classroom and school. Two principal research questions were addressed in this preliminary analysis. First what are teacher perceptions of the effects on NAPLAN on curriculum and pedagogy? Second, are there any interaction effects between gender, socioeconomics status, location and school system on teachers perceptions? Statistical analyses examined one- and two-way MANOVA to assess main effects and interaction effects on teachers' global perceptions. These were followed by a series of exploratory one- and two-way ANOVA of specific survey items to suggest potential sources for differences among teachers from different socioeconomic regions, states and systems. Teachers report that they are either choosing or being instructed to teach to the test, that this results in less time being spent on other curriculum areas and that these effects contribute in a negative way on the engagement of students. This largely agrees with a body of international research that suggests that high-stakes literacy and numeracy tests often results in unintended consequences such as a narrow curriculum focus (Au, 2007), a return to teacher-centred instruction (Barret, 2009) and a decrease in motivation (Ryan & Wesinstein, 2009). Preliminary results from early survey respondents suggests there is a relationship between participant responses to the effect of NAPLAN on curriculum and pedagogy based on the characteristics of which State the teacher taught in, their perceptions of the socioeconomic status of the school and the school system in which they were employed (State, Catholic, and Independent).

The right to a voice and the fight to be heard: The experience of being an ESL user in Australia

This paper focuses on the fundamental right to be heard, that is, the right to have one’s voice heard and listened to – to impose reception (Bourdieu, 1977). It focuses on the ways that non-mainstream English is heard and received in Australia, where despite public policy initiatives around equal opportunity, language continues to socially disadvantage people (Burridge & Mulder, 1998). English is the language of the mainstream and most people are monolingually English (Ozolins, 1993). English has no official status yet it remains dominant and its centrality is rarely challenged (Smolicz, 1995). This paper takes the position that the lack of language engagement in mainstream Australia leads to linguistic desensitisation. Writing in the US context where English is also the unofficial norm, Lippi-Green (1997) maintains that discrimination based on speech features or accent is commonly accepted and widely perceived as appropriate. In Australia, non-standard forms of English are often disparaged or devalued because they do not conform to the ‘standard’ (Burridge & Mulder, 1998). This paper argues that talk cannot be taken for granted: ‘spoken voices’ are critical tools for representing the self and negotiating and manifesting legitimacy within social groups (Miller, 2003). In multicultural, multilingual countries like Australia, the impact of the spoken voice, its message and how it is heard are critical tools for people seeking settlement, inclusion and access to facilities and services. Too often these rights are denied because of the way a person sounds. This paper reports a study conducted with a group that has been particularly vulnerable to ongoing ‘panics’ about language – international students. International education is the third largest revenue source for Australia (AEI, 2010) but has been beset by concerns from academics (Auditor-General, 2002) and the media about student language levels and falling work standards (e.g. Livingstone, 2004). Much of the focus has been high-stakes writing but with the ascendancy of project work in university assessment and the increasing emphasis on oracy, there is a call to recognise the salience of talk, especially among students using English as a second language (ESL) (Kettle & May, 2012). The study investigated the experiences of six international students in a Master of Education course at a large metropolitan university. It utilised data from student interviews, classroom observations, course materials, university policy documents and media reports to examine the ways that speaking and being heard impacted on the students’ learning and legitimacy in the course. The analysis drew on Fairclough’s (2003) model of the dialectical-relational Critical Discourse Analysis (CDA) to analyse the linguistic, discursive and social relations between the data texts and their conditions of production and interpretation, including the wider socio-political discourses on English, language difference, and second language use. The interests of the study were if and how discourses of marginalisation and discrimination manifested and if and how students recognised and responded to them pragmatically. Also how they juxtaposed with and/or contradicted the official rhetoric about diversity and inclusion. The underpinning rationale was that international students’ experiences can provide insights into the hidden politics and practices of being heard and afforded speaking rights as a second language speaker in Australia.

Re-thinking teacher quality in high-poverty schools in Australia

As is the case globally, Australian schools that serve high-poverty communities most often employ the least experienced, least prepared teachers. Beginning with a discussion of poverty in Australia this chapter draws on 6 years of learnings from Australia's National Exceptional Teachers for Disadvantaged Schools (NETDS) program to examine how social justice can be taught within a mainstream Initial Teacher Education program in an increasingly neoliberal climate where teacher education curriculum around social justice struggles to find a place within the current discourses of quality teaching and its preoccupations with standards, accountability, and high-stakes testing.

A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement

The outcomes of educational assessments undoubtedly have real implications for students, teachers, schools and education in the widest sense. Assessment results are, for example, used to award qualifications that determine future educational or vocational pathways of students. The results obtained by students in assessments are also used to gauge individual teacher quality, to hold schools to account for the standards achieved by their students, and to compare international education systems. Given the current high-stakes nature of educational assessment, it is imperative that the measurement practices involved have stable philosophical foundations. However, this paper casts doubt on the theoretical underpinnings of contemporary educational measurement models. Aspects of Wittgenstein’s later philosophy and Bohr’s philosophy of quantum theory are used to argue that a quantum theoretical rather than a Newtonian model is appropriate for educational measurement, and the associated implications for the concept of validity are elucidated. Whilst it is acknowledged that the transition to a quantum theoretical framework would not lead to the demise of educational assessment, it is argued that, where practical, current high-stakes assessments should be reformed to become as ‘low-stakes’ as possible. The paper also undermines some of the pro high-stakes testing rhetoric that has a tendency to afflict education.

The "freedom to frame questions... worth asking" or three stories and three (other) fragments of research

In our state of centralised control of the curriculum and high-stakes testing an examination subject's assessment objectives have become high profile. Some of the anomalous effects of this profile are shown in the teaching, question-setting, and marking of English literature. Glimpses of earlier times are revealed, all three secondary school key stages are considered, examination performances are discussed, and the views of beginning teachers about teaching to the test are sought.

High leverage interventions: three cases of defensive action and their lessons for OR/MS today.

This paper has two aims. First, to present cases in which scientists developed a defensive system for their homeland: Blackett and the air defense of Britain in WWII, Forrester and the SAGE system for North America in the Cold War, and Archimedes’ work defending Syracuse during the Second Punic War. In each case the historical context and the individual’s other achievements are outlined, and a description of the contribution’s relationship to OR/MS is given. The second aim is to consider some of the features the cases share and examine them in terms of contemporary OR/MS methodology. Particular reference is made to a recent analysis of the field’s strengths and weaknesses. This allows both a critical appraisal of the field and a set of potential responses for strengthening it. Although a mixed set of lessons arise, the overall conclusion is that the cases are examples to build on and that OR/MS retains the ability to do high stakes work.

Reframing conceptions of contemporary literacy capabilities in pre-service primary teacher education

This chapter describes the challenges of integrating new technologies with literacy education in pre-service primary teacher education in Australia. The authors describe the policy context and regulatory mechanisms controlling pre-service education, including a national set of professional standards for graduate teachers, a new national curriculum for school students, the introduction of high stakes national assessment for school students, and the looming threat of decontextualized back-to-the-basics professional entry tests for aspiring teachers. The chapter includes three case studies of the authors’ pedagogical practices that attempt to reframe conceptions of the literacy capabilities of pre-service teachers to reflect the complex and sophisticated requirements of teachers in contemporary schooling. The authors conclude the chapter with a discussion of the implications of these case studies as they illustrate the ways that pre-service teachers can be scaffolded and supported to develop creative capacity and critical awareness of the kinds of literacies required in the digital age despite restrictive regimes.

Closing the emergency facility: Moving schools from literacy triage to better literacy outcomes

This article focuses on the tensions between national and international testing, educational policy and professionalism for middle school English teachers. I argue that state and federal government(s) are responding to the impact of Australia's falling results on the international testing in PISA (Programme for International Student Assessment) through the usage of their own testing program, the National Assessment Program for Literacy and Numeracy (NAPLAN). The publication of NAPLAN results on the MySchool website in a searchable and comparable form has been detrimental to many schools and has pushed these schools into "emergency mode", as they struggle to improve their scores. At the same time, the results from recent PISA examinations reveal extensive inequities in educational outcomes across Australia, as well as some consistent general trends in the Australian data. I use the metaphor of the hospital emergency department to explore this situation. Drawing on Sahlberg's (2011) notion of the Global Educational Reform Movement (GERM), I explore this metaphor becoming a pandemic. I draw on Gillborn and Youdell's (2000) usage of educational triage and cast different and multiple educational professionals playing the role of the triage nurse-the alternate federal and state government education ministers responding to international and state test results in triage; and principals of poor performing schools operating their school as though it is an emergency department; poor literacy results triaged Code Red receiving immediate focus and attention, but "treated" in terms of immediate survival and a focus on basic skills. I argue that the international testing provides better markers for how we are doing as a nation, and what might be done to improve our international standing with respect to our literacy scores. I argue that true gains in literacy and the development of more complex literacy skills are not made through triaging literacy through an emergency department, but through a long-term focus on school redesign.