Interactional competence in a paired speaking test : features salient to raters

Paired speaking tests are now commonly used in both high-stakes testing and classroom assessment contexts. The co-construction of discourse by candidates is regarded as a strength of paired speaking tests, as candidates have the opportunity to display a wider range of interactional competencies, including turn taking, initiating topics and engaging in extended discourse with a partner, rather than an examiner. However, the impact of the interlocutor in such jointly negotiated discourse and the implications for assessing interactional competence are areas of concern. This article reports on the features of interactional competence that were salient to four trained raters of 12 paired speaking tests through the analysis of rater notes, stimulated verbal recalls and rater discussions. Findings enabled the identification of features of the performance noted by raters when awarding scores for interactional competence, and the particular features associated with higher and lower scores. A number of these features were seen by the raters as mutual achievements, which raises the issue of the extent to which it is possible to assess individual contributions to the co-constructed performance. The findings have implications for defining the construct of interactional competence in paired speaking tests and operationalising this in rating scales.

A case for addressing the literacy demands of student assessment

The development and implementation of the Australian Curriculum together with national testing of students and the publication of school results place new demands on teachers. In this article we address the importance of teachers becoming attuned to the silent assessors in assessment generally and in the National Literacy and Numeracy Program (NAPLAN) more specifically. Using the concept of literacies, we develop a method to conduct a literacy audit of assessment tasks that teachers can use to help both themselves and their students. Providing assistance to students as a consequence of such an audit is imperative to improve the outcomes for students and to address issues of equity.

Teachers’ perceptions of the use of an external change agent in school curriculum change

An external change agent (ECA) was recently employed in three Queensland schools to align the school curriculum with the requirements of the state’s high stakes test known as the Queensland Core Skills test (QCS). This paper reports on the teachers’ perceptions of a change process led by an ECA. With the ever-increasing implementation of high stakes testing in Australian schools, teachers are under mounting pressure to produce ‘results’. Therefore, in order to maximise their students’ success in these tests, schools are altering their curricula to incorporate the test requirements. Rather than the traditional method of managing such curriculum change processes internally, there is a growing trend for principals to source external expertise in the form of ECAs. Although some academics, teachers, and much of the relevant literature, would regard such a practice as problematic, this study found that in fact, teachers were quite open to externally led curriculum change, especially if they perceived the leader to be knowledgeable and creditable in this area.

Data analysis skills for teachers

Although accountability in the form of high stakes testing is in favour in the contemporary Australian educational context, this practice remains a highly contested source of debate. Proponents for high stakes tests claim that higher standards in teaching and learning result from their implementation, whereas others believe that this type of testing regime is not required and may even in fact be counterproductive. Regardless of what side of the debate you sit on, the reality is that at present, high stakes testing appears to be here to stay. It could therefore be argued it is essential that teachers understand accountability and possess the specific skills to interpret and use test data beneficially.

Creativity is as important as literacy : making a film trailer responding to literature

The first part of the title is from Sir Ken Robinson (Robinson, 2009), the esteemed educator and champion of creativity in schools. Sometimes in the face of meeting the demands of time, timetabling, demanding administration tasks and teaching for high stakes testing accountability, we can find ourselves desperate for time to remember that English has always been one of the places in schools where creativity can flourish. English is a place for the play of the imagination. English teachers are the purveyors of narrative; the keepers and teachers of stories. The new Australian Curriculum: English, (Australian Curriculum and Assessment Reporting Authority (ACARA), 2012) asks us to be using ICT technologies in creative ways to tell those stories. The curriculum asks students to access texts receptively and to then speak about, write and create texts productively. There are so many interesting things to do with texts beyond word processing of print based resources. Responding to literature through media is always an alternative option to writing or simply speaking about it. In this paper my QUT pre-service student Chrystal Armitage describes how she made a mini story via a film trailer in response to a short story, ‘Turned’ (Gilman, 1987) in the unit, Literature in Secondary Teaching.

School culture matters

Schools today are subjected to a vast array of accountability measures including professional standards and high-stakes testing, to name but two. These measures and the implementation of new curricula inevitably result in change and put pressure on schools and teachers to perform. During these times of change, a positive school culture can make a difference for all school stakeholders: staff, students and parents. As a school leader, what can you do to ensure a positive school culture is maintained in your school environment during these changing times?

The effects of standardised assessment (NAPLAN) on teacher pedagogy at two Queensland schools

The purpose of this qualitative interpretative case study was to explore how the National Assessment Program – Literacy and Numeracy (NAPLAN) requirements may be affecting pedagogies of two Year 3, Year 5 and Year 7 teachers at two Queensland schools. The perceived problem was that standardised assessment NAPLAN practices and its growing status as a key measure of education quality throughout Australia has the potential to limit the everyday literacy and numeracy practices of teachers to instructional methods primarily focused on teaching to the test. The findings demonstrate how increased explicit teaching of NAPLAN content and procedural knowledge prior to testing has the potential to negatively impact on the teaching of everyday literacy and numeracy skills and knowledge that extend beyond those concerned with NAPLAN. Such teaching limited opportunity for what teachers reported as valued collaborative learning contexts aiming for long-term literacy and numeracy results.

The spatialized practices of teaching writing in Australian elementary schools : diverse students shaping discoursal selves

This paper discusses the teaching of writing within the competing and often contradictory spaces of high-stakes testing and the practices and priorities around writing pedagogy in diverse school communities. It uses socio-spatial theory to examine the real-and-imagined spaces (Soja, 1996) that influence and are influenced by teachers’ pedagogical priorities for writing in two linguistically diverse elementary school case studies. Methods of critical discourse analysis are used to examine rich data sets to make visible the discourses and power relations at play in the case schools. Findings show that when teachers’ practices focus on the teaching of structure and skills alongside identity building and voice, students with diverse linguistic backgrounds can produce dramatic, authoritative and resonant texts. The paper argues that “thirdspaces” can be forged that both attend to accountability requirements, yet also give the necessary attention to more complex aspects of writing necessary for students from diverse and multilingual backgrounds to invest in writing as a creative and critical form of communication for participation in society and the knowledge economy.

Bilingualism, literacy and NAPLAN : ongoing challenges for EAL/D education [Editorial]

Advocacy is integral to the work of many TESOL specialists. For several decades, ACTA and the state TESOL associations, along with other professional associations, and individual teachers, researchers and administrators have all engaged with conversations about EAL/D education in public forums. These advocates have drawn attention to implications of policy developments for EAL/D students; they have proffered alternative forms of curriculum, pedagogy and assessment to better account for the particularity of EAL/D learning pathways; they have argued the necessity of specialist EAL/D teaching. In response to the Australian Language and Literacy Policy of the early 1990s, for example, there was “a frenzy of writing responses… a conference… and attempts to publicise what was going on through the press and television” (Moore, 1995, p. 6). It is in this spirit that this double issue of TESOL in Context has been compiled...

A controlled, rapid approach to curriculum change

Teachers are continually bombarded with change programs for improvements in areas such as literacy and numeracy, however; the focus is often on the program and not on results (Pertuzé, Calder, Greitzer & Lucas, 2010). When the inevitable failure follows (Fullan, 2005; Gross, Giacquinta & Bernstein, 1971)the school moves on to a new activities-based model.

Literacy and Digital Culture in the Early Years

In this chapter we present data drawn from observations of kindergarten children using iPads and talk with the children, their parents/guardians and teachers. We identify a continuum of practices that extends from ‘educational apps’ teaching handwriting, sight words and so forth to uses of the iPad as a device for multimodal literacy development and substantive conversation around children’s creative work. At the current time high stakes testing and the implementation of the Australian Curriculum are prompting new public and professional conversations about literacy and digital technology. The iPad is construed as both cause of and solution to problems of traditional literacy education. In this context we describe the literacies enabled by educational software available on iPads. We higlight the time constraints which bore on teachers' capacity to enact their visions of literacy education through the iPad platform and suggest ways of reflecting on responses to this constraint.

An exploratory study of the current assessment practices for improving the learning of English as a foreign language (EFL) in two Vietnamese universities

This case study investigated EFL assessment practices at one public and one private university to explore the support of assessment for English language learning (ELL) within the Vietnamese sociocultural context. Findings demonstrated the potential of assessment to engage students in learning; enhance their understanding of the learning objectives; and facilitate their learning reflection. Findings also identified strong influences of contextual factors such as teachers' language assessment literacy, high-stakes testing and institutional administrative policies on the practices of assessment for ELL. This study contributes to research on Assessment for Learning and EFL education at tertiary level in Vietnam and other similar sociocultural contexts.

Producing the NAPLAN Machine: A Schizoanalytic Cartography

Everything revolves around desiring-machines and the production of desire… Schizoanalysis merely asks what are the machinic, social and technical indices on a socius that open to desiring-machines (Deleuze & Guattari, 1983, pp. 380-381). Achievement tests like NAPLAN are fairly recent, yet common, education policy initiatives in much of the Western world. They intersect with, use and change pre-existing logics of education, teaching and learning. There has been much written about the form and function of these tests, the ‘stakes’ involved and the effects of their practice. This paper adopts a different “angle of vision” to ask what ‘opens’ education to these regimes of testing(Roy, 2008)? This paper builds on previous analyses of NAPLAN as a modulating machine, or a machine characterised by the increased intensity of connections and couplings. One affect can be “an existential disquiet” as “disciplinary subjects attempt to force coherence onto a disintegrating narrative of self”(Thompson & Cook, 2012, p. 576). Desire operates at all levels of the education assemblage, however our argument is that achievement testing manifests desire as ‘lack’; seen in the desire for improved results, the desire for increased control, the desire for freedom, the desire for acceptance to name a few. For Deleuze and Guattari desire is irreducible to lack, instead desire is productive. As a productive assemblage, education machines operationalise and produce through desire; “Desire is a machine, and the object of the desire is another machine connected to it”(Deleuze & Guattari, 1983, p. 26). This intersection is complexified by the strata at which they occur, the molar and molecular connections and flows they make possible. Our argument is that when attention is paid to the macro and micro connections, the machines built and disassembled as a result of high-stakes testing, a map is constructed that outlines possibilities, desires and blockages within the education assemblage. This schizoanalytic cartography suggests a new analysis of these ‘axioms’ of testing and accountability. It follows the flows and disruptions made possible as different or altered connections are made and as new machines are brought online. Thinking of education machinically requires recognising that “every machine functions as a break in the flow in relation to the machine to which it is connected, but at the same time is also a flow itself, or the production of flow, in relation to the machine connected to it”(Deleuze & Guattari, 1983, p. 37). Through its potential to map desire, desire-production and the production of desire within those assemblages that have come to dominate our understanding of what is possible, Deleuze and Guattari’s method of schizoanalysis provides a provocative lens for grappling with the question of what one can do, and what lines of flight are possible.

Education and the relation to the outside: A little real reality

One of the aims of Deleuze. Guattari. Schizoanalysis. Education. is to focus on the radical reconfiguration that education is undergoing, impacting educator, administrator, institution and ‘sector’ alike. More to the point, it is the responses to that process of reconfiguration - this newly emerging assemblage - that are a key focal point in this issue. Essential to these responses, we propose, is Deleuze and Guattari’s method of schizonalysis, which offers a way to not only understand the rules of this new game, but also, hopefully, some escape from the promise of a brave new world of continuous education and motivation. A brave new world of digitised courses, impersonal and corporate expertise, updatable performance metrics, Massive Open Online Courses (MOOCs), learning analytics, transformative teaching and learning, online high-stakes testing in the name of transforming and augmenting human capital overlays the corporeal practices of institutional surveillance, examination and categorical sorting. A brave new world, importantly, where people’s continuous education is instituted less, or not simply, through disciplinary practices, and increasingly through a constant and continuous sampling and profiling of not simply performance but their activity, measured against the profiled activity of a ‘like’ age group, person, or an institution. This continuous education, including the sampling that accompanies it, we are all informed through various information and marketing campaigns, is in our best interest. An interest that is driven and governed by an ever-increasing corporatisation and monetisation of ‘the knowledge sector’, as well as an interest that is sustained through an ever-increasing, as well as continuous, debt.

Education policy-making and time

This paper examines the global policy convergence toward high-stakes testing in schools and the use of test results to ‘steer at a distance’, particularly as it applies to policy-makers’ promise to improve teacher quality. Using Deleuze’s three syntheses of time in the context of the Australian policy blueprint Quality Education, this paper argues that using test scores to discipline teaching repeats the past habit of policy-making as continuing the problem of the unaccountable teacher. This results in local policy-making enfolding test scores in a pure past where the teacher-as-problem is resolved through the use of data from testing to deliver accountability and transparency. This use of the database returns a digitised form of inspection that is a repetition of the habit of teacher-as-problem. While dystopian possibilities are available through the database, in what Deleuze refers to as a control society, for us the challenge is to consider policy-making as a step into an unknown future, to engage with producing policy that is not grounded on the unconscious interiority of solving the teacher problem, but of imagining new ways of conceiving the relationship between policy-making and teaching.