Standards, teacher judgement and moderation in contexts of national curriculum and assessment reform

This paper puts forward a proposal for reviewing the role and purpose of standards in the context of national curriculum and assessment reform more generally. It seeks to commence the much-needed conversation about standards in the work of teachers as distinct from large-scale testing companies and the policy personnel responsible for reporting. Four key conditions that relate to the effective use of standards to measure improvement and support learning are analysed: clarity about purpose and function; understanding of the representation of standards; moderation practice; and the assessment community. The Queensland experience of the use of standards, teacher judgement and moderation is offered to identify what is educationally preferable in terms of their use and their relationships to curriculum, improvement and accountability. The article illustrates how these practices have recently been challenged by emerging political constraints related to the Australian Government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards.

Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.

Standards-driven reform years 1-10 : moderation an optional extra?

While externally moderated standards-based assessment has been practised in Queensland senior schooling for more than three decades, there has been no such practice in the middle years. With the introduction of standards at state and national levels in these years, teacher judgement as developed in moderation practices is now vital. This paper argues, that in this context of assessment reform, standards intended to inform teacher judgement and to build assessment capacity are necessary but not sufficient for maintaining teacher and public confidence in schooling. Teacher judgement is intrinsic to moderation, and to professional practice, and can no longer remain private. Moderation too is intrinsic to efforts by the profession to realise judgements that are defensible, dependable and open to scrutiny. Moderation can no longer be considered an optional extra and requires system-level support especially if, as intended, the standards are linked to system-wide efforts to improve student learning. In presenting this argument we draw on an Australian Research Council funded study with key industry partners (the Queensland Studies Authority and the National Council for Curriculum and Assessment of the Republic of Ireland). The data analysed included teacher interview data and additional teacher talk during moderation sessions. These were undertaken during the initial phase of policy development. The analysis identified those issues that emerge in moderation meetings that are designed to reach consistent, reliable judgements. Of interest are the different ways in which teachers talked through and interacted with one another to reach agreement about the quality of student work in the application of standards. There is evidence of differences in the way that teachers made compensations and trade-offs in their award of grades, dependent on the subject domain in which they teach. This article concludes with some empirically derived insights into moderation practices as policy and social events.

The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

The five myths of academic standards

This script provided the basis for a short DVD produced in 2010. The script and DVD were products of research into the introduction of 'minimum threshold' academic standards to Australian Universities. Learning and teaching academic standards are publicly defensible statements about academic standards in all disciplines, intended to establish 'baseline expectations' for undergraduate and postgraduate degrees. The script was developed using an 'anti-model' approach to character and narrative. This produced a set of deliberately skewed perspectives on the standards initiative, which are intended stimulate discussion and debate on the topic. The DVD has been shown to a range of stakeholder audiences in a variety of academic forums.

Development of a workplace wellness promotion pilot framework : a case study of the Blue Care Staff Wellness Program

Workplace wellness initiatives are currently unreflective of the multidimensional and holistic nature of the wellness construct. There exists an opportunity for promoters of health to move toward models of workplace wellness promotion that more fully appreciate the interconnected nature of health dimensions and promote them even-handedly. The Blue Care Staff Wellness Program framework was developed in response to a recognised need for consistent and wellness-focused constructs for workplace wellness promotion and dissemination. The framework promotes and supports the individual and organisational wellness of the Blue Care employee population by providing a comprehensive and sustainable employee wellness program. This has been achieved by the adoption of consistent wellness principles to guide the framework conception and theory based development. The use of the framework in a pilot program will provide insight into the frameworks effectiveness in promoting a comprehensive workplace wellness program, and go further to establish the relationship between wellness and productivity in the workplace.

Double standards in cultural judgements

The author, a teacher of television and film from a cultural studies perspective, endeavours to persuade his students to give up snobbery when they judge culture. The author has found that most students enter university with a series of middle class value judgements very strongly in place. Essentially, the judgements are that commercial culture is 'bad' and non-commercial culture is 'good'.

Does institutional location protect from political influence? the case of a minimum labour standards enforcement agency in Australia

Among the many factors that influence enforcement agencies, this article examines the role of the institutional location (and independence) of agencies, and an incumbent government's ideology. It is argued that institutional location affects the level of political influence on the agency's operations, while government ideology affects its willingness to resource enforcement agencies and approve regulatory activities. Evidence from the agency regulating minimum labour standards in the Australian federal industrial relations jurisdiction (currently the Fair Work Ombudsman) highlights two divergences from the regulatory enforcement literature generally. First, notions of independence from political interference offered by institutional location are more illusory than real and, second, political need motivates political action to a greater extent than political ideology.

Marking the liminal for true blue Aussies : the generic placement of Aboriginality in Australian soap operas.

This paper addresses a previously unconsidered history — that of Aboriginal characters in Australian soap operas. Rejecting critical approaches which have obtained even into the 1990s, it refuses to judge these characters as 'good' or 'bad' manifestations of indigeneity. Rather, using the idea that genre is a way of closing down interpretive possibilities, the paper looks at the manner in which generic expectations around soap operas produce particular valences for these representations of Aboriginality. It points to the many ways in which these indigenous characters are insistently constructed as liminal in soap operas' structural communities - simultaneously inside and outside of the group. This is seen to accord with the suggestions of Jakubowicz et al about the ways in which Aboriginal people are positioned by wider social discourses.

Developing shared understandings of standards-based assessment : online moderation practices across geographically diverse contexts

This thesis investigates the place of online moderation in supporting teachers to work in a system of standards-based assessment. The participants of the study were fifty middle school teachers who met online with the aim of developing consistency in their judgement decisions. Data were gathered through observation of the online meetings, interviews, surveys and the collection of artefacts. The data were viewed and analysed through sociocultural theories of learning and sociocultural theories of technology, and demonstrates how utilising these theories can add depth to understanding the added complexity of developing shared meaning of standards in an online context. The findings contribute to current understanding of standards-based assessment by examining the social moderation process as it acts to increase the reliability of judgements that are made within a standards framework. Specifically, the study investigates the opportunities afforded by conducting social moderation practices in a synchronous online context. The study explicates how the technology affects the negotiation of judgements and the development of shared meanings of assessment standards, while demonstrating how involvement in online moderation discussions can support teachers to become and belong within a practice of standards-based assessment. This research responds to a growing international interest in standards-based assessment and the use of social moderation to develop consistency in judgement decisions. Online moderation is a new practice to address these concerns on a systemic basis.

Minimum labour standards enforcement in Australia : caught in the crossfire?

The complex transition from convict to free labour influenced state intervention in the employment relationship, and initiated the first minimum labour standards in Australia in 1828. Since then, two principal sets of tensions have affected the enforcement of such standards: tensions between government and employers, and tensions between the major political parties over industrial and economic issues. This article argues that these tensions have resulted in a sustained legacy affecting minimum labour standards’ enforcement in Australia. The article outlines broad historical developments and contexts of minimum labour standards’ enforcement in Australia since 1828, with more contemporary exploration focusing specifically on enforcement practices and policies in the Australian federal industrial relations jurisdiction. Current enforcement practices are an outcome of this volatile history, and past influences remain strong.