The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

The five myths of academic standards

This script provided the basis for a short DVD produced in 2010. The script and DVD were products of research into the introduction of 'minimum threshold' academic standards to Australian Universities. Learning and teaching academic standards are publicly defensible statements about academic standards in all disciplines, intended to establish 'baseline expectations' for undergraduate and postgraduate degrees. The script was developed using an 'anti-model' approach to character and narrative. This produced a set of deliberately skewed perspectives on the standards initiative, which are intended stimulate discussion and debate on the topic. The DVD has been shown to a range of stakeholder audiences in a variety of academic forums.

Double standards in cultural judgements

The author, a teacher of television and film from a cultural studies perspective, endeavours to persuade his students to give up snobbery when they judge culture. The author has found that most students enter university with a series of middle class value judgements very strongly in place. Essentially, the judgements are that commercial culture is 'bad' and non-commercial culture is 'good'.

Does institutional location protect from political influence? the case of a minimum labour standards enforcement agency in Australia

Among the many factors that influence enforcement agencies, this article examines the role of the institutional location (and independence) of agencies, and an incumbent government's ideology. It is argued that institutional location affects the level of political influence on the agency's operations, while government ideology affects its willingness to resource enforcement agencies and approve regulatory activities. Evidence from the agency regulating minimum labour standards in the Australian federal industrial relations jurisdiction (currently the Fair Work Ombudsman) highlights two divergences from the regulatory enforcement literature generally. First, notions of independence from political interference offered by institutional location are more illusory than real and, second, political need motivates political action to a greater extent than political ideology.

Developing shared understandings of standards-based assessment : online moderation practices across geographically diverse contexts

This thesis investigates the place of online moderation in supporting teachers to work in a system of standards-based assessment. The participants of the study were fifty middle school teachers who met online with the aim of developing consistency in their judgement decisions. Data were gathered through observation of the online meetings, interviews, surveys and the collection of artefacts. The data were viewed and analysed through sociocultural theories of learning and sociocultural theories of technology, and demonstrates how utilising these theories can add depth to understanding the added complexity of developing shared meaning of standards in an online context. The findings contribute to current understanding of standards-based assessment by examining the social moderation process as it acts to increase the reliability of judgements that are made within a standards framework. Specifically, the study investigates the opportunities afforded by conducting social moderation practices in a synchronous online context. The study explicates how the technology affects the negotiation of judgements and the development of shared meanings of assessment standards, while demonstrating how involvement in online moderation discussions can support teachers to become and belong within a practice of standards-based assessment. This research responds to a growing international interest in standards-based assessment and the use of social moderation to develop consistency in judgement decisions. Online moderation is a new practice to address these concerns on a systemic basis.

Minimum labour standards enforcement in Australia : caught in the crossfire?

The complex transition from convict to free labour influenced state intervention in the employment relationship, and initiated the first minimum labour standards in Australia in 1828. Since then, two principal sets of tensions have affected the enforcement of such standards: tensions between government and employers, and tensions between the major political parties over industrial and economic issues. This article argues that these tensions have resulted in a sustained legacy affecting minimum labour standards’ enforcement in Australia. The article outlines broad historical developments and contexts of minimum labour standards’ enforcement in Australia since 1828, with more contemporary exploration focusing specifically on enforcement practices and policies in the Australian federal industrial relations jurisdiction. Current enforcement practices are an outcome of this volatile history, and past influences remain strong.

Grading : harmonising standards and stakeholder expectations

This paper suggests that when a course is planned within one culture for delivery to members of another culture, appropriate quality control of assessment becomes an issue of major proportions. Based on their experience of presenting an Aid Agency-funded Masters course in a developing country in the Pacific, the authors describe the processes to address the needs and wants of all the stakeholders, with different cultural expectations. Maintaining a balance between domestic and Pacific student cohorts regarding resources and opportunities for study was especially challenging. However, grounding grades in course curriculum and clearly stated objectives permitted the teaching team to meet external requirements while maintaining their professional and academic freedom.

Small animal bone healing models : standards, tips, and pitfalls results of a consensus meeting

Small animal fracture models have gained increasing interest in fracture healing studies. To achieve standardized and defined study conditions, various variables must be carefully controlled when designing fracture healing experiments in mice or rats. The strain, age and sex of the animals may influence the process of fracture healing. Furthermore, the choice of the fracture fixation technique depends on the questions addressed, whereby intra- and extramedullary implants as well as open and closed surgical approaches may be considered. During the last few years, a variety of different, highly sophisticated implants for fracture fixation in small animals have been developed. Rigid fixation with locking plates or external fixators results in predominantly intramembranous healing in both mice and rats. Locking plates, external fixators, intramedullary screws, the locking nail and the pin-clip device allow different degrees of stability resulting in various amounts of endochondral and intramembranous healing. The use of common pins that do not provide rotational and axial stability during fracture stabilization should be discouraged in the future. Analyses should include at least biomechanical and histological evaluations, even if the focus of the study is directed towards the elucidation of molecular mechanisms of fracture healing using the largely available spectrum of antibodies and gene-targeted animals to study molecular mechanisms of fracture healing. This review discusses distinct requirements for the experimental setups as well as the advantages and pitfalls of the different fixation techniques in rats and mice.

The teacher as reflexive professional : making visible the excluded discourse in teacher standards

In the current climate of accountability, political manoeuvring, changing curriculum, increasingly diverse student cohorts and community expectations, teachers, more than ever, need to develop the skills and abilities to be reflective and reflexive practitioners. This study examines national teacher professional standards from Australia and the UK to identify the extent to which reflexivity is embedded in key policy documents that are intended to guide the work of teachers in those countries. Using Margaret Archer's theories of reflexivity and morphogenesis, and methods of critical discourse analysis, we argue that these blueprints for teachers’ work exclude reflexivity as an essential and overarching discourse of teacher professionalism.

Integration of CENA practice standards for postgraduate emergency nursing assessment

The use of professional competency standards to assess postgraduate nursing student’s clinical performance has been in place since 2004, at the Queensland University of Technology, School of Nursing & Midwifery (SONAM) when the Graduate Certificate in Emergency Nursing degree commenced. Emergency nursing students were assessed in their workplace, using a Clinical Performance Appraisal Tool or CPAT which was based on the Australian College of Critical Care Nurses (ACCCN) Competency Standards. With the subsequent formation of a separate Emergency Nursing Course advisory group in 2007, there was a review of clinical assessment course component. The release of the 2008 CENA revised Practice Standards for the Emergency Nursing Specialist’s, led to the emergency nursing course advisory committee supporting the integration of the CENA practice standards for assessment of emergency nurses in preference to the less relevant ACCCN competency standards. The SONAM emergency nursing study area team commenced the phasing in and progression of the CENA practice standards across the two Graduate Certificate units, and Graduate Diploma and Master of Nursing (emergency) clinical major options in 2009. As some units undertaken in the degree are available to nurses in other disciplines a separate CPAT was devised for the clinical assessments according to speciality context. The team has had to carefully consider how the professional standards are integrated into the teaching and assessment of the unit and not just applied instead of the ACCCN competency standards. Professional standards for the emergency context has also helped tailor course content and learning outcomes to be relevant across a number of emergency nursing contexts in Australia. The assessment of the CPAT is undertaken at the workplace by QUT appointed clinical lecturers. Clinical lecturers need to apply and have suitable postgraduate qualification to undertake the position. The clinical lecturer support role is well established at QUT. The integration of the new CENA practice standards has necessitated a review of the postgraduate assessment of emergency nurses. A clinical lecturer workshop has been organised to review role, scope and how to utilise the new look CENA based CPAT, clinical assessment format.

The emergence of JD in the Australian Legal Education marketplace and its impact on academic standards

Over the last decade there has been an expansion in the number of Juris Doctor (JD) courses in the Australian legal education marketplace. Across the board it is graduate-entry, but it is currently offered in undergraduate, postgraduate and ‘hybrid’ forms. In this article we will discuss recent research conducted as part of an Australian Learning and Teaching Council grant. This project included an exploration of whether JD courses in Australia were applying different and higher level academic standards to those operating in Bachelor of Laws degrees. Our research findings reveal justification for concerns about the academic standards of some JD courses, particularly where masters level students were being taught alongside their undergraduate counterparts. They also provide some insights into perceptions in the marketplace of JD graduates. Finally, we will discuss the future viability of such courses in light of recent revisions to the Australian Qualifications Framework.