Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

From profiles to rich tasks : the situated nature of 'authenticity' in the context of reforming curriculum and assessment practices

Outcome based education that has dominated Australian education in the 1990s is under review in the early years of the twenty first century. The available historical 'texts' produced during the first half of the 1990s, which include the national Statements and Profiles, and the state Curriculum and Standards Frameworks, provide us with documents that we can engage with not simply for 'history's sake', but with an opportunity to, in the words of the feminist author Dorothy Smith, 'displace[s] the analysis from the text as originating in writer or thinker, to the discourse itself as an ongoing intertextual process' bringing into view the social relations in which texts are embedded and which they organise' (1990, p. 161-2). Most Australian states and territories have now commenced significant situated, local curriculum renewal and reform. This renewed interest in curriculum offers insights into the character of recent assessment practices in Australia, recognising the tensions inherent in assessment practices and authentic assessment models. This paper explores, by way of an overview of the broad curriculum and assessment practices adopted in Australia over the past twenty-five years, the situated nature of 'authenticity' in the context of curriculum and assessment practices and how as teacher educators we are responding through our everyday work.

Faculty mentoring, evidence-based assessment, and student learning : an Australian exploration of American initiatives

There have been many improvements in Australian engineering education since the 1990s. However, given the recent drive for assuring the achievement of identified academic standards, more progress needs to be made, particularly in the area of evidence-based assessment. This paper reports on initiatives gathered from the literature and engineering academics in the USA, through an Australian National Teaching Fellowship program. The program aims to establish a process to help academics in designing and implementing evidence-based assessments that meet the needs of not only students and the staff that teach them, but also industry as well as accreditation bodies. The paper also examines the kinds and levels of support necessary for engineering academics, especially early career ones, to help meet the expectations of the current drive for assured quality and standards of both research and teaching. Academics are experiencing competing demands on their time and energy with very high expectations in research performance and increased teaching responsibilities, although many are researchers who have not had much pedagogic training. Based on the literature and investigation of relevant initiatives in the USA, we conducted interviews with several identified experts and change agents who have wrought effective academic cultural change within their institutions and beyond. These reveal that assuring the standards and quality of student learning outcomes through evidence-based assessments cannot be appropriately addressed without also addressing the issue of pedagogic training for academic staff. To be sustainable, such training needs to be complemented by a culture of on-going mentoring support from senior academics, formalised through the university administration, so that mentors are afforded resources, time, and appropriate recognition.

Child sexual abuse prevention education : A review of school policy and curriculum provision in Australia

The past four decades have seen increasing public and professional awareness of child sexual abuse. Congruent with public health approaches to prevention, efforts to eliminate child sexual abuse have inspired the emergence of prevention initiatives which can be provided to all children as part of their standard school curriculum. However, relatively little is known about the scope and nature of child sexual abuse prevention efforts in government school systems internationally. This paper assesses and compares the policies and curriculum initiatives for child sexual abuse prevention education in primary (elementary) schools across state and territory Departments of Education in Australia. Using publicly available electronic data, a deductive qualitative content analysis of policy and curriculum documents was undertaken to examine the characteristics of child sexual abuse prevention education in these school systems. It was found that the system-level provision of child sexual abuse prevention education occurs unevenly across state and territory jurisdictions. This results in the potential for substantial inequity in Australian children’s access to learning opportunities in child abuse prevention education as a part of their standard school curriculum. In this research, we have developed a strategy for generating a set of theoretically-sound empirical criteria that may be more extensively applied in comparative research about prevention initiatives internationally.

Context-based assessment: Creating opportunities for resonance between classroom fields and societal fields

There is on-going international interest in the relationships between assessment instruments, students’ understanding of science concepts and context-based curriculum approaches. This study extends earlier research showing that students can develop connections between contexts and concepts – called fluid transitions – when studying context-based courses. We provide an in-depth investigation of one student’s experiences with multiple contextual assessment instruments that were associated with a context-based course. We analyzed the student’s responses to context-based assessment instruments to determine the extent to which contextual tests, reports of field investigations, and extended experimental investigations afforded her opportunities to make connections between contexts and concepts. A system of categorizing student responses was developed that can inform other educators when analyzing student responses to contextual assessment. We also refine the theoretical construct of fluid transitions that informed the study initially. Implications for curriculum and assessment design are provided in light of the findings.

Top-down and bottom-up approaches to motor skill assessment of children : are child-report and parent-report perceptions predictive of children's performance-based assessment results?

Background/ Aim: Therapists use different types of tests, scales, and instruments to assess children's motor skills, including those classified as being top-down and bottom-up. The aim of the study was to investigate the ability of measures of children's motor skill performance from the perspectives of children and parents (a type of top-down assessment) to predict children's performance-based motor ability test results (a type of bottom-up assessment).
Methods: A convenience sample of 38 children and parents was recruited from Victoria, Australia. Motor skill performance was evaluated from a top-down perspective using the Physical Self-Description Questionnaire (PSDQ) and the Movement Assessment Battery for Children – Second Edition (MABC-2) Checklist to measure children's and parents' perspectives respectively. Motor skill performance was also evaluated from a bottom-up approach using the Bruininks-Oseretsky Test of Motor Proficiency – Second Edition (BOT-2). Data were analyzed using multiple linear regression analysis to determine whether the PSDQ or MABC-2 Checklist was predictive of the children's BOT-2 performance results.
Results: Two predictive relationships were identified based on parents' perspectives, where the total score of the MABC-2 Checklist was found to be a significant predictor of the BOT-2 Manual Coordination motor composite score, accounting for 8.35% of its variance, and the BOT-2 Strength and Agility motor composite score, accounting for 11.6% of its variance. No predictive relationships were identified between the children's self-report PSDQ perspectives and the BOT-2 performance scores.
Conclusions: Therapists are encouraged to utilize a combination of top-down and bottom-up approaches and purposefully to seek parents' and children's perspectives when evaluating children's motor skill performance.

Standards, teacher judgement and moderation in contexts of national curriculum and assessment reform

This paper puts forward a proposal for reviewing the role and purpose of standards in the context of national curriculum and assessment reform more generally. It seeks to commence the much-needed conversation about standards in the work of teachers as distinct from large-scale testing companies and the policy personnel responsible for reporting. Four key conditions that relate to the effective use of standards to measure improvement and support learning are analysed: clarity about purpose and function; understanding of the representation of standards; moderation practice; and the assessment community. The Queensland experience of the use of standards, teacher judgement and moderation is offered to identify what is educationally preferable in terms of their use and their relationships to curriculum, improvement and accountability. The article illustrates how these practices have recently been challenged by emerging political constraints related to the Australian Government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards.

Role and purpose of standards in the context of national curriculum and assessment reform for accountability, improvement and equity in student learning

In this article our starting point is the current context of national curriculum change and intense speculation about the assessment, standards and reporting. It is written against a background of accountability measures and improvement imperatives, and focuses attention on standards as offering representations of quality. We understand standards to be constructs that aim to achieve public credibility and utility. Further, they can be examined for the purposes they seek to serve and also their expected functions. Fitness for purpose is therefore a useful notion in considering the nature of standards. Our interest in the discussion is the ‘fit’ between how standards are formulated and how they are used in practice, by whom and for what purposes. A related interest is in the matter of how standards can be harnessed to realise improvement.

Developing shared understandings of standards-based assessment : online moderation practices across geographically diverse contexts

This thesis investigates the place of online moderation in supporting teachers to work in a system of standards-based assessment. The participants of the study were fifty middle school teachers who met online with the aim of developing consistency in their judgement decisions. Data were gathered through observation of the online meetings, interviews, surveys and the collection of artefacts. The data were viewed and analysed through sociocultural theories of learning and sociocultural theories of technology, and demonstrates how utilising these theories can add depth to understanding the added complexity of developing shared meaning of standards in an online context. The findings contribute to current understanding of standards-based assessment by examining the social moderation process as it acts to increase the reliability of judgements that are made within a standards framework. Specifically, the study investigates the opportunities afforded by conducting social moderation practices in a synchronous online context. The study explicates how the technology affects the negotiation of judgements and the development of shared meanings of assessment standards, while demonstrating how involvement in online moderation discussions can support teachers to become and belong within a practice of standards-based assessment. This research responds to a growing international interest in standards-based assessment and the use of social moderation to develop consistency in judgement decisions. Online moderation is a new practice to address these concerns on a systemic basis.