Assessment reform and educational change in Australia

This chapter addresses the changing climate of assessment policy and practice in Australia in response to global trends in education and the mounting accountability demands of standards-driven reform. Queensland, a State of Australia, has a tradition of respecting and trusting teacher judgment through the practice of, and policy commitment to, externally moderated school-based assessment. This chapter outlines the global trends in curriculum and assessment reform, and then analyzes the impact of international comparisons on national policy. The creation of the Australian Curriculum, Assessment and Reporting Authority (ACARA) together with the intent of establishing a standards-referenced framework raises tensions and challenges for teachers’ practice. The argument for sustaining confidence in teacher-based assessment is developed with reference to research evidence pertaining to the use of more authentic assessments and moderation practices for the purposes of improving learning, equity and accountability. Evidence is drawn from local studies of teacher judgment practice and used to demonstrate these developments and in so doing illuminate the complex issues of engaging the demands of policy while sustaining confidence in teacher assessment.

Curriculum, assessment teaching and learning for all

This chapter explores how the culture of classrooms and schools can acknowledge diversity and meet all learning needs. Classroom and school culture can and should enhance the belonging and learning of all students. Understanding of learning, curriculum, pedagogy and assessment influences the ways teachers consider their expectations of student achievement and participation in school. We revisit the theory of social constructionism to emphasise the development of shared and valued curriculum, which meets all learner needs. Decisions about what to teach, how to teach and assess, and what supports student needs are important considerations discussed in this chapter. Key messages drawn from the Australian and New Zealand curriculum reinforce the need to ensure education responds to the diversity of students in classrooms. A range of models of pedagogy that have influenced education in Australia and New Zealand are presented, with a particular focus on meeting the needs of students who have disabilities. In addition, the issues related to student and teacher identity, the importance of respectful partnerships that acknowledge family knowledge, and respectful collaboration are discussed. Belonging to a community of learners is made possible through teachers forming authentic relationships with students and their families. In turn, these relationships support teachers to understand how the students in their classrooms learn, and to know their students’ strengths and interests.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Using real-time authentic online learning scenarios to teach criminal intelligence

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Using real-time authentic online learning scenarios to teach criminal intelligence : presentation

Criminal intelligence is an area of expertise highly sought-after internationally and within a variety of justice-related professions; however, producing university graduates with the requisite professional knowledge, as well as analytical, organisational and technical skills presents a pedagogical and technical challenge to university educators. The situation becomes even more challenging when students are undertaking their studies by distance education. This best practice session showcases the design of an online undergraduate unit for final year justice students which uses an evolving real-time criminal scenario as the focus of authentic learning activities in order to prepare students for graduate roles within the criminal intelligence and justice professions. Within the unit, students take on the role of criminal intelligence analysts, applying relevant theories, models and strategies to solve a complex but realistic crime and complete briefings and documentation to industry standards as their major summative assessment task. The session will demonstrate how the design of the online unit corresponds to authentic learning principles, and will specifically map the elements of the unit design to Herrington & Oliver’s instructional design framework for authentic learning (2000; Herrington & Herrington 2006). The session will show how a range of technologies was used to create a rich learning experience for students that could be easily maintained over multiple unit iterations without specialist technical support. The session will also discuss the unique pedagogical affordances and challenges implicated in the location of the unit within an online learning environment, and will reflect on some of the lessons learned from the development which may be relevant to other authentic online learning contexts.

Pre-service teachers’ perceptions of authentic learning in a capstone unit

Capstone units in higher education courses are learning experiences which are designed to bring reflection and focus to a whole course of study while, at the same time, leading students toward their entry into a new world of work (Humphrey, Brown, & Benson, 2005). The capstone experience described in this paper runs as a conference, called the Stepping Out Conference. The conference is delivered as one unit and is mandatory for all fourth year pre-service teachers. Participation in a capstone unit is an effective way for students to begin thinking of themselves as teaching professionals rather than as continuing students. Students engage in the assessment as part of their capstone experience. The assessment is designed to measure students’ knowledge and skills as they relate to ‘authentic’ real life situations (Darling-Hammond, 1991). This paper details pre-service teachers’ experiences of authentic learning through their participation in a capstone unit.

Pioneering use of narrative method in a first-year law course to provide an authentic, inquiry-based entry into the discipline of law

Law is saturated with stories. People tell their stories to lawyers; lawyers tell their client's stories to courts; and legislators develop regulation to respond to their constituent's stories of injustice or inequality. My approach to first-year legal education respects this narrative tradition. Both my curriculum design and assessment scheme in the compulsory first-year subject Australian Legal System deploy narrative methodology as the central teaching and learning device. Throughout the course, students work on resolving the problems of four hypothetical clients. Like a murder mystery, pieces of the puzzle come together as students learn more about legal institutions and the texts they produce, the process of legal research, the analysis and interpretation of primary legal sources, the steps in legal problem-solving, the genre conventions of legal writing style, the practical skills and ethical dimensions of professional practice, and critical inquiry into the normative underpinnings and impacts of the law. The assessment scheme mirrors this design. In their portfolio-based assignment, for example, students devise their own client profile, research the client's legal position and prepare a memorandum of advice.

Context-based assessment: Creating opportunities for resonance between classroom fields and societal fields

There is on-going international interest in the relationships between assessment instruments, students’ understanding of science concepts and context-based curriculum approaches. This study extends earlier research showing that students can develop connections between contexts and concepts – called fluid transitions – when studying context-based courses. We provide an in-depth investigation of one student’s experiences with multiple contextual assessment instruments that were associated with a context-based course. We analyzed the student’s responses to context-based assessment instruments to determine the extent to which contextual tests, reports of field investigations, and extended experimental investigations afforded her opportunities to make connections between contexts and concepts. A system of categorizing student responses was developed that can inform other educators when analyzing student responses to contextual assessment. We also refine the theoretical construct of fluid transitions that informed the study initially. Implications for curriculum and assessment design are provided in light of the findings.

Temporary tattoos:a novel OSCE assessment tool

Background: There are many issues regarding the use of real patients in objective structured clinical examinations (OSCEs). In dermatology OSCE stations, standardised patients (SPs) with clinical photographs are often used. Temporary transfer tattoos can potentially simulate skin lesions when applied to an SP. This study aims to appraise the use of temporary malignant melanoma tattoos within an OSCE framework. Method: Within an 11-station OSCE, a temporary malignant melanoma tattoo was developed and applied to SPs in a 'skin lesion' OSCE station. A questionnaire captured the opinions of the candidate, SP and examiners, and the degree of perceived realism of each station was determined. Standard post hoc OSCE analysis determined the psychometric reliability of the stations. Results: The response rates were 95.9 per cent of candidates and 100 per cent of the examiners and SPs. The 'skin lesion' station achieved the highest realism score compared with other stations: 89.0 per cent of candidates felt that the skin lesion appeared realistic; only 28 per cent of candidates had ever seen a melanoma before in training. The psychometric performance of the melanoma station was comparable with, and in many instances better than, other OSCE stations. Discussion: Transfer tattoo technology facilitates a realistic dermatology OSCE station encounter. Temporary tattoos, alongside trained SPs, provide an authentic, standardised and reliable experience, allowing the assessment of integrated dermatology clinical skills.

Enseñar a aprender a pensar en los centros educativos, incluso en las actividades de evaluación.= Teaching to learn how to think at schools, even within assessment activities

El auténtico protagonismo de los centros educativos tiene que dirigirse a ayudar a pensar a sus alumnos y a enseñarlos a aprender, es decir, el docente tiene que enseñar estrategias de aprendizaje y debe promover el esfuerzo del estudiante para facilitar la construcción de esquemas y el aprendizaje permanente. El profesor debe utilizar cualquier situación de aprendizaje para enseñar dichas estrategias de aprendizaje, incluso en las situaciones de evaluación; por lo tanto, en este trabajo se sugiere que en las evaluaciones de los alumnos y alumnas se tenga en cuenta la metacognición como factor fundamental en el aprendizaje y la enseñanza

The Scored Patient-Generated Subjective Global Assessment (PG-SGA) and its Association with Quality of Life in Ambulatory Patients Receiving Radiotherapy

OBJECTIVE: To evaluate the scored Patient-generated Subjective Global Assessment (PG-SGA) tool as an outcome measure in clinical nutrition practice and determine its association with quality of life (QoL). DESIGN: A prospective 4 week study assessing the nutritional status and QoL of ambulatory patients receiving radiation therapy to the head, neck, rectal or abdominal area. SETTING: Australian radiation oncology facilities. SUBJECTS: Sixty cancer patients aged 24-85 y. INTERVENTION: Scored PG-SGA questionnaire, subjective global assessment (SGA), QoL (EORTC QLQ-C30 version 3). RESULTS: According to SGA, 65.0% (39) of subjects were well-nourished, 28.3% (17) moderately or suspected of being malnourished and 6.7% (4) severely malnourished. PG-SGA score and global QoL were correlated (r=-0.66, P<0.001) at baseline. There was a decrease in nutritional status according to PG-SGA score (P<0.001) and SGA (P<0.001); and a decrease in global QoL (P<0.001) after 4 weeks of radiotherapy. There was a linear trend for change in PG-SGA score (P<0.001) and change in global QoL (P=0.003) between those patients who improved (5%) maintained (56.7%) or deteriorated (33.3%) in nutritional status according to SGA. There was a correlation between change in PG-SGA score and change in QoL after 4 weeks of radiotherapy (r=-0.55, P<0.001). Regression analysis determined that 26% of the variation of change in QoL was explained by change in PG-SGA (P=0.001). CONCLUSION: The scored PG-SGA is a nutrition assessment tool that identifies malnutrition in ambulatory oncology patients receiving radiotherapy and can be used to predict the magnitude of change in QoL.