Initial teacher education and assessment of graduates in Australia

In this chapter we discuss the impact of recent standards-based legislation and implementation in Australia designed to improve the quality of teacher education and examine the ways in which teacher educators are assessing graduates in relation to beginning teacher standards, the evidence they are using within the context of accreditation of their programs, and the impact this is having on the teacher education curriculum. We report on research into the implementation and evaluation of an authentic teacher assessment approach being used in one Australian university and argue that such an approach not only empowers pre-service teachers but also teacher educators.

Portfolio assessment

At a time when global uncertainty is paramount and when a new form or re-form of curriculum is emerging – with content displaced by skills and knowledge acquisition by learning - assessment, too, begins to take on a new from or re-form. The focus for assessment has shifted to that which engages and promotes learning as s process rather than an assessment that focuses solely on measuring and reporting learning as product or score. The use of the portfolio for assessment offers the potential for the process and progress – integral to learning - to be included.

Integration of CENA practice standards for postgraduate emergency nursing assessment

The use of professional competency standards to assess postgraduate nursing student’s clinical performance has been in place since 2004, at the Queensland University of Technology, School of Nursing & Midwifery (SONAM) when the Graduate Certificate in Emergency Nursing degree commenced. Emergency nursing students were assessed in their workplace, using a Clinical Performance Appraisal Tool or CPAT which was based on the Australian College of Critical Care Nurses (ACCCN) Competency Standards. With the subsequent formation of a separate Emergency Nursing Course advisory group in 2007, there was a review of clinical assessment course component. The release of the 2008 CENA revised Practice Standards for the Emergency Nursing Specialist’s, led to the emergency nursing course advisory committee supporting the integration of the CENA practice standards for assessment of emergency nurses in preference to the less relevant ACCCN competency standards. The SONAM emergency nursing study area team commenced the phasing in and progression of the CENA practice standards across the two Graduate Certificate units, and Graduate Diploma and Master of Nursing (emergency) clinical major options in 2009. As some units undertaken in the degree are available to nurses in other disciplines a separate CPAT was devised for the clinical assessments according to speciality context. The team has had to carefully consider how the professional standards are integrated into the teaching and assessment of the unit and not just applied instead of the ACCCN competency standards. Professional standards for the emergency context has also helped tailor course content and learning outcomes to be relevant across a number of emergency nursing contexts in Australia. The assessment of the CPAT is undertaken at the workplace by QUT appointed clinical lecturers. Clinical lecturers need to apply and have suitable postgraduate qualification to undertake the position. The clinical lecturer support role is well established at QUT. The integration of the new CENA practice standards has necessitated a review of the postgraduate assessment of emergency nurses. A clinical lecturer workshop has been organised to review role, scope and how to utilise the new look CENA based CPAT, clinical assessment format.

Teacher professional standards : mirage or miracle cure - an archaeology of professionalism in education

This thesis is a problematisation of the development and implementation of professional standards as the mechanism to enhance professionalism and teacher quality in the teaching force within Australia and, more specifically, Queensland. Drawing on tools from Foucauldian archaeological analysis, the dominant discourses of professionalism from the academic literature, Australian federal and state policy documents and narratives from Queensland teachers are examined. These data sets are then cross referenced, analysing the intersections and divergences between the different texts. Findings suggest that through policy, political strategy and derisory statements from various authoritative voices, the managerial discourse of professionalism through professional standards documents has been unduly privileged as a means of regulating teachers, despite the fact that teachers themselves do not share this dominant notion of professionalism. The teachers in this study proffer ‘new classical-practical professionalism’ as a counter discourse, or discourse of resistance, to managerialism. However, an application of Foucault’s theorisations on power-knowledge reveals that their spoken discourses mean they are in fact yielding to the discourse of professional standards as docile bodies.

Development and implementation of the Australian universities radiation therapy student clinical assessment form

Purpose: Prior to 2009, one of the problems faced by radiation therapists who supervised and assessed students on placement in Australian clinical centres, was that each of the six Australian universities where Radiation Therapy (RT) programmes were conducted used different clinical assessment and reporting criteria. This paper describes the development of a unified national clinical assessment and reporting form that was implemented nationally by all six universities in 2009. Methods: A four phase methodology was used to develop the new assessment form and user guide. Phase 1 included university consensus around domains of student practice and assessment, and alignment with national competency standards; Phase 2 was a national consensus workshop attended by radiation therapists involved in student supervision and assessment; Phase 3 was an action research re-iterative Delphi technique involving two rounds of a mail-out to gain further expert consensus; and stage 4 was national piloting of the developed assessment form. Results: The new assessment form includes five main domains of practice and 19 sub-domain criteria which students are assessed against during placement. Feedback from the pilot centre participants was positive, with the new form being assessed to be comprehensive and complemented by the accompanying user guide. Conclusion: The new assessment form has improved both the formative and summative assessment of students on placement, as well as enhancing the quality of feedback to students and the universities. The new national form has high acceptance from the Australian universities and has been subject to wide review by the profession.

Using annotations to inform an understanding of achievement standards

The implementation of a new national curriculum and standards-referenced assessment in Australia has been an opportunity and a challenge for teacher assessment practices. In this case study of teachers in two Queensland schools, we explore how annotating student or exemplar assessment tasks could support teacher assessment practice. Three learning conversations between the researchers and the teacher teams are interpreted through the lens of Bernstein’s (1999) horizontal and vertical discourses to understand the complexities of coming to know an assessment standard. The study contributes to the literature on the use of annotations by exploring how teachers negotiated the purposes and processes of annotation, how annotating student work or exemplars before teaching commenced supported teachers to experience greater clarity about assessment standards and, finally, some of the tensions experienced by the teachers as they considered this practice within the practicalities of their daily work.

Teachers using annotations to engage students in assessment conversations : recontextualising knowledge

Assessment for Learning practices with students such as feedback, and self- and peer assessment are opportunities for teachers and students to develop a shared understanding of how to create quality learning performances. Quality is often represented through achievement standards. This paper explores how primary school teachers in Australia used the process of annotating work samples to develop shared understanding of achievement standards during their curriculum planning phase, and how this understanding informed their teaching so that their students also developed this understanding. Bernstein's concept of the pedagogic device is used to identify the ways teachers recontextualised their assessment knowledge into their pedagogic practices. Two researchers worked alongside seven primary school teachers in two schools over a year, gathering qualitative data through focus groups and interviews. Three general recontextualising approaches were identified in the case studies; recontextualising standards by reinterpreting the role of rubrics, recontextualising by replicating the annotation process with the students and recontextualising by reinterpreting practices with students. While each approach had strengths and limitations, all of the teachers concluded that annotating conversations in the planning phase enhanced their understanding, and informed their practices in helping students to understand expectations for quality.

Improving criteria and feedback in student assessment in law

Spurred on by both the 1987 Pearce Report1 and the general changes to higher education spawned by the “Dawkins revolution” from 1988, there has been much critical self-evaluation leading to profound improvements to the quality of teaching in Australian law schools.2 Despite the changes there are still areas of general law teaching practice which have lagged behind recent developments in our understanding of what constitutes high quality teaching. One such area is assessment criteria and feedback. The project Improving Feedback in Student Assessment in Law is an attempt to remedy this. It aims to produce a manual containing key principles for the design of assessment and the provision of feedback, with practical yet flexible ideas and illustrations which law teachers may adopt or modify. Most of the examples have been developed by teachers at the University of Melbourne Law School. The project was supported in 1996 by a Committee for the Advancement of University Teaching grant and the manual will be published late in 1997.3 This note summarises the core principles which are elaborated further in the manual.

Towards a theoretical framework for online professional discussions

Online interactions are becoming commonplace for a multitude of educational purposes. Each context presents a unique and dynamic mix of variables that combine to shape the practice and the identities of those involved. In this article, sociocultural theories of learning and sociocultural theories of technology are explored as a way to view and to map the complex interactions that can occur. The case of synchronous online moderation meetings are used as an example of the combination of variables that can impact on the development of shared understandings of a practice. Online moderation can involve teachers from geographically diverse areas discussing and negotiating their judgement decisions. These discussions represent an intersection of a national curriculum, standards-referenced assessment, moderation protocols, site-specific practices and understandings, and individual teachers’ knowledges and histories. It is suggested that the proposed theoretical combination addresses some of the limitations of each of the theories when investigating such a dynamic context. As higher education moves into increasing use of online modes of communication and a higher level of accountability the relevance of this discussion to higher education is evident.

Spatialised metaphors of practice: How teacher educators engage with professional standards for teachers

Preservice teacher educators, both nationally and internationally, must negotiate a plethora of expectations including using Professional Standards to enhance teacher quality. In Australia, the recent Teacher Education Ministerial Advisory Group (TEMAG) report highlighted weak application of Standards in Initial Teacher Education (ITE). However, recent findings suggest that education stakeholders feel positive about the implementation of the Australian Professional Standards for Teachers (APSTs). This study responds to these differing viewpoints by exploring how teacher educators in a large metropolitan university in Australia account for the use of Standards in their work. Discourse analytic techniques in conjunction with socio-spatial theory make visible particular metaphors of practice as teacher educators negotiate the real-and-imagined spaces of regulated teacher education programs. The findings highlight the importance of investigating the utility of Standards in the lived experiences of teacher educators, as they are responsible for preparing quality, classroom ready graduates.

Teacher performance assessment in teacher education : an example in Malaysia

As part of a cross-cultural collaboration, a teacher performance assessment (TPA) was implemented during 2009 in three Malaysian institutes of teacher education. This paper reports on the TPA for graduating primary teachers in Malaysia. The investigation focused on the pre-service teachers’ perceptions about whether the TPA provided them with an opportunity to document successfully their professional learning and professional practice. Successful completion of the Malaysian TPA was closely aligned to successful relationships, support and collaboration between Malaysian lecturers and pre-service teachers, and between pre-service teachers and their classroom teachers. Overall, the TPA did provide pre-service teachers with an opportunity to focus on the connection between theory and professional learning during field-work, and to become reflective evidence-based practitioners. Recommendations for improving the assessment of pre-service teachers are discussed.

Using professional atandards : assessing work integrated learning in initial teacher education

All Australian teacher education programs must include practical experience--the practicum. It is a critical part of learning to become a teacher.  One of the major challenges in initial teacher education is to provide good quality assessment of the practicum.  Assessing the practicum is filled with tension for both the individual supervisor as well as the pre-service teacher. In 2011 the Australian National Professional Standards for Teachers were established.  On completion of teacher education programs, graduate teachers will have gained the knowledge and practice to meet the seven national standards.  For teacher preparation programs, the successful implementation of the standards will rely on the opportunities for preservice teachers to gather evidence of achieving the standards. This project focussed specifically on evidence of achievements of these standards through assessment practices during practicum.
The overall aim of this project was to enhance the academic and school-based teacher educators' and preservice teachers' capacities and understandings of assessing the practicum.  To achieve this aim, four outcomes were developed to provide professional leaning for improving the assessment practices of the practicum: a website resource, a collaborative partnership process, a professional learning model (PLM) and a developmental 'inventory' of evidence of achievement of the first five national standards.  The website resource provides materials and activities for staff involved in the design of professional experience in initial teacher education programs, to work with partner schools and preservice teachers to facilitate high quality supervision and assessment in practicum sites.  The collaborateive partnership process used for achieving these soutcomes -- communities of reflective practitioners--is integral to the professional learning focus of the project.  It guides the use of the resource in future teacher education sites of practice.  The professional learning model and website materials emphasise the critical role that evidence-informed judgements play at school sites in learning and assessment of future teachers.

Does the summative assessment of real world learning using criterion-referenced assessment need to be discipline specific?

This paper synthesises the existing literature on the contemporary conception of ‘real world’ and compares it with similar notions such as ‘authentic’ and ‘work integrated learning’. While the term ‘real world’ may be partly dependent on the discipline, it does not necessarily follow that the criterion-referenced assessment of ‘real world’ assessment must involve criteria and performance descriptors that are discipline specific. Two examples of summative assessment (court report and trial process exercise) from a final year core subject at the Queensland University of Technology, LWB432 Evidence, emphasise real world learning, are authentic, innovative and better prepare students for the transition into the workplace than more generic forms of assessment such as tutorial participation or oral presentations. The court report requires students to attend a criminal trial in a Queensland Court and complete a two page report on what they saw in practice compared with what they learned in the classroom. The trial process exercise is a 50 minute written closed book activity conducted in tutorials, where students plan questions that they would ask their witness in examination-in-chief, plan questions that they would ask their opponent’s witness in cross-examination, plan questions that they would ask in reexamination given what their opponent asked in cross-examination, and prepare written objections to their opponent’s questions. The trial process exercise simulates the real world, whereas the court report involves observing the real world, and both assessment items are important to the role of counsel. The design of the criterion-referenced assessment rubrics for the court report and trial process exercise is justified by the literature. Notably, the criteria and performance descriptors are not necessarily law specific and this paper highlights the parts that may be easily transferred to other disciplines.

Assessing performance and capability in the work place : focusing on essential skills and knowledge in student work placements

The determination of performance standards and assessment practices in regard to student work placements is an essential and important task. Inappropriate, inadequate, or excessively complex assessment tasks can influence levels of student engagement and the quality of learning outcomes. Critical to determining appropriate standards and assessment tasks is an understanding and knowledge of key elements of the learning environment and the extent to which opportunities are provided for students to engage in critical reflection and judgement of their own performance in the contexts of the work environment. This paper focuses on the development of essential skills and knowledge (capabilities) that provide evidence of learning in work placements by describing an approach taken in the science and technology disciplines. Assessment matrices are presented to illustrate a method of assessment for use within the context of the learning environment centred on work placements in science and technology. This study contributes to the debate on the meaning of professional capability, performance standards and assessment practices in work placement programs by providing evidence of an approach that can be adapted by other programs to achieve similar benefits. The approach may also be valuable to other learning contexts where capability and performance are being judged in situations that are outside a controlled teaching and learning environment i.e. in other life-wide learning contexts.

Identifying discourses of moderation in higher education

Moderation of student assessment is a critical component of teaching and learning in contemporary universities. Yet, despite this, it tends to be marked by idiosyncratic and sporadic processes informed by liminal understanding. This paper, in the light of forthcoming radical national requirements for the declaration of moderation processes in tertiary curricula in Australia, will present four discourses of moderation we identified in a recent study in a Faculty of Education in a large metropolitan university. The discourses are equity, justification, community building and accountability. Together, they will act as a starting point for academics to review their beliefs and attitudes towards the moderation of student assessment.