The role of assessment in the development of judgement

This paper introduces an integrated assessment model developed within a project management discipline stream in a Construction Management course. Following Boud and Falchikov (2007) this model starts with practice, that is, the actual ‘doing’ of project management as the basis for shaping assessment that equips students to learn for the rest of their lives. Practice is understood as a holistic conception of what professionals do in particular contexts, and a theoretical construct that provides a method of framing ways in which we can investigate the world (Schatzki, 2001). This approach opens the way for considerations of assessment that engage with, and cultivate, certain kinds of professional learning and identity formation including the development of judgement. Integral to the model is the non-sequential nature of assessment activities, evolving team formation and ongoing self and communal reflection. The paper concludes that the use of an authentic and integrated assessment model creates a compelling learning environment that contributes meaningfully to the development of skills, knowledge and identities for future professional learning.

From profiles to rich tasks : the situated nature of 'authenticity' in the context of reforming curriculum and assessment practices

Outcome based education that has dominated Australian education in the 1990s is under review in the early years of the twenty first century. The available historical 'texts' produced during the first half of the 1990s, which include the national Statements and Profiles, and the state Curriculum and Standards Frameworks, provide us with documents that we can engage with not simply for 'history's sake', but with an opportunity to, in the words of the feminist author Dorothy Smith, 'displace[s] the analysis from the text as originating in writer or thinker, to the discourse itself as an ongoing intertextual process' bringing into view the social relations in which texts are embedded and which they organise' (1990, p. 161-2). Most Australian states and territories have now commenced significant situated, local curriculum renewal and reform. This renewed interest in curriculum offers insights into the character of recent assessment practices in Australia, recognising the tensions inherent in assessment practices and authentic assessment models. This paper explores, by way of an overview of the broad curriculum and assessment practices adopted in Australia over the past twenty-five years, the situated nature of 'authenticity' in the context of curriculum and assessment practices and how as teacher educators we are responding through our everyday work.

Developing robust assessment criteria for postgraduate research oriented papers

Assessment criteria designed to fully evaluate prescribed learning outcomes is a significant aid to both student and staff alike. For the student, it allows them to fully understand the requirements for a specific grade and for staff, it simplifies marking (grading) and minimises the likelihood of student appeals against assessment. Whilst criterion referencing is common place in the more traditional analytical type taught papers common in the Engineering degree curriculum it is perhaps less commonly utilised for research based papers. Presented here is a case study where both learning outcomes and achievement criteria have been proposed for a postgraduate research methodology paper which prepares students for their thesis. It has significant cross over to a descriptor for the thesis paper itself and is considered a template which could be equally applied to other subject domains where research methodology is taught.

Digital oral feedback written assignments as professional learning for teacher educators : a collaborative self-study.

Allan Luke (2008) uses a “pedagogical economy where literacy education is taken as a cultural gift”. This paper reports on the digital oral feedback provided to pre-service teachers in a literacy unit and explores the pedagogical gift this feedback is to the teacher educators marking this work. Rather than mark their written work as individual lecturers, we collaboratively read the assignment and recorded the sound file of the conversation around each assignment. We then participated in another conversation with a critical friend, which enabled us to explore the impact of this form of assessment on our professional identities as teacher educators. We found these conversations provided a rich context for our professional learning about ourselves as teacher educators, as well as specific content knowledge we both brought to the teaching of this unit. We found we were working as a team to provide more in-depth feedback of the assessment criteria for each assignment than we did with written feedback. Through this dialogical feedback we were able to construct the pre-service teachers' assignments as an important textual gift in our collaborative professional learning about assessment, and in exploring our beliefs and practices as teacher educators.

Digital oral feedback on written assignments as professional learning for teacher educators: a collaborative self-study

This article reports on a self-study of teacher educators involved in a preservice teacher unit on literacy. In this study the teacher educators provided the preservice teachers with digital oral feedback about their final unit of work. Rather than marking written work as individual lecturers, we collaboratively read each assignment and recorded a sound file of our conversation. We constructed our collaborative marking of each assignment as a “cultural gift” to our own professional learning. We found that we were providing more in-depth feedback on the assessment criteria for each assignment than we would have with written feedback prepared individually. We also uncovered tensions in relation to our preferred modalities associated with the digital marking.

Reframing conceptions of contemporary literacy capabilities in pre-service primary teacher education

This chapter describes the challenges of integrating new technologies with literacy education in pre-service primary teacher education in Australia. The authors describe the policy context and regulatory mechanisms controlling pre-service education, including a national set of professional standards for graduate teachers, a new national curriculum for school students, the introduction of high stakes national assessment for school students, and the looming threat of decontextualized back-to-the-basics professional entry tests for aspiring teachers. The chapter includes three case studies of the authors’ pedagogical practices that attempt to reframe conceptions of the literacy capabilities of pre-service teachers to reflect the complex and sophisticated requirements of teachers in contemporary schooling. The authors conclude the chapter with a discussion of the implications of these case studies as they illustrate the ways that pre-service teachers can be scaffolded and supported to develop creative capacity and critical awareness of the kinds of literacies required in the digital age despite restrictive regimes.

The teacher education evolution : the shift from online to mobile learning in curriculum, assessment and delivery

Most teacher education programs have online applications. Increasingly teacher education programs are expanding their distance education applications with mobile learning, or m-learning. Although related to online learning, m-learning focuses on the learning opportunities offered by mobile technologies. Mobile learning is a big step towards providing flexible teacher education; it has brought about a new forum for learning, decreased limitations of learning location, and provided learners with choices about how and when they access learning materials. Universities are finding themselves grappling with how best to utilize mobile technologies for learning, while staying within their educational missions and resources. In this paper the mobile devices used in higher education and the current status of mobile technologies as learning tools at universities are described. The background of approaches and methods which are currently in use are also discussed, plus universities and teacher readiness for this transformation are also reviewed. Affordances and constraints are considered.

Ways in which theory and practice are integrated in the pre-service teacher education practicum

This paper reports on a study into pre-service teachers’ perceptions about their professional development during practicum. The study examined to what extent, and how effectively, one group of pre-service teachers was able to integrate theory and practice during a three-week practicum in the first year of their degree. Data for this mixed methods study were drawn from one cohort of first-year students undertaking the Master of Teaching (MTeach), a graduate-level entry program in the Faculty of Education at an urban Australian university. Although there is a strong field of literature around the practicum in pre-service teacher education, there has been a limited focus on how pre-service teachers themselves perceive their development during this learning period. Further, despite widespread and longstanding acknowledgement of the “gap” between theory and practice in teacher education, there is still more to learn about how well the practicum enables an integration of these two dimensions of teacher preparation. In presenting three major findings of the study, this paper goes some way in addressing these shortcomings in the literature. First, opportunities to integrate theory and practice were varied, with many participants reporting supervision and scheduling issues as impacting on their capacity to effectively enact theory in practice. Second, participants’ privileging of theory over practice, identified previously in the literature as commonly characteristic of the pre-service teacher, was found in this study to be particularly prevalent during practicum. Third, participants overwhelmingly supported the notion of linking university coursework assessment to the practicum as a means of bridging the gap between, on the one hand, the university and the school and, on the other hand, theory and practice. The discussion and consideration of findings such as those reported in this paper are pertinent and timely, given the ratification of both the National Professional Standards for Teachers and the Initial Teacher Education Program Standards by the Australian Federal Government earlier this year. Within a number of the seven Professional Standards, graduate teachers are required to demonstrate knowledge and skills associated with both the theory and practice of teaching and with their effective integration in the classroom. To be nationally accredited, pre-service teacher education programs must provide evidence of enabling pre-service teachers to acquire such knowledge and skills.

Evaluating objective structured clinical assessment (OSCA) in undergraduate nursing

The aims of this mixed methods study were to gain insight into how individual assessors determine an Objective Structured Clinical Assessment (OSCA) result for undergraduate nursing students and identify whether individual assessor perceptions and professional characteristics have an impact on students' results. Results from 25 participants showed that although less than half (44%) of the participants were teaching in the course that they were assessing, the participants were highly experienced clinicians and nearly three-quarters (72%) had completed formal teaching qualifications. There were wide variations in pass rates (16.7–90%) between assessors. The widest disparity was observed between assessors with and those without critical care experience (66% versus 39%), as well as assessors who were teaching the course and those who were not (68% versus 49%). Qualitative analysis revealed three dominant themes within participants' transcripts. The themes focused on determining student safety, and the use of personal perceptions and clinical experience to determine competency. Findings indicate that assessors' individual perceptions and clinical experience have the potential to influence and determine undergraduate nursing students OSCA results. Development of criteria standards and objective assessment may be enhanced by greater involvement of assessors and thorough education and training within the context of student assessments.

Professional knowledge and standards-based reforms: Learning from the experiences of early career teachers

This article explores the paradoxical situation of early career teachers in this era of standards-based reforms, beginning with the experiences of an English teacher working in a state school in Queensland, Australia and expanding to consider the viewpoints of her colleagues. Our goal is to trace the ways she and the other early career teachers at this particular school negotiate the tensions between the current emphases on standardisation of curricula, testing regimes and teaching standards and their burgeoning sense of their identities as teachers. We shall raise questions about the status of the professional knowledge that these early career teachers bring to their work, showing examples of how this knowledge puts them at odds with standards-based reforms, including the professional standards recently introduced by the Australian Institute for Teaching and School Leadership (AITSL) and the National Assessment Program – Literacy and Numeracy (NAPLAN).

Towards a framework for aligning learning outcomes, academic literacies and assessment criteria

Although Australian students spend three or more years studying they can seem quite unaware of any of the expected learning outcomes of their course. They are often single unit focused, paying most attention to individual assessment items thus not developing a holistic view of their course. This paper presents a theoretical framework to support staff and students to recognise, scaffold and achieve learning outcomes and academic skills at unit level and to recognise how these contribute to course and graduate learning outcomes, within the boundaries of Australian university and professional accreditation requirements. A case study is described that demonstrates the manual implementation of the framework. The complex nature of the implementation suggests that a software solution is required to ease the process and ensure the resulting mapping will have some longevity by being maintainable.

Assessment policies, curricular directives, and teacher agency: quandaries of EFL teachers in Inner Mongolia

In the debate over English language teaching approaches and methods, the influence of examinations on classroom pedagogy and the nature of these examinations are critical considerations for teachers. In the Inner Mongolian context, as for all China, examinations reflect traditional conceptions of teaching and learning, classroom teaching conditions such as class sizes, and the English-as-a-foreign language setting. In this situation, decisions about classroom pedagogy and objectives and whether teaching focuses on test-taking rather than on the learning of language go to the core of teacher agency. In this paper we foreground the struggles and dilemmas experienced by English language teachers in Inner Mongolia in attempts to exercise agency amidst the instructional demands of an exam-oriented community, and a misalignment created by an exam remaining centered on discrete skills rather than students' proficiency in applying ranging uses of the language they are learning. These conditions are now located within New English Syllabus expectations are that teachers will implement their knowledge of educational theories and of current English teaching methodology to create opportunities for more broadly based learning and proficiency. © 2014 © 2014 Taylor & Francis.

Does student engagement in self-assessment calibrate their judgement over time?

One of the implicit aims of higher education is to enable students to become better judges of their own work. This paper examines whether students who voluntarily engage in self-assessment improve in their capacity to make those judgements. The study utilises data from a web-based marking system that provides students with the opportunity to assess themselves on each criterion for each assessment task throughout a programme of study. Student marks were compared with those from tutors to plot changes over time. The findings suggest that overall students’ judgements do converge with those of tutors, but that there is considerable variation across achievement levels, with weaker students showing little improvement. Whilst the study is limited by the exigencies of voluntary participation and thus consequential gaps in the data set, it shows how judgement over time can be demonstrated and points to the potential for more systematic interventions to improve students’ judgements. It also illustrates the use of the web-based marking and feedback software (ReView) that has considerable utility in aiding self-assessment research.