Standards-driven reform years 1-10 : moderation an optional extra?

While externally moderated standards-based assessment has been practised in Queensland senior schooling for more than three decades, there has been no such practice in the middle years. With the introduction of standards at state and national levels in these years, teacher judgement as developed in moderation practices is now vital. This paper argues, that in this context of assessment reform, standards intended to inform teacher judgement and to build assessment capacity are necessary but not sufficient for maintaining teacher and public confidence in schooling. Teacher judgement is intrinsic to moderation, and to professional practice, and can no longer remain private. Moderation too is intrinsic to efforts by the profession to realise judgements that are defensible, dependable and open to scrutiny. Moderation can no longer be considered an optional extra and requires system-level support especially if, as intended, the standards are linked to system-wide efforts to improve student learning. In presenting this argument we draw on an Australian Research Council funded study with key industry partners (the Queensland Studies Authority and the National Council for Curriculum and Assessment of the Republic of Ireland). The data analysed included teacher interview data and additional teacher talk during moderation sessions. These were undertaken during the initial phase of policy development. The analysis identified those issues that emerge in moderation meetings that are designed to reach consistent, reliable judgements. Of interest are the different ways in which teachers talked through and interacted with one another to reach agreement about the quality of student work in the application of standards. There is evidence of differences in the way that teachers made compensations and trade-offs in their award of grades, dependent on the subject domain in which they teach. This article concludes with some empirically derived insights into moderation practices as policy and social events.

The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

Developing reflective practitioners online: The business of blogs in work integrated learning

Reflective practice is widely considered across discussions around educational psychology, professional identity, employability of graduates, and generic or graduate capabilities. Critical reflection is essential for providing a bridge between the university and the workplace, and for ultimately preparing work ready graduates (Patrick et al, 2008). Work integrated learning, particularly through internships and work placements for students, is viewed as a valuable approach for students developing skills in reflective practice. Reflective journals are one of the tools often used to encourage and develop student reflection. Shifting the reflective journal to an online interface as a reflective blog presents opportunities for more meaningful, frequent and richer interaction between the key players in a work integrated learning experience. This paper examines the adoption, implementation and refinement of the use of reflective blogs in a work integrated learning unit for business students majoring in advertising, marketing and public relations disciplines. The reflective blog is discussed as a learning and assessment tool, including the approaches taken to integrate and scaffold the blog as part of the work integrated learning experience. Graduate capabilities were used as cornerstones for students to frame students’ thinking, experiences and reflection. These capabilities emphasise the value of coherent theoretical and practical knowledge, coupled with critical, creative and analytical thinking, problem solving skills, self reliance and resilience. Underlying these graduate capabilities is a focus on assessment for learning matched with assessment of learning. Using specific triggers and prompts as part of the reflective process, and incorporating ongoing feedback from academic supervisors, students moved from descriptive levels of reflection, to more meaningful and critical reflection. Students’ blogs are analysed to identify key themes, challenges and achievements in the work integrated learning experience. Suggestions for further development and improvement, together with a model of best practice, are proposed.

Preparing quality teachers : making learning visible

Teacher quality is recognised as a lynchpin for education reforms internationally, and both Federal and State governments in Australia have turned their attention to teacher education institutions: the starting point for preparing quality teachers. Changes to policy and shifts in expectations impact on Faculties of Education, despite the fact that little is known about what makes a quality teacher preparation program effective. New accountability measures, mandated Professional Standards, and proposals to test all graduates before registration, mean that teacher preparation programs need capacity for flexibility and responsiveness. The risk is that undergraduate degree programs can become ‘patchwork quilts’ with traces of the old and new stitched together, sometimes at the expense of coherence and integrity. This paper provides a roadmap used by one large Faculty of Education in Queensland for reforming and reconceptualising the curriculum for a 4-year undergraduate program, in response to new demands from government and the professional bodies.

The five myths of academic standards

This script provided the basis for a short DVD produced in 2010. The script and DVD were products of research into the introduction of 'minimum threshold' academic standards to Australian Universities. Learning and teaching academic standards are publicly defensible statements about academic standards in all disciplines, intended to establish 'baseline expectations' for undergraduate and postgraduate degrees. The script was developed using an 'anti-model' approach to character and narrative. This produced a set of deliberately skewed perspectives on the standards initiative, which are intended stimulate discussion and debate on the topic. The DVD has been shown to a range of stakeholder audiences in a variety of academic forums.

Drawing on imagination : primary students' ideal learning environments

Research has established a close relationship between learning environments and learning outcomes (Department of Education and Early Childhood Development, Victoria, 2008; Woolner, Hall, Higgins, McCaughey & Wall, 2007) yet little is known about how students in Australian schools imagine the ways that their learning environments could be improved to enhance their engagement with the processes and content of education and children are rarely consulted on the issue of school design (Rudduck & Flutter, 2004). Currently, school and classroom designers give attention to operational matters of efficiency and economy, so that architecture for children’s education is largely conceived in terms of adult and professional needs (Halpin, 2007). This results in the construction of educational spaces that impose traditional teaching and learning methods, reducing the possibilities of imaginative pedagogical relationships. Education authorities may encourage new, student-centred pedagogical styles, such as collaborative learning, team-teaching and peer tutoring, but the spaces where such innovations are occurring do not always provide the features necessary to implement these styles. Heeding the views of children could result in the creation of spaces where more imaginative pedagogical relationships and student-centred pedagogical styles can be implemented. In this article, a research project conducted with children in nine Queensland primary schools to investigate their ideas of the ideal ‘school’ is discussed. Overwhelmingly, the students’ work emphasised that learning should be fun and that learning environments should be eco-friendly places where their imaginations can be engaged and where they learn from and in touch with reality. The children’s imagined schools echo ideas that have been promoted over many decades by progressive educators such as John Dewey (1897, in Provenzo, 2006) (“experiential learning”), AS Neill (in Cassebaum, 2003) (Summerhill school) and Ivan Illich (1970) (“deschooling”), with a vast majority of students suggesting that, wherever possible, learning should take place away from classrooms and in environments that support direct, hands-on learning.

Assessment for learning in the accountability era : Queensland, Australia

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative analyses of student achievement data, have challenged State efforts to maintain the emphasis on assessment to promote learning while fulfilling accountability demands. In this article lessons from the Queensland experience indicate that it is important to build teachers' assessment capacity and their assessment literacy for the promotion of student learning. It is argued that teacher assessment can be a source of dependable results through moderation practice. The Queensland Studies Authority has recognised and supported the development of teacher assessment and moderation practice in the context of standards-driven, national reform. Recent research findings explain how the focus on learning can be maintained by avoiding an over-interpretation of test results in terms of innate ability and limitations and by encouraging teachers to adopt more tailored diagnosis of assessment data to address equity through focus on achievement for all. Such efforts are challenged as political pressures related to the Australian government’s implementation of national testing and national partnership funding arrangements tied to the performance of students at or below minimum standards become increasingly apparent.

Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System

This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs’ SOLO taxonomy. However, written assessment items require extensive resources for marking, and are susceptible to copying as well as marking inconsistencies for large classes. This project developed an assessment tool which is valid, reliable and sustainable and that addresses the issues identified above. The tool provides each student with an assignment assessing the same learning outcomes, but containing different questions, with responses in the form of words or numbers. Practice questions are available, enabling students to obtain feedback on their approach before submitting their assignment. Thus, the tool incorporates automatic marking (essential for large classes), randomised tasks to each student (reducing copying), the capacity to give credit for working (feedback on the application of theory), and the capacity to target higher order learning outcomes by requiring students to derive their answers rather than choosing them. Results and feedback from students are presented, along with technical implementation details.

Development and evaluation of an integrated clinical learning model to inform continuing education for acute care nurses

Background Significant ongoing learning needs for nurses have occurred as a direct result of the continuous introduction of technological innovations and research developments in the healthcare environment. Despite an increased worldwide emphasis on the importance of continuing education, there continues to be an absence of empirical evidence of program and session effectiveness. Few studies determine whether continuing education enhances or develops practice and the relative cost benefits of health professionals’ participation in professional development. The implications for future clinical practice and associated educational approaches to meet the needs of an increasingly diverse multigenerational and multicultural workforce are also not well documented. There is minimal research confirming that continuing education programs contribute to improved patient outcomes, nurses’ earlier detection of patient deterioration or that standards of continuing competence are maintained. Crucially, evidence-based practice is demonstrated and international quality and safety benchmarks are adhered to. An integrated clinical learning model was developed to inform ongoing education for acute care nurses. Educational strategies included the use of integrated learning approaches, interactive teaching concepts and learner-centred pedagogies. A Respiratory Skills Update education (ReSKU) program was used as the content for the educational intervention to inform surgical nurses’ clinical practice in the area of respiratory assessment. The aim of the research was to evaluate the effectiveness of implementing the ReSKU program using teaching and learning strategies, in the context of organisational utility, on improving surgical nurses’ practice in the area of respiratory assessment. The education program aimed to facilitate better awareness, knowledge and understanding of respiratory dysfunction in the postoperative clinical environment. This research was guided by the work of Forneris (2004), who developed a theoretical framework to operationalise a critical thinking process incorporating the complexities of the clinical context. The framework used educational strategies that are learner-centred and participatory. These strategies aimed to engage the clinician in dynamic thinking processes in clinical practice situations guided by coaches and educators. Methods A quasi experimental pre test, post test non–equivalent control group design was used to evaluate the impact of the ReSKU program on the clinical practice of surgical nurses. The research tested the hypothesis that participation in the ReSKU program improves the reported beliefs and attitudes of surgical nurses, increases their knowledge and reported use of respiratory assessment skills. The study was conducted in a 400 bed regional referral public hospital, the central hub of three smaller hospitals, in a health district servicing the coastal and hinterland areas north of Brisbane. The sample included 90 nurses working in the three surgical wards eligible for inclusion in the study. The experimental group consisted of 36 surgical nurses who had chosen to attend the ReSKU program and consented to be part of the study intervention group. The comparison group included the 39 surgical nurses who elected not to attend the ReSKU program, but agreed to participate in the study. Findings One of the most notable findings was that nurses choosing not to participate were older, more experienced and less well educated. The data demonstrated that there was a barrier for training which impacted on educational strategies as this mature aged cohort was less likely to take up educational opportunities. The study demonstrated statistically significant differences between groups regarding reported use of respiratory skills, three months after ReSKU program attendance. Between group data analysis indicated that the intervention group’s reported beliefs and attitudes pertaining to subscale descriptors showed statistically significant differences in three of the six subscales following attendance at the ReSKU program. These subscales included influence on nursing care, educational preparation and clinical development. Findings suggest that the use of an integrated educational model underpinned by a robust theoretical framework is a strong factor in some perceptions of the ReSKU program relating to attitudes and behaviour. There were minimal differences in knowledge between groups across time. Conclusions This study was consistent with contemporary educational approaches using multi-modal, interactive teaching strategies and a robust overarching theoretical framework to support study concepts. The construct of critical thinking in the clinical context, combined with clinical reasoning and purposeful and collective reflection, was a powerful educational strategy to enhance competency and capability in clinicians.

Developing shared understandings of standards-based assessment : online moderation practices across geographically diverse contexts

This thesis investigates the place of online moderation in supporting teachers to work in a system of standards-based assessment. The participants of the study were fifty middle school teachers who met online with the aim of developing consistency in their judgement decisions. Data were gathered through observation of the online meetings, interviews, surveys and the collection of artefacts. The data were viewed and analysed through sociocultural theories of learning and sociocultural theories of technology, and demonstrates how utilising these theories can add depth to understanding the added complexity of developing shared meaning of standards in an online context. The findings contribute to current understanding of standards-based assessment by examining the social moderation process as it acts to increase the reliability of judgements that are made within a standards framework. Specifically, the study investigates the opportunities afforded by conducting social moderation practices in a synchronous online context. The study explicates how the technology affects the negotiation of judgements and the development of shared meanings of assessment standards, while demonstrating how involvement in online moderation discussions can support teachers to become and belong within a practice of standards-based assessment. This research responds to a growing international interest in standards-based assessment and the use of social moderation to develop consistency in judgement decisions. Online moderation is a new practice to address these concerns on a systemic basis.

Conceptualising and teaching discursive and performative reflection in higher education

The importance of reflection in higher education, and across disciplinary fields is widely recognised. It is generally embedded in university graduate attributes, professional standards and course objectives. Furthermore, reflection is commonly included in assessment requirements in higher education subjects, often without necessary scaffolding or clear expectations for students. It is essential that academic staff have substantive knowledge and clear expectations about the aims of reflective activities, the most effective mode of representation, and appropriate teaching strategies to support students in deep, critical reflection. The paper argues the case for reflection to be represented in different modes, using discursive (language) or performative (symbolic practice) forms of expression according to disciplinary context and individual communicative strengths. It introduces key discursive and expressive elements that constitute different modes of representation in reflective tasks. This functional analysis of textual elements provides explicit knowledge for teaching and assessing multiple modes of reflection in higher education.

Hunters & gatherers : strategies for curriculum mapping and data collection for assurance of learning

Assurance of learning is a predominant feature in both quality enhancement and assurance in higher education. Assurance of learning is a process that articulates explicit program outcomes and standards, and systematically gathers evidence to determine the extent to which performance matches expectations. Benefits accrue to the institution through the systematic assessment of whole of program goals. Data may be used for continuous improvement, program development, and to inform external accreditation and evaluation bodies. Recent developments, including the introduction of the Tertiary Education and Quality Standards Agency (TEQSA) will require universities to review the methods they use to assure learning outcomes. This project investigates two critical elements of assurance of learning: 1. the mapping of graduate attributes throughout a program; and 2. the collection of assurance of learning data. An audit was conducted with 25 of the 39 Business Schools in Australian universities to identify current methods of mapping graduate attributes and for collecting assurance of learning data across degree programs, as well as a review of the key challenges faced in these areas. Our findings indicate that external drivers like professional body accreditation (for example: Association to Advance Collegiate Schools of Business (AACSB)) and TEQSA are important motivators for assuring learning, and those who were undertaking AACSB accreditation had more robust assurance of learning systems in place. It was reassuring to see that the majority of institutions (96%) had adopted an embedding approach to assuring learning rather than opting for independent standardised testing. The main challenges that were evident were the development of sustainable processes that were not considered a burden to academic staff, and obtainment of academic buy in to the benefits of assuring learning per se rather than assurance of learning being seen as a tick box exercise. This cultural change is the real challenge in assurance of learning practice.

The teacher as reflexive professional : making visible the excluded discourse in teacher standards

In the current climate of accountability, political manoeuvring, changing curriculum, increasingly diverse student cohorts and community expectations, teachers, more than ever, need to develop the skills and abilities to be reflective and reflexive practitioners. This study examines national teacher professional standards from Australia and the UK to identify the extent to which reflexivity is embedded in key policy documents that are intended to guide the work of teachers in those countries. Using Margaret Archer's theories of reflexivity and morphogenesis, and methods of critical discourse analysis, we argue that these blueprints for teachers’ work exclude reflexivity as an essential and overarching discourse of teacher professionalism.

Integration of CENA practice standards for postgraduate emergency nursing assessment

The use of professional competency standards to assess postgraduate nursing student’s clinical performance has been in place since 2004, at the Queensland University of Technology, School of Nursing & Midwifery (SONAM) when the Graduate Certificate in Emergency Nursing degree commenced. Emergency nursing students were assessed in their workplace, using a Clinical Performance Appraisal Tool or CPAT which was based on the Australian College of Critical Care Nurses (ACCCN) Competency Standards. With the subsequent formation of a separate Emergency Nursing Course advisory group in 2007, there was a review of clinical assessment course component. The release of the 2008 CENA revised Practice Standards for the Emergency Nursing Specialist’s, led to the emergency nursing course advisory committee supporting the integration of the CENA practice standards for assessment of emergency nurses in preference to the less relevant ACCCN competency standards. The SONAM emergency nursing study area team commenced the phasing in and progression of the CENA practice standards across the two Graduate Certificate units, and Graduate Diploma and Master of Nursing (emergency) clinical major options in 2009. As some units undertaken in the degree are available to nurses in other disciplines a separate CPAT was devised for the clinical assessments according to speciality context. The team has had to carefully consider how the professional standards are integrated into the teaching and assessment of the unit and not just applied instead of the ACCCN competency standards. Professional standards for the emergency context has also helped tailor course content and learning outcomes to be relevant across a number of emergency nursing contexts in Australia. The assessment of the CPAT is undertaken at the workplace by QUT appointed clinical lecturers. Clinical lecturers need to apply and have suitable postgraduate qualification to undertake the position. The clinical lecturer support role is well established at QUT. The integration of the new CENA practice standards has necessitated a review of the postgraduate assessment of emergency nurses. A clinical lecturer workshop has been organised to review role, scope and how to utilise the new look CENA based CPAT, clinical assessment format.

Enhancing workplace learning through collaborative HRD

Human resource development (HRD) has evolved a great deal over the past 20 years. Indeed, developments in HRD theory, research and practice have helped transform HRD from a reactive function focusing on administrative and bureaucratic issues to a proactive function focusing on creating learning and development opportunities for employees that not only allow them to achieve their potential but also make a substantial contribution to the longterm survival and sustainability of the organisation. HRD is now seen as an investment in the future of an organisation. This investment perspective is based on the recognition that HRD is linked to business strategy and the achievement of competitive advantage (Caravan et al. 2002). One reason for the shift in emphasis is that many of the traditional sources of competitive advantage (technology, economies of scale) have diminished in value. Nowadays it is the workforce that has come to be seen as an important source of competitive advantage for the organisation. However, not too long ago employees were viewed by management as a disposable resource rather than an asset to an organisation.