Assessment in education : principles, policy and practice

The English examination system provides a market in which a limited number of providers are accredited to offer curriculum-based examinations in many subject areas and at several levels. The most significant are the General Certificate of Secondary Education (GCSE) and the General Certificate of Education, Advanced (A level). Because these examinations are used for high-stakes purposes, including higher education and employment selection for individuals and programme evaluation for institutions, it is desired that scores from various exams be ‘comparable’ in several respects: across syllabuses and examination boards within a subject area, across years, and even across subject areas. Just how to accomplish this goal has been a topic of continual research and debate for over 50 years, through many changes of examination and institutional structures. But ever year, tens of thousands of scores must be reported, and every year, users expect them to ‘be comparable’ and use them as if they are.

Deepening our understanding about school leadership : learning from educators and non-educators

Increasingly, leadership is argued as a way forward to improve performance and practice in a variety of contexts. School leadership is no different. There is little doubt that in the current globalised world characterized by change and complexity, effective school leadership is a key requirement. The contribution of this chapter is framed around a synthesis of current research, writing and theoretical insights regarding leadership. It draws upon three bodies of writing, Firstly, it begins by distilling several key themes and trends regarding educational leadership from the current research and writing. Secondly, it reports on the findings of a current research project carried out by the authors that explored the leadership stories of ten outstanding leaders from non-educational settings in Australia. Finally, it concludes by referring to some of the paradoxes and tensions inherent in the work of school leaders. It is argued that understanding and endeavouring to reconcile these dilemmas is a pre-requisite for school leaders as they continue to operate in an environment fraught with change and complexity.

Assessment for learning revisited : an Asia-Pacific perspective

In March of this year, 2009, the Third International Conference on Assessment for Learning was held in Dunedin, New Zealand. Colleagues from Australia (4), Canada (6), Europe (5), New Zealand (7), United Kingdom (5) and the United States of America (4) met to advance the understanding and practices of Assessment for Learning at all levels of education. An important outcome of this meeting was a position paper on Assessment for Learning (AfL) that has been reproduced with permission in this editorial because of its significance to a recurrent theme of the majority of the articles published in this special Asia-Pacific issue of the journal. The text of this statement is set out in italics below.

Learning to drive with cognitive impairment : the experience of young ADHD diagnosed drivers and their parent supervisors

A subset of novice drivers exhibit executive function impairments which may adversely impact on the learn-to-drive period and subsequent driving experience, potentially explaining their overrepresentation in traffic offences and crashes. This paper presents the results of a qualitative analysis of a small series of in-depth semi-structured interviews undertaken individually with affected young drivers (n = 7) and each of their parent supervisors (n = 6). Young drivers were selected on the basis of their ADHD diagnosis, as a sample particularly affected by executive function impairments. Standardised rating scale measures confirmed the currency of the young drivers’ ADHD symptoms and executive function impairment. Results are discussed in terms of common experiences of the young affected drivers and those of their parents as supervising drivers of the learn-to-drive process and subsequent driving behaviour. Key themes included difficulties that were related to core executive function impairments symptomatic of ADHD. Themes also included common emotions that the young drivers associated with driving, with particular types of impact on their driving behaviour. Common strategies that were used by both the young driver and their parent during this learning process and their perceived effectiveness are also discussed. Those that were perceived to be most effective tended to focus on reducing the cognitive load for the young driver when introducing new information and skills.

Toward a fuzzy domain ontology extraction method for adaptive e-learning

With the widespread applications of electronic learning (e-Learning) technologies to education at all levels, increasing number of online educational resources and messages are generated from the corresponding e-Learning environments. Nevertheless, it is quite difficult, if not totally impossible, for instructors to read through and analyze the online messages to predict the progress of their students on the fly. The main contribution of this paper is the illustration of a novel concept map generation mechanism which is underpinned by a fuzzy domain ontology extraction algorithm. The proposed mechanism can automatically construct concept maps based on the messages posted to online discussion forums. By browsing the concept maps, instructors can quickly identify the progress of their students and adjust the pedagogical sequence on the fly. Our initial experimental results reveal that the accuracy and the quality of the automatically generated concept maps are promising. Our research work opens the door to the development and application of intelligent software tools to enhance e-Learning.

Levelling expectations across different years in an undergraduate degree to support work-related learning : evidence for a multi-pronged approach.

One of the ways in which university departments and faculties can enhance the quality of learning and assessment is to develop a ‘well thought out criterion‐referenced assessment system’ (Biggs, 2003, p. 271). In designing undergraduate degrees (courses) this entails making decisions about the levelling of expectations across different years through devising objectives and their corresponding criteria and standards: a process of alignment analogous to what happens in unit (subject) design. These decisions about levelling have important repercussions in terms of supporting students’ work‐related learning, especially in relation to their ability to cope with the increasing cognitive and skill demands made on them as they progress through their studies. They also affect the accountability of teacher judgments of students’ responses to assessment tasks, achievement of unit objectives and, ultimately, whether students are awarded their degrees and are sufficiently prepared for the world of work. Research reveals that this decision‐making process is rarely underpinned by an explicit educational rationale (Morgan et al, 2002). The decision to implement criterion referenced assessment in an undergraduate microbiology degree was the impetus for developing such a rationale because of the implications for alignment, and therefore ‘levelling’ of expectations across different years of the degree. This paper provides supporting evidence for a multi‐pronged approach to levelling, through backward mapping of two revised units (foundation and exit year). This approach adheres to the principles of alignment while combining a work‐related approach (via industry input) with the blended disciplinary and learner‐centred approaches proposed by Morgan et al. (2002). It is suggested that this multi‐pronged approach has the potential for making expectations, especially work‐related ones across different year levels of degrees, more explicit to students and future employers.

Harnessing assessment and feedback in the first year to support learning success, engagement and retention

It has been argued that intentional first year curriculum design has a critical role to play in enhancing first year student engagement, success and retention (Kift, 2008). A fundamental first year curriculum objective should be to assist students to make the successful transition to assessment in higher education. Scott (2006) has identified that ‘relevant, consistent and integrated assessment … [with] prompt and constructive feedback’ are particularly relevant to student retention generally; while Nicol (2007) suggests that ‘lack of clarity regarding expectations in the first year, low levels of teacher feedback and poor motivation’ are key issues in the first year. At the very minimum, if we expect first year students to become independent and self-managing learners, they need to be supported in their early development and acquisition of tertiary assessment literacies (Orrell, 2005). Critical to this attainment is the necessity to alleviate early anxieties around assessment information, instructions, guidance, and performance. This includes, for example:  inducting students thoroughly into the academic languages and assessment genres they will encounter as the vehicles for evidencing learning success; and  making expectations about the quality of this evidence clear. Most importantly, students should receive regular formative feedback of their work early in their program of study to aid their learning and to provide information to both students and teachers on progress and achievement. Leveraging research conducted under an ALTC Senior Fellowship that has sought to articulate a research-based 'transition pedagogy' (Kift & Nelson, 2005) – a guiding philosophy for intentional first year curriculum design and support that carefully scaffolds and mediates the first year learning experience for contemporary heterogeneous cohorts – this paper will discuss theoretical and practical strategies and examples that should be of assistance in implementing good assessment and feedback practices across a range of disciplines in the first year.

Mainstreamed students with learning difficulties : failing and underachieving in the secondary school

Despite the rhetoric that students with learning difficulties are adequately supported within schools, the evidence suggests that they continue to experience school failure with devastating consequences. Students with learning difficulties are disproportionately represented as juvenile delinquents, as the unemployed and in mental health statistics. However, the defining of this group remains confused and imprecise and has not been a national priority. This has repercussions for both secondary schools and for the students themselves. This paper highlights research related to teaching practices, policies and school structure and their effects on the academic outcomes and emotional well being of students with learning difficulties. Finally, it makes a number of recommendations to change the status quo for these students.

Transfer of learning across the globe : pre-service teachers taking the initiative

A continuing challenge for pre-service teacher education is the learning transfer between the university based components and the practical school based components of their training. It is not clear how easily pre-service teachers can transfer university learnings into ‘in school’ practice. Similarly, it is not clear how easily knowledge learned in the school context can be disembedded from this particular context and understood more generally by the pre-service teacher. This paper examines the effect of a community of practice formed specifically to explore learning transfer via collaboration and professional enquiry, in ‘real time’, across the globe. “Activity Theory” (Engestrom, 1999) provided the theoretical framework through which the cognitive, physical and social processes involved could be understood. For the study, three activity systems formed community of practice network. The first activity system involved pre-service teachers at a large university in Queensland, Australia. The second activity system was introduced by the pre-service teachers and involved Year 12 students and teachers at a private secondary school also in Queensland, Australia. The third activity system involved university staff engineers at a large university in Pennsylvania, USA. The common object among the three activity systems was to explore the principles and applications of nanotechnology. The participants in the two Queensland activity systems, controlled laboratory equipment (a high powered Atomic Force Microscope – CPII) in Pennsylvania, USA, with the aim of investigating surface topography and the properties of nano particles. The pre-service teachers were to develop their remote ‘real time’ experience into school classroom tasks, implement these tasks, and later report their findings to other pre-service teachers in the university activity system. As an extension to the project, the pre-service teachers were invited to co-author papers relating to the project. Data were collected from (a) reflective journals; (b) participant field notes – a pre-service teacher initiative; (c) surveys – a pre-service teacher initiative; (d) lesson reflections and digital recordings – a pre-service teacher initiative; and (e) interviews with participants. The findings are reported in terms of the major themes: boundary crossing, the philosophy of teaching, and professional relationships The findings have implications for teacher education. The researchers feel that deliberate planning for networking between activity systems may well be a solution to the apparent theory/practice gap. Proximity of activity systems need not be a hindering issue.

Problem-based learning (PBL) in Virtual Space : Developing experiences for professional development

This book reports the outcomes of an investigation into discovering the qualitatively different ways that students experience Problem-based learning (PBL)in virtual space. PBL is increasingly being used in many fields including engineering education. At the same time, many engineering education providers are turning to online distance education. Unfortunately there is a dearth of research into what constitutes an effective learning experience for adult learners who undertake PBL instruction through online distance education. Data were collected from a course which adopted the PBL strategy and was delivered entirely in virtual space. Students were asked to respond to open-ended questions designed to elicit their learning experiences. Data were analysed using the phenomenographic approach. Five qualitatively different ways of experiencing PBL in virtual space were discovered. Results indicate that the design of students' online learning experience was responsible for making students aware of deeper ways of experienceing PBL in virtual space. The outcomes imply that pedagogical strategies can be devised for shifting students' focus as they engage in virtual PBL.

Virtual reality or virtually real : blended teaching and learning in a Master's level research methods class

This paper examines the enabling effect of using blended learning and synchronous internet mediated communication technologies to improve learning and develop a Sense of Community (SOC) in a group of post-graduate students consisting of a mix of on-campus and off-campus students. Both quantitative and qualitative data collected over a number of years supports the assertion that the blended learning environment enhanced both teaching and learning. The development of a SOC was pivotal to the success of the blended approach when working with geographically isolated groups within a single learning environment.

Writing together, learning together : the value and effectiveness of a research writing group for doctoral students

The high level of scholarly writing required for a doctoral thesis is a challenge for many research students. However, formal academic writing training is not a core component of many doctoral programs. Informal writing groups for doctoral students may be one method of contributing to the improvement of scholarly writing. In this paper, we report on a writing group that was initiated by an experienced writer and higher degree research supervisor to support and improve her doctoral students’ writing capabilities. Over time, this group developed a workable model to suit their varying needs and circumstances. The model comprised group sessions, an email group, and individual writing. Here, we use a narrative approach to explore the effectiveness and value of our research writing group model in improving scholarly writing. The data consisted of doctoral students’ reflections to stimulus questions about their writing progress and experiences. The stimulus questions sought to probe individual concerns about their own writing, what they had learned in the research writing group, the benefits of the group, and the disadvantages and challenges to participation. These reflections were analysed using thematic analysis. Following this analysis, the supervisor provided her perspective on the key themes that emerged. Results revealed that, through the writing group, members learned technical elements (e.g., paragraph structure), non-technical elements (e.g., working within limited timeframes), conceptual elements (e.g., constructing a cohesive arguments), collaborative writing processes, and how to edit and respond to feedback. In addition to improved writing quality, other benefits were opportunities for shared writing experiences, peer support, and increased confidence and motivation. The writing group provides a unique social learning environment with opportunities for: professional dialogue about writing, peer learning and review, and developing a supportive peer network. Thus our research writing group has proved an effective avenue for building doctoral students’ capability in scholarly writing. The proposed model for a research writing group could be applicable to any context, regardless of the type and location of the university, university faculty, doctoral program structure, or number of postgraduate students. It could also be used within a group of students with diverse research abilities, needs, topics and methodologies. However, it requires a group facilitator with sufficient expertise in scholarly writing and experience in doctoral supervision who can both engage the group in planned writing activities and also capitalise on fruitful lines of discussion related to students’ concerns as they arise. The research writing group is not intended to replace traditional supervision processes nor existing training. However it has clear benefits for improving scholarly writing in doctoral research programs particularly in an era of rapidly increasing student load.

Enhancing Student Learning in Large Undergraduate Clasees by Using Audio-visual Case Studies

Critical skills such as identifying and appreciating issues that confront firms engaging in international business, and the ability to undertake creative decision-making, are considered fundamental to the study of International Business. It has been argued that using audio-visual case studies can help develop such skills. However, this is difficult due to a lack of Australian case studies. This paper reviews the literature outlining the advantages believed to result from the use of audio-visual case studies, describes a project implemented in a large cohort of students studying International Business, reports on a pilot evaluation of the project, and outlines the findings and conclusions of the survey.

Mainstreaming sustainability into pre-service teacher edcuation in Australia

There is a growing interest in and support for education for sustainability in Australian schools. Australian Government schemes such as the Australian Sustainable Schools Initiative (AuSSI), along with strategies such as Educating for a Sustainable Future: A National Environmental Education Statement for Australian Schools(NEES(Australian Government and Curriculum Corporation (2005) and Living Sustainably: The Australian Government’s National Action Plan for Education for Sustainability (Australian Government 2009), recognise the need and offer support for education for sustainability in Australian schools. The number of schools that have engaged with AuSSI indicates that this interest also exists within Australian schools. Despite this, recent research indicates that pre-service teacher education institutions and programs are not doing all they can to prepare teachers for teaching education for sustainability or for working within sustainable schools. The education of school teachers plays a vital role in achieving changes in teaching and learning in schools. Indeed, the professional development of teachers in education for sustainability has been identified as ‘the priority of priorities’. Much has been written about the need to ‘reorient teacher education towards sustainability’. Teacher education is seen as a key strategy that is yet to be effectively utilised to embed education for sustainability in schools. Mainstreaming sustainability in Australian schools will not be achieved without the preparation of teachers for this task. The Mainstreaming Sustainability model piloted in this study seeks to engage a range of stakeholder organisations and key agents of change within a system to all work simultaneously to bring about a change, such as the mainstreaming of sustainability. The model is premised on the understanding that sustainability will be mainstreamed within teacher education if there is engagement with key agents of change across the wider teacher education system and if the key agents of change are ‘deeply’ involved in making the change. The model thus seeks to marry broad engagement across a system with the active participation of stakeholders within that system. Such a systemic approach is a way of bringing together diverse viewpoints to make sense of an issue and harness that shared interpretation to define boundaries, roles and relationships leading to a better defined problem that can be acted upon more effectively. Like action research, the systemic approach is also concerned with modelling change and seeking plausible solutions through collaboration between stakeholders. This is important in ensuring that outcomes are useful to the researchers/stakeholders and the system being researched as it creates partnerships and commitments to the outcomes by stakeholder participants. The study reported on here examines whether the ‘Mainstreaming Sustainability’ model might be effective as a means to mainstream sustainability in pre-service teacher education. This model, developed in an earlier study, was piloted in the Queensland teacher education system in order to examine its effectiveness in creating organisational and systemic change. The pilot project in Queensland achieved a number of outcomes. The project: • provided useful insights into the effectiveness of the Mainstreaming Sustainability model in bringing about change while also building research capacity within the system • developed capacities within the teacher education community: o developing competencies in education for sustainability o establishing more effective interactions between decision-makers and other stakeholders o establishing a community of inquiry • changed teaching and learning approaches used in participating teacher education institutions through: o curriculum and resource development o the adoption of education for sustainability teaching and learning processes o the development of institutional policies • improved networks within the teacher education system through: o identifying key agents of change within the system o developing new, and building on existing, partnerships between schools, teacher education institutions and government agencies • engaged relevant stakeholders such as government agencies and non-government organisations to understand and support the change Our findings indicate that the Mainstreaming Sustainability model is able to facilitate organisational and systemic change – over time – if: • the individuals involved have the conceptual and personal capacities needed to facilitate change, that is, to be a key agent of change • stakeholders are engaged as participants in the process of change, not simply as ‘interested parties’ • there is a good understanding of systemic change and the opportunities for leveraging change within systems. In particular, in seeking to mainstream sustainability in pre-service teacher education in Queensland it has become clear that one needs to build capacity for change within participants such as knowledge of education for sustainability, conceptual skills in systemic thinking, action research and organisational change, and leadership skills. It is also of vital importance that key agents of change – those individuals who are ‘hubs’ within a system and can leverage for change across a wide range of the system – are identified and engaged with as early as possible. Key agents of change can only be correctly identified, however, if the project leaders and known participants have clearly identified the boundary to their system as this enables the system, sub-system and environment of the system to be understood. Through mapping the system a range of key organisations and stakeholders will be identified, including government and nongovernment organisations, teacher education students, teacher education academics, and so on. On this basis, key agents of change within the system and sub-system can be identified and invited to assist in working for change. A final insight is that it is important to have time – and if necessary the funding to ‘buy time’ – in seeking to bring about system-wide change. Seeking to bring about system-wide change is an ambitious project, one that requires a great deal of effort and time. These insights provide some considerations for those seeking to utilise the Mainstreaming Sustainability model to bring about change within and across a pre-service teacher education system.