Revisiting the impact of formative assessment opportunities in student learning

This project developed as a result of some inconclusive data from an investigation of whether a relationship existed between the use of formative assessment opportunities and performance, as measured by final grade. We were expecting to show our colleagues and students that use of formative assessment resources had the potential to improve performance of first year students. This first study, undertaken in semester 1 2002, indicated that there was no apparent relationship between the two, even though the students reported how useful they found the formative assessment resources. This led us to ask if there was a transition effect such that students were not yet working in an independent way and making full use of the resources, and/or whether in order to see an effect we needed to persuade non-users of the resources to become users, before investigating if use can be correlated with improvement in performance. With the 2002-3 NextEd ASCILITE Research Grant we set out to repeat our project and to look at use and usefulness of resources in both first and second semester, to encourage non-users to become users and to investigate the relationship between use and performance. Now our story has a different ending.

Revisiting associations between student performance outcomes and formative assessment opportunities: is there any impact on student learning?

This project developed as a result of some inconclusive data from an investigation of whether a relationship existed between the use of formative assessment opportunities and performance, as measured by final grade. We were expecting to show our colleagues and students that use of formative assessment resources had the potential to improve performance. This first study, done in semester 1 2002, indicated that there was no apparent relationship even though the students reported how useful they found the resources. This led us to ask if there was a transition effect
such that students were not yet working in an independent way and making full use of the resources, and/or whether in order to see an effect we needed to persuade non-users of the resources to become users before investigating if use can be correlated with improvement in performance. With the 2002-3 NextEd ASCILITE Research Grant we set out to repeat our project and to look at use and usefulness of resources in both first and second semester, to encourage non-users to become users and to investigate use with performance. Now our story has a different ending.

Using progression points for diagnostic (formative) assessment : chance

Find every Chance-related Progression Point, in Level-order, from Prep to Year 10. Translate each Progression Point into a pencil-and-paper task. This makes a developmentally or progressively graded worksheet-like ''diagnostic profile' for assessing knowledge of and skills with Chance. It is diagnostic because it starts with easy, early questions, and progressively gets harder and harder as the concepts and skills in the Chance curriculum develop. Presenting this diagnostic profile to students at the beginning of a unit of work on Chance gives invaluable formative assessment information to guide your teaching. Using the same profile, or a parrallel version at the end of the unit provides before-and-after summative assessment of the students' learning during the unit.

A preliminary study of open learner model representation formats to support formative assessment

Open learner models provide a way of showing teachers and students the learning progress of a student against expectations. Creating an effective interface to present a learner model is an important part in open learner modeling. Usefulness of the learner model relies on using a clear andeffective representation format to facilitate users’understanding of the information presented. In this paper, wepropose a range of open learner model representation formatsto display students’ learning task status and achievement interms of learning outcomes. We investigate different types ofrepresentation formats and data useful for users to inspect thelearner model. An interface design prototype has been built toprovide potential users with an evaluation platform thatenables investigation of these aspects. The results obtained willallow us to develop a more effective new open learner modelvisualisation tool.

Large-scale mathematics assessment : looking globally to act locally

In this paper, I will argue that it is possible to use data from large-scale international and national mathematics assessment programmes, whose attention is on summative achievement, to provide formative information that informs teachers about the effects of their classroom practice. However, to have impact on, and be useful for, classroom practitioners, these achievement data need to be reworked and re-presented in ways that are plausible, provide a basis for inferences about practice, and be appropriate for the intended audience. This paper examines achievement-focused assessment programmes in terms of their aims and approaches, and develops the argument that formative assessment possibilities are present, within these programmes, although usually hidden. Examples are drawn from several sources to support this argument, and demonstrate a variety of approaches that have been taken in the past. Suggestions for further action are made.

Using online environments to promote assessment as a learning enhancement process

The 21st century presents new challenges relating to the need for assessment to be more innovative, more responsive to students' needs, and more relevant and authentic. The characteristics of good assessment are well known and resources abound to assist academic staff to change their practices. Yet, at a time when the imperative for reconsidering practices has never been greater, it appears to be very difficult to bring about and maintain substantive change in assessment. This paper presents case studies that illustrate the way some academic staff have responded to the challenges. In particular, how the online environment can enhance learning through formative assessment is illustrated with four case studies. The paper outlines specific challenges faced in each case and  discusses issues that arose during development and delivery. It concludes by identifying some of the factors that helped to facilitate changes in assessment practices in these specific cases.

Overcoming inconsistencies in placement assessment : the case for developmental assessment centers

Placements are integral to many university courses and to increasing student employability skills. Nevertheless, several complications, such as the assessment of placement experiences which often go against the principles of procedural justice, may limit placement effectiveness. For example, procedures are not applied uniformly across students; and evaluations of intangible qualities are susceptible to biases. As a result, effort and learning can be compromised. This paper advocates the use of developmental assessment centers to help solve these shortcomings. Developmental assessment centers are often used in organizations to evaluate capabilities of individuals and to facilitate development. Participants complete a series of work related and standardized tasks. Multiple raters then utilize a systematic approach to evaluate participants on a range of competencies, and consequently present constructive feedback to facilitate learning. Therefore, developmental assessment center principles match the key determinants of procedural justice and thus overcome many problems with traditional placement assessments.

Sustainable assessment: rethinking assessment for the learning society

Assessment practices in higher education institutions tend not to equip students well for the processes of effective learning in a learning society. The purposes of assessment should be extended to include the preparation of students for sustainable assessment. Sustainable assessment encompasses the abilities required to undertake those activities that necessarily accompany learning throughout life in formal and informal settings. Characteristics of effective formative assessment identified by recent research are used to illustrate features of sustainable assessment. Assessment acts need both to meet the specific and immediate goals of a course as well as establishing a basis for students to undertake their own assessment activities in the future. To draw attention to the importance of this, the idea that assessment always has to do double duty is introduced.

Improving laboratory learning through self and peer assessment of laboratory reports

The laboratory provides an opportunity for students to achieve many learning outcomes including to critically evaluate information, interpret and draw conclusions from scientific data, and communicate scientific results, information, or arguments. This paper describes a laboratory-writing task that involves self and peer evaluation. After discussion of the expectations of laboratory report writing during class, students self and peer evaluate reports. In a process similar to double-blind journal refereeing, students practise critically evaluating the quality of academic writing using a rubric. The summative assessment is based on how consistent their evaluations are with the evaluations of the same reports performed by their peers. The formative assessment is that students receive peer evaluations and feedback via a rubric on reports that they have written. The skill of critically evaluating their own reports is used to improve the laboratory reports in subsequent assessment tasks.

Renewing assessment practices: literacy teaching and learning in digital environments

Interpretations of “literacy” and approaches to literacy pedagogy and assessment are under renewal as meaning-making and learning are increasingly situated in digitized environments. While the implications of these shifts are in part technological, they are also relational, as students are increasingly positioned as interactive with participatory roles in self-knowledge and increased responsibility for their learning. However, while shifts are occurring in understandings of literacy and approaches to literacy pedagogy, the same cannot be said for the way in which assessments of digital literacies are undertaken. There is a lack of valid, reliable, and practical assessments of new literacies to inform and help students to become better prepared for study, work, and citizenship in digital environments. This article maps five characteristics of effective formative assessment in print-based classrooms with seven affordancesin digital learning and assessment to suggest an analytical framework for examining teacher and student assessment in digital environments. Drawing on data from a research project in which a team of teachers introduced a one-to-one computing program and worked to renew their literacy assessment practices, this article discusses how each of the seven affordances are enacted in the assessment practices in a years five and six primary school classroom. The findings from this research project show that educational technologies have the potential to enable new approaches to teaching, learning, and assessment that better align with the needs of twenty-first century literacy learners. The findings alsosupport approaches to formative assessment that value print and multimodality and engage students in more flexible and differentiated ways. They can enable teachers and students to be re-positioned as designers, knowledge producers, and collaborative learners. The seven affordances provide a framework that holds rich possibilities for teacher learning and planning as prompts to support reflection on formative assessment practices, critique habitual practices, and considernew opportunities.

Enhancing quality in online learning : scaffolding planning and design through proactive evaluation

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (from classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation has been positioned at the end of the instructional development cycle, to assess first whether or not the creative effort achieved the original product goals and second whether or not the desired learning outcomes were realized. In the context of online teaching and learning environments, however, the level of understanding teachers, learners and developers have of the medium can impact the ultimate effectiveness of the product. This paper articulates an additional dimension to post-development evaluation processes in proposing proactive evaluation, a framework that identifies critical online learning factors and influences that will better inform the planning, design and development of learning resources. This notion of proactive evaluation advocates resource development being undertaken where all planning activities are assessed against the evaluation criteria that would normally be applied during formative assessment. By performing these evaluation checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved. More importantly, for those participants who are new to online environments, proactive evaluation will perform a scaffolding and professional development role by enhancing online teaching or learning competencies.