Sustainable assessment: rethinking assessment for the learning society

Assessment practices in higher education institutions tend not to equip students well for the processes of effective learning in a learning society. The purposes of assessment should be extended to include the preparation of students for sustainable assessment. Sustainable assessment encompasses the abilities required to undertake those activities that necessarily accompany learning throughout life in formal and informal settings. Characteristics of effective formative assessment identified by recent research are used to illustrate features of sustainable assessment. Assessment acts need both to meet the specific and immediate goals of a course as well as establishing a basis for students to undertake their own assessment activities in the future. To draw attention to the importance of this, the idea that assessment always has to do double duty is introduced.

Formalising industry feedback in assessment practice for work integrated learning

Work Integrated Learning (WIL) programs, such as co-operative education programs, offer students a learning environment which exists outside the traditional classroom and specific discipline boundaries. This necessitates assessment practices that go beyond traditional practices and relationships. Work placement supervisors are best located to observe the students' learning and development and offer feedback on performance and improvement. An investigation was carried out in order to articulate the role of supervisors and work colleagues in facilitating learning in the workplace environment and their involvement in assessment practices. Interviews were conducted with academics and industry representatives on their perceptions of assessment task validity in terms of professional and generic skill development. A synthesis of the findings formed the basis of the research described in this paper. Key findings highlighted the need for better preparation of industry supervisors as to their role in providing feedback and assessment; better preparation of students for transition from the classroom to the workplace; and the importance of ongoing involvement of the three stakeholders (academic, supervisor and student) to maximise learning and professional development. Recommendations for assessment practices include suggestions on how to involve employers in appraising workplace performance; how to measure the real life application of learning; and the development of generic employability skills. © Common Ground, Kathy Henschke, Joan Richardson.

Assessment of student development and learning in IB PYP schools

The aim of this study is to examine how International Baccalaureate (IB) Primary Years Programme (PYP) schools define the purpose of educational assessment in their assessment policies and practices. Educational assessment in this study is broadly defined to include standardized tests, and formative and summative assessment. This investigation offers a deeper understanding of the assessment cultures of eight PYP schools and provides insights into the current assessment literacy of teachers. The researchers employed a multiple case-study approach, with two phases of data collection: an online survey of teachers and detailed teacher focus groups and coordinator interviews to follow-up on themes identified in the survey. Assessment in the PYP case-study schools was described as holistic and ongoing, and involved a wide range of assessment strategies. Assessment as learning, however, emerged as an approach still in development in the schools. Teachers enthusiastically supported the development of learner profile attributes, although assessing progress in any particular attribute was regarded as challenging. Finally, while teacher feedback and student self-assessment were common practices, teachers were more equivocal about peer assessment. The authors conclude the report with a number of recommendations for further improving PYP assessment practices.

'Worldmarks': Web guidelines for socially and culturally responsive assessment in university classrooms

In the early 21st century, we need to prepare university students to navigate local and global cultures effectively and sensitively. These future professionals must develop comprehensive intercultural communication skills and understanding. Yet university assessment in Australia is often based on a western template of knowledge, which automatically places International, Indigenous, as well as certain groups of local students at a study disadvantage. It also ensures that Australian students from dominant groups are not given the opportunity to develop these vital intercultural skills. This paper explores the issues embedded in themes 1 and 4 of this conference and provides details of an innovative website developed at Queensland University of Technology in Brisbane, Australia, which encourages academic staff to investigate the hidden assumptions that can underpin their assessment practices. The website also suggests strategies academics can use to ensure that their assessment becomes more socially and culturally responsive.

The development and operation of the effective interpersonal relationship skills relevant to career development problems from staff assessment at an industrial research laboratory

This study concerns the application of a model of effective interpersonal relationships to problems arising from staff assessment at I.C.I. Ltd. Corporate Laboratory between 1972 and 1974. In collaboration with academic and industrial supervision, the study commenced with a survey of management and supervisor opinions about the effectiveness of current staff (work) relationships, with particular reference to the problem of recognising and developing creative potential. This survey emphasised a need to improve the relationships between staff in the staff assessment context. A survey of research into creativity emphasised the importance of the interpersonal environment for obtaining creative behaviour in an organisation context. A further survey of theories of how inter­personal behaviour related to personal creativity (therapeutic psychology) provided a model of effective interpersonal behaviour (Carkhuff, 1969) that could be applied to the organisation context of staff assessment. The objective of the project was redefined as a need to improve the conditions of interpersonal behaviour in relation to certain (career development) problems arising from staff assessment practices. In order to demonstrate the application of the model of effective interpersonal behaviour, the research student recorded interviews between himself and members of staff designed to develop and operate the dimensions of the model. Different samples of staff were used to develop the 'facilitative' and the 'action oriented' dimensions of bahaviour, and then for the operation of a helping programme (based on vocational guidance tests). These interactions have been analysed, according to the scales of measurement in the model ana the results are presented in case study form in this thesis. At each stage of the project, results and conclusions were presented to the sponsoring organisation (e.g. industrial supervisor) in order to assess their (subjective) opinion of relevance to the organ­ isation. Finally, recommendations on further actions towards general improvement of the work relationships in the laboratory were presented in a brief report to the sponsor.

Assessment of Higher-Education Hospitality Programs

The function of assessment in higher-education hospitality programs is to improve student learning. Although the assessment process is common in higher-education institutions, examples of assessment practices in hospitality programs have not been made available to academic practitioners. This paper describes a method successful at formulating assessment in a hospitality college professional program.

Good practice guidelines for curriculum, supervision and assessment of final year engineering projects and AQF8 learning outcomes

Undergraduate engineering programs require final year students to complete capstone final year projects and demonstrate that they can integrate knowledge, skills and professional graduate attributes developed during the program at Australian Qualification Framework, level 8 (AQF8) outcomes. Literature shows that currently there is no guarantee of consistency for curriculum, supervision and assessment practices of FYEPs. Practices differ greatly between universities and littlework has been initiated that seeks to identify good practice, highlighting the need for the development of guidelines for curriculum, supervision and assessment of FYEPs. This workshop is designed to share and disseminate the good practice guidelines that have been developed on curriculum, supervision and assessment of Final Year Engineering Projects as a part of phase 2 of the project ‘Assessing Final Year Engineering Projects (FYEPs): Ensuring Learning and Teaching Standards and AQF8 Outcomes’ funded by the Australian Office for Learning and Teaching (OLT) with people working in the area of FYEPs. The guidelines typically apply to four year undergraduate engineering degrees with embedded Honours and support achievement of AQF8learning outcomes. The project team has 7 partner Universities – Central Queensland University (the lead), University of Technology Sydney, University of Adelaide, Curtin University, Deakin University, University of Tasmania and RMIT University.Participants will be invited to reflect on and evaluate guidelines and findings derived from FYEP coordinators, supervisors and the wider literature and to consider the ways in which these findings might lead to improvements in their practice.

Promoting reflective assessing practices through narratives: An action research project in early childhood

This project aims at describing the use of Action Research in the development of more structured assessment practices in Early Childhood Portuguese contexts. The teacher had always observed young learners’ activities and progress, and registered them in the form of “critical incidents”. This reflective process structured through this type of narratives helps “tune” the Class Curriculum firstly designed without much knowledge about the kids and so, difficultly responding to their specific needs and interests. The results achieved suggest kids become better prepared to face further education and life. Being early childhood assessment felt by most Portuguese kindergarten teachers as an innovative procedure, the project was seen as the launching of roots for “new” practices.

Project RAILS: Lessons Learned about Collaborative Rubric Assessment of Information Literacy Skills

Link to article on publisher site: https://www.press.jhu.edu/journals/portal_libraries_and_the_academy/portal_pre_print/articles/belanger.pdf

The enactment of the New Basics Project in a special school

This study investigates the impact of the New Basics Project on teachers at a special school for students with intellectual impairments. The study is aimed at exploring the complex nature of the work of special educators as they enact the New Basics curriculum with a particular focus on the teachers’ opinions about challenges that arose for their curriculum, pedagogy and assessment practices. Attention is also paid to how the principal’s leadership supported the enactment of the New Basics in respect to what he did and why he used particular strategies. The nine teachers and their principal were involved in a series of in-depth, semi-structured interviews from one of only three special schools in phase one of the New Basics trial in Queensland, Australia. These interviews produced data from the special educators as they were confronted with a new curriculum that challenged their previous teaching practices. The enactment of the New Basics curriculum occurred within the context of a state-sanctioned mandate to provide alternative programs to those offered in mainstream schools, for students with special needs. This thesis explores these teachers' experiences using critical theory as a basis for analyzing their opinions on issues such as the role of the special educator, tensions between old and new curricula, pedagogical and assessment practices, and connections between the at-school learning experiences for intellectually impaired students and the realities of post-school life. The investigation also examines the leadership conduct of the principal in changing times at the school. The findings suggest that the New Basics has played a significant role in providing structures for developing communities of practice amongst teachers; in supporting special educators to focus more on the educational needs of the students (e.g., literacy, numeracy, financial planning) and less on their medical needs (e.g., toileting, feeding, personal hygiene); and supporting school leadership that empowers and listens critically to teachers as essential components of the successful enactment of curriculum reforms like the New Basics.

Identity and disciplinarity : Multi-disciplinary student cohorts in Higher Education [Abstract]

This paper will describe a research project that examines the implications of multidisciplinary student cohorts on teaching and learning within undergraduate and postgraduate units in higher education. Whist students generally specialise in one discipline, it is also common that, at some point during their degree, they will choose to undertake subjects that are outside their specialist area. Students may choose a multidisciplinary learning experience either out of interest or because the subject is seen as complementary to their core discipline. When the lens of identity is applied to the multi-disciplinary cohorts in undergraduate and postgraduate units, it assists in identifying learning needs. The nature of disciplinarity, and the impact it has on students’ academic identity, presents challenges to both students and teachers when they engage in teaching and learning, impacting on curriculum design, assessment practices and teaching delivery strategies (Winberg, 2008). This project aims to identify the barriers that exist to effective teaching and learning in units that have multidisciplinary student cohorts. It will identify the particular needs of students in multidisciplinary student cohorts and determine a teaching and learning model that meets the needs of such cohorts. References Becher, T. & Trowler, P.R. (2001). Academic tribes and territories: Intellectual enquiry and the culture of the discipline. Buckingham, UK: Open University Press. Light, G. & Cox, R. (2001). Learning and teaching in higher education: A reflective professional. Thousand Oaks, CA: Sage. Neumann, R. (2001). Disciplinary differences and university teaching. Studies in Higher Education, 26 (2), 135-46. Neumann, R., Parry, S. & Becher, T. (2002). Teaching and Learning in their disciplinary contexts: A conceptual analysis. Studies in Higher Education, 27(4), 405-417. Taylor, P.G. (1999) Making Sense of Academic Life: Academics, Universities and Change. Buckingham, UK: Open University Press. Winberg, C. (2008). Teaching engineering/engineering teaching: interdisciplinary collaboration and the construction of academic identities. Teaching in Higher Education, 13(3), 353 - 367.

Accounts of the visual art classroom : catering for artistically talented students

Inclusive education practices call for the diverse and individual needs of all students to be met satisfactorily. The needs and experiences of artistically talented students in Australian visual art classrooms are currently unknown. This study addresses this gap in research through an inquiry into the experiences of artistically talented students and their teachers in visual art classrooms, by examining the accounts of a group of students and teachers at one high school in South East Queensland. This study is significant as it provides teachers, parents and others involved in the education of artistically talented students with additional means to plan and cater for the educational needs of artistically talented students. Teacher and student accounts of the visual art classroom in this study indicated that identification processes for artistically talented students are unclear and contradictory. Furthermore, teacher and student accounts of their experiences presented a wide variety of conceptions of the visual art classroom and point towards an individualised approach to learning for artistically talented students. This study also discovered a mismatch between assessment practices in the subject visual art and assessment of art in the ‘real world’. Specifically, this study proposes a renewal of programs for artistically talented students, and recommends a revision of current procedures for the identification of artistically talented students in visual art classrooms.

Strategies to engage engineering students in group project work

Project focused group work is significant in developing social and personal skills as well as extending the ability to identify, formulate and solve engineering problems. As a result of increasing undergraduate class sizes, along with the requirement for many students to work part-time, group projects, peer and collaborative learning are seen as a fundamental part of engineering education. Group formation, connection to learning objectives and fairness of assessment has been widely reported as major issues that leave students dissatisfied with group project based units. Several strategies were trialled including a study of formation of groups by different methods across two engineering disciplines over the past 2 years. Other strategies involved a more structured approach to assessment practices of civil and electrical engineering disciplines design units. A confidential online teamwork management tool was used to collect and collate student self and peer assessment ratings and used for both formative feedback as well as assessment purposes. Student satisfaction and overall academic results in these subjects have improved since the introduction of these interventions. Both student and staff feedback highlight this approach as enhancing student engagement and satisfaction, improved student understanding of group roles, reducing number of dysfunctional groups whilst requiring less commitment of academic resources.

Evaluation of the year 1 literacy and numeracy checkpoints assessments trial - 2010

The draft Year 1 Literacy and Numeracy Checkpoints Assessments were in open and supported trial during Semester 2, 2010. The purpose of these trials was to evaluate the Year 1 Literacy and Numeracy Checkpoints Assessments (hereafter the Year 1 Checkpoints) that were designed in 2009 as a way to incorporate the use of the Year 1 Literacy and Numeracy Indicators as formative assessment in Year 1 in Queensland Schools. In these trials there were no mandated reporting requirements. The processes of assessment were related to future teaching decisions. As such the trials were trials of materials and the processes of using those materials to assess students, plan and teach in year 1 classrooms. In their current form the Year 1 Checkpoints provide assessment resources for teachers to use in February, June and October. They aim to support teachers in monitoring children's progress and making judgments about their achievement of the targeted P‐3 Literacy and Numeracy Indicators by the end of Year 1 (Queensland Studies Authority, 2010 p. 1). The Year 1 Checkpoints include support materials for teachers and administrators, an introductory statement on assessment, work samples, and a Data Analysis Assessment Record (DAAR) to record student performance. The Supported Trial participants were also supported with face‐to‐face and on‐line training sessions, involvement in a moderation process after the October Assessments, opportunities to participate in discussion forums as well as additional readings and materials. The assessment resources aim to use effective early years assessment practices in that the evidence is gathered from hands‐on teaching and learning experiences, rather than more formal assessment methods. They are based in a model of assessment for learning, and aim to support teachers in the “on‐going process of determining future learning directions” (Queensland Studies Authority, 2010 p. 1) for all students. Their aim is to focus teachers on interpreting and analysing evidence to make informed judgments about the achievement of all students, as a way to support subsequent planning for learning and teaching. The Evaluation of the Year 1 Literacy and Numeracy Checkpoints Assessments Supported Trial (hereafter the Evaluation) aimed to gather information about the appropriateness, effectiveness and utility of the Year 1 Checkpoints Assessments from early years’ teachers and leaders in up to one hundred Education Queensland schools who had volunteered to be part of the Supported Trial. These sample schools represent schools across a variety of Education Queensland regions and include schools with:  - A high Indigenous student population; - Urban, rural and remote school locations; - Single and multi‐age early phase classes; - A high proportion of students from low SES backgrounds. The purpose of the Evaluation was to: Evaluate the materials and report on the views of school‐based staff involved in the trial on the process, materials, and assessment practices utilised. The Evaluation has reviewed the materials, and used surveys, interviews, and observations of processes and procedures to collect relevant data to help present an informed opinion on the Year 1 Checkpoints as assessment for the early years of schooling. Student work samples and teacher planning and assessment documents were also collected. The evaluation has not evaluated the Year 1 Checkpoints in any other capacity than as a resource for Year 1 teachers and relevant support staff.

Negotiating the meaning of achievement standards in the Australian curriculum

Planning for assessment using the achievement standards in the implementation of the Australian Curriculum presents a challenge for teachers. The achievement standards differ in appearance and function from current assessment practices. This research inquiry used qualitative focus group discussions to investigate how Year 6 teachers from three Queensland schools negotiated the meaning of the English and Mathematics achievement standards for their assessment practice. A sociocultural theoretical perspective was used to analyse the data. Three significant influences on the teachers’ understanding of the achievement standards were their understanding of the achievement standard text, their beliefs about learning and assessment, and the assessment culture of the school. The opportunity to learn through supported professional conversations with peers, and the need for a shared assessment discourse were identified as necessities to support teachers as they seek to implement the new practices inherent in the achievement standards in the Australian Curriculum.