Teaching engineering tribology: Elements of assessment design for different learning styles

This study involves teaching engineering students concepts in lubrication engineering that are heavily dependent on mathematics. Excellent learning outcomes have been observed when assessment tasks are devised for a diversity of learning styles. Providing different pathways to knowledge reduces the probability that a single barrier halts progress towards the ultimate learning objective. The interdisciplinary nature of tribology can be used advantageously to tie together multiple elements of engineering to solve real physical problems—an approach that seems to benefit a majority of engineering students. To put this into practice, various assessment items were devised on the study of hydrodynamics, culminating in a project to provide a summative evaluation of the students’ learning achievement. A survey was also conducted to assess other aspects of students’ learning experiences under the headings: ‘perception of learning’ and ‘overall satisfaction’. High degrees of achievement and satisfaction were observed. An attempt has been made to identify the elements contributing to success so that they may be applied to other challenging concepts in engineering education.

Assessment design checklist

Produced by Birmingham City University

Feeding back and enhancing authentic learning in quality course assessment design : locating information systems education in rigorous educational research

Locating information systems education foursquare within rigorous and substantial educational research is crucial if the discipline is to receive the scholarly attention that it warrants. One way to do that is to highlight how current information systems course design in Australian undergraduate and postgraduate programs exhibits the strongest possible elements of contemporary learning theories. This paper analyses selected features of the design of an information systems postgraduate course in an Australian university, including the use of peer review of journal entries and writing professional reports to enhance authentic learning and maximise quality assessment design. The analysis is framed by the principles of instructional design theory (Snyder 2009). The authors argue that, by demonstrating theoretically grounded and effective educational practice, the course highlights the value of being located in wider educational research, and of bringing the two fields more closely together.

Review of assessment, design, and mitigation of multiple hazards

Large parts of the world are subjected to one or more natural hazards, such as earthquakes, tsunamis, landslides, tropical storms (hurricanes, cyclones and typhoons), costal inundation and flooding. Virtually the entire world is at risk of man-made hazards. In recent decades, rapid population growth and economic development in hazard-prone areas have greatly increased the potential of multiple hazards to cause damage and destruction of buildings, bridges, power plants, and other infrastructure; thus posing a grave danger to the community and disruption of economic and societal activities. Although an individual hazard is significant in many parts of the United States (U.S.), in certain areas more than one hazard may pose a threat to the constructed environment. In such areas, structural design and construction practices should address multiple hazards in an integrated manner to achieve structural performance that is consistent with owner expectations and general societal objectives. The growing interest and importance of multiple-hazard engineering has been recognized recently. This has spurred the evolution of multiple-hazard risk-assessment frameworks and development of design approaches which have paved way for future research towards sustainable construction of new and improved structures and retrofitting of the existing structures. This report provides a review of literature and the current state of practice for assessment, design and mitigation of the impact of multiple hazards on structural infrastructure. It also presents an overview of future research needs related to multiple-hazard performance of constructed facilities.

Support for assessment practice: developing the assessment design decisions framework

There are many excellent publications outlining features of assessment and feedback design in higher education. However, university educators often find these ideas challenging to realise in practice, as much of the literature focuses on institutional change rather than supporting academics. This paper describes the conceptual development of a practical framework designed to stimulate educators’ thinking when creating or modifying assessments. We explain the concepts that underpin this practical support, including the notions of ‘assessment decisions’ and ‘assessment design phases’, as informed by relevant literature and empirical data. We also present the outcome of this work. The Assessment Design Decisions Framework. This provides key considerations in six categories: purposes, contexts, tasks, interactions, feedback processes and learning outcomes. By tracing the development of the Framework, we highlight complex ways of thinking about assessment that are relevant to those who design and deliver assessment to tertiary students.

How technology shapes assessment design: findings from a study of university teachers

A wide range of technologies has been developed to enhance assessment, but adoption has been inconsistent. This is despite assessment being critical to student learning and certification. To understand why this is the case and how it can be addressed, we need to explore the perspectives of academics responsible for designing and implementing technology-supported assessment strategies. This paper reports on the experience of designing technology-supported assessment based on interviews with 33 Australian university teachers. The findings reveal the desire to achieve greater efficiencies and to be contemporary and innovative as key drivers of technology adoption for assessment. Participants sought to shape student behaviors through their designs and made adaptations in response to positive feedback and undesirable outcomes. Many designs required modification because of a lack of appropriate support, leading to compromise and, in some cases, abandonment. These findings highlight the challenges to effective technology-supported assessment design and demonstrate the difficulties university teachers face when attempting to negotiate mixed messages within institutions and the demands of design work. We use these findings to suggest opportunities to improve support by offering pedagogical guidance and technical help at critical stages of the design process and encouraging an iterative approach to design.

Sustainable design education: teaching, learning and assessment in collaborative group design projects

Changes in the funding of tertiary education resulting in less one-to-one staff/student contact time mean that we cannot continue to teach as we have historically been taught. If design schools are unable to implement strategies that successfully overcome resource intensive studio teaching programs, then current architectural education may for many higher education providers be based on an unsustainable course structure. Rather than spreading their time thinly over a large number of individual projects, an increasing number of lecturers are setting group projects. This allows them to co-ordinate longer and more in-depth review sessions on a smaller number of assignments. However, while the group model may reflect the realities of the design process in practice, the approach is not without short comings as a teaching archetype for the assessment of individual skill competencies. Hence, what is clear is the need for a readily adoptable andragogy for the teaching and assessment of group design projects.
The following describes the background, methodology and early results of a Strategic Teaching and Learning Grant currently running at the School of Architecture and Building at Deakin University. The project is evaluating two design programs at Deakin and it is envisaged that the results of the
investigation may inform other project-based teaching disciplines experiencing a similar need for new knowledge and skill-based delivery due to increasing staff-student ratios.

Design of an assessment methodology for Educational Innovation Groups in the EHEA.

This document explains the process of designing a methodology to evaluate Educational Innovation Groups, which are structures created within universities in the context of adaptation to the European Higher Education Area. These groups are committed to introduce innovation in educational processes as a means to improve educational quality. The assessment design is based on a participatory model of planning called Working With People, that tries to integrate the perspectives of all stakeholders. The aim of the methodology is to be a useful tool for the university to evaluate the work done by the groups, encourage the members to continue improving the quality of teaching and reorient the activities to fulfill the emergent needs that the university faces.

Assessment rubrics: towards clearer and more replicable design, research and practice

‘Rubric’ is a term with a variety of meanings. As the use of rubrics has increased both in research and practice, the term has come to represent divergent practices. These range from secret scoring sheets held by teachers to holistic student-developed articulations of quality. Rubrics are evaluated, mandated, embraced and resisted based on often imprecise and inconsistent understandings of the term. This paper provides a synthesis of the diversity of rubrics, and a framework for researchers and practitioners to be clearer about what they mean when they say ‘rubric’. Fourteen design elements or decision points are identified that make one rubric different from another. This framework subsumes previous attempts to categorise rubrics, and should provide more precision to rubric discussions and debate, as well as supporting more replicable research and practice.

Developing teamwork assessment : satisfying solutions for the real world

While the need for teamwork skills consistently appears in job advertisements across all sectors, the development of these skills for many university students (and some academic staff) remains one of the most painful and often complained about experiences. This presentation introduces the final phase of a project that has investigated and analysed the design of teamwork assessment across all discipline areas in order to provide a university-wide protocol for this important graduate capability. The protocol concentrates best practice guidelines and resources across a range of approaches to team assessment and includes an online diagnostic tool for evaluating the quality of assessment design. Guide-lines are provided for all aspects of the design process such as the development of real-world relevance; choosing the ideal team structure; planning for intervention and conflict resolution; and selecting appropriate marking options. While still allowing academic staff to exercise creativity in assessment design; the guidelines increase the possibility of students’ experiencing a consistent and explicit approach to teamwork throughout their course. If implementation of the protocol is successful, the project team predicts that the resulting consistency and explicitness in approaches to teamwork will lead to more coherent skill development across units, more realistic expectations for students and staff and better communication between all those participating in the process.

Assessing architectural design processes of diverse learners

Given that what students learn is so strongly related to how they learn, the modes of delivery and assessment that we as teachers provide them with have a major impact on their ability to learn. As this paper shows, good learning environments are constructed from a range of modes that respond to student learning styles and seek to align activities and learning outcomes with assessment tasks, to better accommodate a diversity of student learning styles and backgrounds. This paper uses a number of models of learning to critique and analyse the traditional practices of assessment in an architectural design class, and then proposes and reports on an alternative pattern of assessment. It discusses the issues of accommodating a group of first-year architecture students at Queensland University of Technology in 2009. These students arrived with diverse prior learning backgrounds, the group being evenly split between those with drawing capabilities and those without. They also had a variety of learning style preferences. The experiment in alternative assessment patterns presented here shows that what has traditionally been considered a diverse and difficult cohort of students can benefit from the assessment of a range of task types at different stages in the learning cycle.

Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

Transferring knowledge through peer-reviewed assessment : the creation of a community of practice and the threats to its survival

While it is generally accepted in the learning and teaching literature that assessment is the single biggest influence on how students approach their learning, assessment methods within higher education are generally conservative and inflexible. Constrained by policy and accreditation requirements and the need for the explicit articulation of assessment standards for public accountability purposes, assessment tasks can fail to engage students or reflect the tasks students will face in the world of practice. Innovative assessment design can simultaneously deliver program objectives and active learning through a knowledge transfer process which increases student participation. This social constructivist view highlights that acquiring an understanding of assessment processes, criteria and standards needs active student participation. Within this context, a peer-assessed, weekly, assessment task was introduced in the first “serious” accounting subject offered as part of an undergraduate degree. The positive outcomes of this assessment innovation was that student failure rates declined 15%, tutorial participation increased fourfold, tutorial engagement increased six-fold and there was a 100% approval rating for the retention of the assessment task. In contributing to the core conference theme of “seismic” shifts within higher education, in stark contrast to the positive student response, staff-related issues of assessment conservatism and the necessity of meeting increasing research commitments, threatened the assessment task’s survival. These opposing forces to change have the potential to weaken the ability of higher education assessment arrangements to adequately serve either a new generation of students or the sector's community stakeholders.

Class participation as a learning and assessment strategy in law : facilitating students’ engagement, skills development and deep learning

Assessment has widely been described as being ‘at the centre of the student experience’. It would be difficult to conceive of the modern teaching university without it. Assessment is accepted as one of the most important tools that an educator can deploy to influence both what and how students learn. Evidence suggests that how students allocate time and effort to tasks and to developing an understanding of the syllabus is affected by the method of assessment utilised and the weighting it is given. This is particularly significant in law schools where law students may be more preoccupied with achieving high grades in all courses than their counterparts from other disciplines. However, well-designed assessment can be seen as more than this. It can be a vehicle for encouraging students to learn and engage more broadly than with the minimums required to complete the assessment activity. In that sense assessment need not merely ‘drive’ learning, but can instead act as a catalyst for further learning beyond what a student had anticipated. In this article we reconsider the potential roles and benefits in legal education of a form of interactive classroom learning we term assessable class participation (‘ACP’), both as part of a pedagogy grounded in assessment and learning theory, and as a platform for developing broader autonomous approaches to learning amongst students. We also consider some of the barriers students can face in ACP and the ways in which teacher approaches to ACP can positively affect the socio-emotional climates in classrooms and thus reduce those barriers. We argue that the way in which a teacher facilitates ACP is critical to the ability to develop positive emotional and learning outcomes for law students, and for teachers themselves.