Innovative science education assessment : linking theory with practice

This paper presents an assessment approach which demonstrates the characteristics of excellent assessment. In a third year Science Education unit in an undergraduate degree in teacher education, assessment is seen as an integral part of the learning process. Learning outcomes are improved for the students and they appreciate the validity of the assessment. Assessment is an important aspect of any unit in higher education but should be seen, not as an end in itself, but rather as a means for educational improvement. Using the assessment task as an illustration, this paper will discuss the theoretical framework of assessment. It will describe how the unit, delivered in a school-based mode, provides opportunity for students to link their theoretical understandings with practical applications, drawing together the academic debates with the first-hand experiences. It will illustrate how the assessment task itself embeds the principles of constructivism and conceptual change models in science education. Finally, the paper will highlight the benefits of this assessment approach with particular reference to the student learning.

Towards a sustainable assessment strategy for digital forensic education and training

In this paper, we show the development and application of a sustainable assessment strategy as an implementation of effective learning for a computer crime and digital forensics unit. The unit is undertaken by undergraduate students as part of an Information Technology Security course at Deakin University. Over a five year period the teaching team has made continuous improvements to the delivery of material and content taking informal student feedback and Faculty review into careful consideration. In addition formal student evaluation of the unit has been extremely positive. As part of reflective teaching practice the teaching team derived a map of the relationship between learning objectives, learning activities, the assessment and the unit outcomes to verify what has led to the favorable student experience and its impact on learning process in order to repeat this strategy for other tertiary courses.

Marking time: leading and managing the development of assessment in higher education

This book highlights the University of New South Wales (UNSW) Assessment as Learning Project, a three year process of assessment change in faculty. The UNSW Vice-Chancellor, Professor Frederick Hilmer charged faculties with a learning and teaching agenda to investigate ways to make quality assessment practices more effective and efficient for both staff and students. The examples provided in this edited collection demonstrate exemplary case studies and theoretical perspectives on learning, teaching, and assessment. This book presents leading research in assessment as learning with a focus on changing practices as well as discipline specific practices.

Not just social work academics : the involvement of others in the assessment of social work students

University regulations typically assume that the assessment of students is essentially a task for paid academic staff. However, this is a far cry from much of the current literature about assessment in social work education, of which one of the distinguishing features is the not infrequent references to stakeholders beyond the individuals who are to be assessed and the academic staff employed to teach them. This paper reviews some of the recent literature on the involvement of persons other than social work academics, including students, practice teachers and service users, in assessing students studying in social work programmes. Implications for programme providers of using non-academic assessors are explored.

Incorporating learning styles into an assessment of formal management development

Students are a primary product of the management education system. To assess the impact of a basic course, the change in competencies of students over the duration of the course is examined. This study found that even a basic subject design had a significant and substantial impact on the competence development of the students. From the perspective of students-as-products, the baseline provided here allows for the testing of alternative designs of educational systems, whereby alternative designs have to prove a benefit above and beyond that of a basic teaching system.

Assessment method difference : comparisons between international and domestic students within a first year undergraduate management course

This paper investigates the assessment methods and student results within a first year undergraduate management course offered within the business faculty of an Australian university. This course is compulsory for those studying for a commerce or management degree. The assessment results of full fee paying international students were compared with those of domestic students, during four teaching semesters in 2009 and 2010. Analysis compares 2,682 students’ numerical results for two constructed response assignments to their results for an examination comprising both multiple choice questions and constructed response questions. It also compares the results of international and domestic students across metropolitan, regional and rural campuses. However due to little comparison data for multiple campuses, findings are consolidated by domestic and international students, university-wide. International students were found to achieve lower results than domestic students for constructed response assessment tasks, but higher results than domestic students for multiple choice question assessments. These findings have implications for instructors eager to provide a level assessment playing field for both domestic and international students, enabling both groupings to take advantage of existing strengths but also to improve their weaknesses. This research led to a restructuring and rescheduling of assessment tasks for the 2012 academic year.

Enhancing fuzzy inference system based criterion-referenced assessment with an application

An important and difficult issue in designing a Fuzzy Inference System (FIS) is the specification of fuzzy sets, and fuzzy rules. The aim of this paper is to demonstrate how an additional qualitative information, i.e., monotonicity property, can be exploited and extended to be part of an FIS designing procedure (i.e., fuzzy sets and fuzzy rules design). In this paper, the FIS is employed as an alternative to the use of addition in aggregating the scores from test items/tasks in a Criterion-Referenced Assessment (CRA) model. In order to preserve the monotonicity property, the sufficient conditions of the FIS is proposed. Our proposed FIS based CRA procedure can be viewed as an enhancement for the FIS based CRA procedure, where monotonicity property is preserved. We demonstrate the applicability of the proposed approach with a case study related to a laboratory project assessment task at a university, and the results indicate the usefulness of the proposed approach in the CRA domain.

Does calibration reduce variability in the assessment of accounting learning outcomes?

Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.

Patterns of resistance in managing assessment change

Achieving change in assessment practices in higher education is difficult. One of the reasons for this is resistance among those responsible for teaching and assessing. This paper seeks to explore this resistance through an analysis of staff dialogue during a major attempt to change the assessment practices at one institution. An institution-wide intervention to pilot new assessment practices was initiated, involving 35 academics across 12 departments. This paper reports on patterns emerging in dialogue about this among academics, and between academics and educational development personnel. Findings suggest that resistance is not a unitary concept, but that different stakeholders under varied circumstances express it differently; and that resistance to assessment change is particularly resilient. Implications are discussed in terms of relevance to current theories of higher education assessment and learning change management, as well as the practical considerations of attempts by institutions to engage in assessment change. © 2013 © 2013 Taylor & Francis.

Teamwork benefits in tertiary education

Purpose – The purpose of this paper is to contribute to the understanding of the development ofstudents’ skills in the context of team-based learning. Academics have heeded the call to incorporateteam learning activities into the curricula, yet little is known of student perception of teamworkand whether they view it as beneficial to them and their future professional career. Further, this studypresents an instructional framework to guide best practice in higher education practitioners withregard to the design of teamwork assessment.Design/methodology/approach – The paper adopts a qualitative approach utilising 190 students’reflections to examine their perception of the benefits of teamwork and whether it will contribute totheir future professional work.Findings – Results indicate students perceive team-based assessment tasks require them to adopt adeep approach to learning together with a deep approach to study, as well as improving their skillsin the areas of collaboration, team unity and cultural diversity. Further, the study identified a bestpractice approach that higher education practitioners should adopt in teamwork assessment designgiving this study both national and international significance and aids fellow educators in theirpractices.Research limitations/implications – Because of the chosen research approach, the results maylack generalisability. Therefore, researchers are encouraged to test the proposed propositions further.Practical implications – The paper presents important implications for those involved in thedevelopment of assessment items where objectives include the development of team skills and qualitylearning outcomes. The findings are vital for unit and course planning and design generally, andassessment planning, design and processes, specifically, both nationally and internationally.Originality/value – This paper fulfils an identified need to study students’ perceptions of teamwork,whether they view it as beneficial to them and their future professional career, and presents a bestpractice approach for teamwork assessment design.