Teaching engineering tribology: Elements of assessment design for different learning styles

This study involves teaching engineering students concepts in lubrication engineering that are heavily dependent on mathematics. Excellent learning outcomes have been observed when assessment tasks are devised for a diversity of learning styles. Providing different pathways to knowledge reduces the probability that a single barrier halts progress towards the ultimate learning objective. The interdisciplinary nature of tribology can be used advantageously to tie together multiple elements of engineering to solve real physical problems—an approach that seems to benefit a majority of engineering students. To put this into practice, various assessment items were devised on the study of hydrodynamics, culminating in a project to provide a summative evaluation of the students’ learning achievement. A survey was also conducted to assess other aspects of students’ learning experiences under the headings: ‘perception of learning’ and ‘overall satisfaction’. High degrees of achievement and satisfaction were observed. An attempt has been made to identify the elements contributing to success so that they may be applied to other challenging concepts in engineering education.

Disorganizing educational tropes: Conceptions of dis/ability and curriculum

A study examined the politics of dis/ability and curriculum. Data were obtained from a review of the new disability studies literature, focusing on the areas of history, sociology, anthropology, and critical legal theory. The results indicate that this new literature challenges popular psychoeducational models that assume disability as an objective medical, individual, and pathological deficiency, effectively restricting the systematic study of dis/ability as relational, external, shifting, and socially constituted. The findings suggest ways in which perceptions of “school problems” have to be adjusted to understand how the constant refiguration of normativities in everyday activities creates perceptions of disability-negative ontologies, generates experiences that incite efforts to modify those perceptions in multiple ways, and produces unintended effects from well-intended approaches that in the end remain irreducible to simplistic definitions for the one “ethical” or “politically correct” strategy.

An exploratory investigation of the practice of assessment for learning in Vietnamese higher education: Three case studies of lecturers' practice

In response to limited research conducted on the practice of assessment for learning (AfL) in higher education and in Asian educational settings, this qualitative study, using sociocultural theories of learning and a multiple case study approach, investigates how AfL was implemented by three lecturers in one Vietnamese university. Findings revealed that the lecturers engaged with AfL principles and practices to some extent. However, despite the lecturers' significant efforts, Vietnamese sociocultural factors such as respect for harmony, hierarchy, and examination-oriented learning, impacted on their practice of AfL. This study therefore argues that AfL requires adaptation for it to be effective in the Vietnamese tertiary context.

Surveying the field: Primary school teachers’ conceptions of the literacy capabilities of recently graduated primary school teachers

In 2015, ALEA National Council provided funds to support the implementation of a research project which was undertaken by a group of teacher educators and researchers from a range of universities across three Australian states. Stage one of the project, which is reported on here, examined primary school teachers’ perceptions of the personal and professional literacy capabilities of recently graduated primary school teachers. This stage of the project also examined primary school teachers’ perceptions of the impact of initial teacher education on the personal and professional literacy capabilities of recently graduated primary school teachers. The project team, led by Associate Professor Beryl Exley (Queensland University of Technology), included Chief Investigators Dr Eileen Honan (The University of Queensland), Associate Professor Lisa Kervin (University of Wollongong), Associate Professor Alyson Simpson (University of Sydney) and Dr Muriel Wells (Deakin University), with Dr Sandy Muspratt as the Statistical Analyst and Lesley Friend as the Research Assistant with primary responsibility for the publication of the online survey.

International review of environmental assessment tools and databases

Existing widely known environmental assessment models, primarily those for Life Cycle Assessment of manufactured products and buildings, were reviewed to grasp their characteristics, since the past several years have seen a significant increase in interest and research activity in the development of building environmental assessment methods. Each method or tool was assessed under the headings of description, data requirement, end-use, assessment criteria (scale of assessment and scoring/ weighting system)and present status

Characterising creativity : a holistic methodology for the assessment of creative works

This paper reports on the early stages of a design experiment in educational assessment that challenges the dichotomous legacy evident in many assessment activities. Combining social networking technologies with the sociology of education the paper proposes that assessment activities are best understood as a negotiable field of exchange. In this design experiment students, peers and experts engage in explicit, "front-end" assessment (Wyatt-Smith, 2008) to translate holistic judgments into institutional, and potentiality economic capital without adhering to long lists of pre-set criteria. This approach invites participants to use social networking technologies to judge creative works using scatter graphs, keywords and tag clouds. In doing so assessors will refine their evaluative expertise and negotiate the characteristics of creative works from which criteria will emerge (Sadler, 2008). The real-time advantages of web-based technologies will aggregate, externalise and democratise this transparent method of assessment for most, if not all, creative works that can be represented in a digital format.

Does the summative assessment of real world learning using criterion-referenced assessment need to be discipline specific?

This paper synthesises the existing literature on the contemporary conception of ‘real world’ and compares it with similar notions such as ‘authentic’ and ‘work integrated learning’. While the term ‘real world’ may be partly dependent on the discipline, it does not necessarily follow that the criterion-referenced assessment of ‘real world’ assessment must involve criteria and performance descriptors that are discipline specific. Two examples of summative assessment (court report and trial process exercise) from a final year core subject at the Queensland University of Technology, LWB432 Evidence, emphasise real world learning, are authentic, innovative and better prepare students for the transition into the workplace than more generic forms of assessment such as tutorial participation or oral presentations. The court report requires students to attend a criminal trial in a Queensland Court and complete a two page report on what they saw in practice compared with what they learned in the classroom. The trial process exercise is a 50 minute written closed book activity conducted in tutorials, where students plan questions that they would ask their witness in examination-in-chief, plan questions that they would ask their opponent’s witness in cross-examination, plan questions that they would ask in reexamination given what their opponent asked in cross-examination, and prepare written objections to their opponent’s questions. The trial process exercise simulates the real world, whereas the court report involves observing the real world, and both assessment items are important to the role of counsel. The design of the criterion-referenced assessment rubrics for the court report and trial process exercise is justified by the literature. Notably, the criteria and performance descriptors are not necessarily law specific and this paper highlights the parts that may be easily transferred to other disciplines.

Accounts of the visual art classroom : catering for artistically talented students

Inclusive education practices call for the diverse and individual needs of all students to be met satisfactorily. The needs and experiences of artistically talented students in Australian visual art classrooms are currently unknown. This study addresses this gap in research through an inquiry into the experiences of artistically talented students and their teachers in visual art classrooms, by examining the accounts of a group of students and teachers at one high school in South East Queensland. This study is significant as it provides teachers, parents and others involved in the education of artistically talented students with additional means to plan and cater for the educational needs of artistically talented students. Teacher and student accounts of the visual art classroom in this study indicated that identification processes for artistically talented students are unclear and contradictory. Furthermore, teacher and student accounts of their experiences presented a wide variety of conceptions of the visual art classroom and point towards an individualised approach to learning for artistically talented students. This study also discovered a mismatch between assessment practices in the subject visual art and assessment of art in the ‘real world’. Specifically, this study proposes a renewal of programs for artistically talented students, and recommends a revision of current procedures for the identification of artistically talented students in visual art classrooms.

An adaptable framework for the teaching and assessment of software development across year levels

Few frameworks exist for the teaching and assessment of programming subjects that are coherent and logical. Nor are they sufficiently generic and adaptable to be used outside the particular tertiary institutions in which they were developed. This paper presents the Teaching and Assessment of Software Development (TASD) frame-work. We describe its development and implementation at an Australian university and demonstrate, with examples, how it has been used, with supporting data. Extracts of criteria sheets (grading rubrics) for a variety of assessment tasks are included. The numerous advantages of this new framework are discussed with comparisons made to those reported in the published literature.

Eucharistic rituals in Catholic primary schools in the Archdiocese of Brisbane : a study of administrators' conceptions

The focus of this study is the celebration of Eucharist in Catholic primary schools within the Archdiocese of Brisbane. The context of the contemporary Australian Catholic primary school embodies certain 'problematical realities' in relation to the time-honoured way in which school Eucharistic rituals have been celebrated. These contemporary realities raise a number of issues that impact on school celebrations of Eucharist. The purpose of this study is to explore administrators' differing conceptions of school Eucharistic rituals in an attempt to investigate some of these issues and assist members of individual school communities as they strive to make celebrations of Eucharist appropriate and meaningful for the group gathered. The phenomenographic research approach was adopted, as it is well suited to the purpose of this study and the nature of the research question. Phenomenography is essentially a study of variation. It attempts to map the 'whole' phenomenon under investigation by describing on equal terms all conceptions of the phenomenon and establishing an ordered relationship among them. The purpose of this study and the nature of the research question necessitate an approach that allows the identification and description of the different ways in which administrators' experience school Eucharistic rituals. Accordingly, phenomenography was selected. Members of the Administration Team, namely the principal, the APRE (Assistant to the Principal Religious Education) and, in larger primary schools, the AP A (Assistant to the Principal Administration) share responsibility for leading change in Catholic primary schools in the Archdiocese of Brisbane. In practice, however, principals delegate the role of leading the development of the school's religion program and providing leadership in the religious life of the school community to the APRE (Brisbane Catholic Education, 1997). Informants in this study are nineteen APREs from a variety of Catholic primary schools in the Archdiocese of Brisbane. These APREs come from schools across the archdiocese, rather than from within one particular region. Several significant findings resulted from this study. Firstly, the data show that there are significant differences in how APREs' experience school Eucharistic rituals, although the number of these qualitatively different conceptions is quite limited. The study identifies and describes six distinct yet related conceptions of school Eucharistic rituals. The logical relationship among these conceptions (the outcome space) is presented in the form of a diagram with accompanying explication. The variation among the conceptions is best understood and described in terms of three dimensions of the role of Eucharist in the Catholic primary school and is represented on the model of the outcome space. Individual transcripts suggest that individual APREs tend to emphasise some conceptions more than others. It is the contention of the present study that change in the practice of school Eucharistic rituals is unlikely to occur until all of a school community's conceptions are brought out into the open and articulated. As leaders of change, APREs need to be alerted to their own biases and become aware of alternative ways of conceiving school Eucharistic ritual. It is proposed that the different categories of description and dimensions, represented by the model of the outcome space, can be used to help in the process of articulating a school community's conceptions of Eucharist, with the APRE as facilitator of this process. As a result, the school community develops a better understanding of why their particular school does what it does in relation to school Eucharistic rituals.

Governmentality and the reflection of legal educators : assessment practices as a case study

This paper presents a conceptual framework, informed by Foucault’s work on governmentality, which allows for new kinds of reflection on the practice of legal education. Put simply, this framework suggests that legal education can be understood as a form of government that relies on a specific rationalisation and programming of the activities of legal educators, students, and administrators, and is implemented by harnessing specific techniques and bodies of ‘know-how’. Applying this framework to assessment at three Australian law schools, this paper highlights how assessment practices are rationalised, programmed, and implemented, and points out how this government shapes students’ legal personae. In particular, this analysis focuses on the governmental effects of pedagogical discourses that are dominant within the design and scholarship of legal education. It demonstrates that the development of pedagogically-sound regimes of assessment has contributed to a reformulation of the terrain of government, by providing the conditions under which forms of legal personae may be more effectively shaped, and extending the power relations that achieve this. This analysis provides legal educators with an original way of reflecting on the power effects of teaching the law, and new opportunities for thinking about what is possible in legal education.

The centrality of teachers’ judgement practice in assessment : a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

Review of refugee mental health assessment: Best practices and recommendations

This article focuses on mental health assessment of refugees in clinical, educational and administrative-legal settings in order to synthesise research and practice designed to enhance and promote further development of culturally appropriate clinical assessment services during the refugee resettlement process. It specifically surveys research published over the last 25 years into the development, reliability measurement and validity testing of assessment instruments, which have been used with children, adolescents and adults from refugee backgrounds, prior to or following their arrival in a resettlement country, to determine whether the instruments meet established crosscultural standards of conceptual, functional, linguistic, technical and normative equivalence. The findings suggest that, although attempts have been made to develop internally reliable, appropriately normed tests for use with refugees from diverse cultural and linguistic backgrounds, matters of conceptual and linguistic equivalence and test–retest reliability are often overlooked. Implications of these oversights for underreporting refugees' mental health needs are considered. Efforts should also be directed towards development of culturally comparable, valid and reliable measures of refugee children's mental health and of refugee children's and adults' psychoeducational, neuropsychological and applied memory capabilities.

Developing shared understandings of standards-based assessment : online moderation practices across geographically diverse contexts

This thesis investigates the place of online moderation in supporting teachers to work in a system of standards-based assessment. The participants of the study were fifty middle school teachers who met online with the aim of developing consistency in their judgement decisions. Data were gathered through observation of the online meetings, interviews, surveys and the collection of artefacts. The data were viewed and analysed through sociocultural theories of learning and sociocultural theories of technology, and demonstrates how utilising these theories can add depth to understanding the added complexity of developing shared meaning of standards in an online context. The findings contribute to current understanding of standards-based assessment by examining the social moderation process as it acts to increase the reliability of judgements that are made within a standards framework. Specifically, the study investigates the opportunities afforded by conducting social moderation practices in a synchronous online context. The study explicates how the technology affects the negotiation of judgements and the development of shared meanings of assessment standards, while demonstrating how involvement in online moderation discussions can support teachers to become and belong within a practice of standards-based assessment. This research responds to a growing international interest in standards-based assessment and the use of social moderation to develop consistency in judgement decisions. Online moderation is a new practice to address these concerns on a systemic basis.

A case for addressing the literacy demands of student assessment

The development and implementation of the Australian Curriculum together with national testing of students and the publication of school results place new demands on teachers. In this article we address the importance of teachers becoming attuned to the silent assessors in assessment generally and in the National Literacy and Numeracy Program (NAPLAN) more specifically. Using the concept of literacies, we develop a method to conduct a literacy audit of assessment tasks that teachers can use to help both themselves and their students. Providing assistance to students as a consequence of such an audit is imperative to improve the outcomes for students and to address issues of equity.