Towards a framework for aligning learning outcomes, academic literacies and assessment criteria

Although Australian students spend three or more years studying they can seem quite unaware of any of the expected learning outcomes of their course. They are often single unit focused, paying most attention to individual assessment items thus not developing a holistic view of their course. This paper presents a theoretical framework to support staff and students to recognise, scaffold and achieve learning outcomes and academic skills at unit level and to recognise how these contribute to course and graduate learning outcomes, within the boundaries of Australian university and professional accreditation requirements. A case study is described that demonstrates the manual implementation of the framework. The complex nature of the implementation suggests that a software solution is required to ease the process and ensure the resulting mapping will have some longevity by being maintainable.

Sustainable assessment revisited

Sustainable assessment has been proposed as an idea that focused on the contribution of assessment to learning beyond the timescale of a given course. It was identified as an assessment that meets the needs of the present in terms of the demands of formative and summative assessment, but which also prepares students to meet their own future learning needs. This paper reviews the value of such a notion for assessment; how it has been taken up over the past 15 years in higher education and why it might still be needed. It identifies how it has been a successful intervention in assessment discourse. It explores what more is needed to locate assessment as an intervention to focus on learning for the longer term. It shows how sustainable assessment can help bridge the gap between assessment and learning, and link to ideas such as self-regulation, students’ making judgements about their own work and course-wide assessment.

Aligning assessment with long‐term learning

Assessment in higher education is commonly held to contribute to feedback to students on their learning and the certification of their achievement. This paper argues that this short‐term focus must be balanced against a longer‐term emphasis for learning‐oriented assessment to foster future learning after graduation. The paper proposes that students need to become assessors within the context of participation in practice, that is, the kinds of highly contextualised learning faced in life and work. It discusses the kinds of practices that are needed to refocus assessment within higher education courses to this end.

Accountability in juvenile justice : a framework to assess client outcomes

This article describes the development of an assessment protocol for use with juvenile justice clients that can be used to assess needs in a manner that not only informs the development of case plans but also allows for the assessment of change over the course of a service contact. The youth justice assessment tool supports case needs identification and analysis as well as screening for mental health concerns, risk of harm to self or others, and risk of reoffending. Initial validation of the case needs component has been undertaken and although further validation is required, preliminary data reported in this article suggest that this type of approach to client assessment does hold some promise.

Healthcare costs associated with language difficulties up to 9 years of age: Australian population-based study

PURPOSE: This study aimed to quantify the non-hospital healthcare costs associated with language difficulties within two nationally representative samples of children. METHOD: Data were from three biennial waves (2004-2008) of the Longitudinal Study of Australian Children (B cohort: 0-5 years; K cohort: 4-9 years). Language difficulties were defined as scores ≤ 1.25 SD below the mean on measures of parent-reported communication (0-3 years) and directly assessed vocabulary (4-9 years). Participant data were linked to administrative data on non-hospital healthcare attendances and prescription medications from the universal Australian Medicare subsidized healthcare scheme. RESULT: It was found that healthcare costs over each 2-year age band were higher for children with than without language difficulties at 0-1, 2-3, and 4-5 years, notably 36% higher (mean difference = $AU206, 95% CI = $90, $321) at 4-5 years (B cohort). The slightly higher 2-year healthcare costs for children with language difficulties at 6-7 and 8-9 years were not statistically different from those without language difficulties. Modelled to the corresponding Australian child population, 2-year government costs ranged from $AU1.2-$AU12.1 million (depending on age examined). Six-year healthcare costs increased with the persistence of language difficulties in the K cohort, with total Medicare costs increasing by $192 (95% CI = $74, $311; p = .002) for each additional wave of language difficulties. CONCLUSION: Language difficulties (whether transient or persistent) were associated with substantial excess population healthcare costs in childhood, which are in addition to the known broader costs incurred through the education system. It is unclear whether healthcare costs were specifically due to the assessment and/or treatment of language difficulties, as opposed to conditions that may be co-morbid with or may cause language difficulties.

'Hands-on' assessment: a useful strategy for improving patient safety in emergency departments

BACKGROUND: Patient assessment is an essential nursing intervention that reduces the incidence and impact of errors and preventable adverse events in emergency departments (EDs). This paper reports on a key finding of the ED nurse component of a larger study investigating how registered nurses manage 'discontinuities' or 'gaps' in patient care. METHODS: The larger study was undertaken as a naturalistic inquiry using a qualitative exploratory descriptive approach. Data were collected from a criterion-based purposeful sample of 71 nurses, of which 19 were ED nurses, and analysed using content and thematic analysis strategies. RESULTS: The component of the study reported here revealed that ED nurses used 'hands-on', head-to-toe assessment to manage gaps in patient care. Examination of the data revealed three key dimensions of patient assessment in the ED: (i) assessment is the 'bread and butter' of emergency nursing; (ii) 'hands-on' assessment techniques are irreplaceable and, (iii) patient assessment is undervalued in EDs. CONCLUSIONS: The findings of this study reaffirm the role of 'hands-on' observation and assessment in creating safety in EDs. Further research and inquiry is needed to determine how health care systems can provide the conditions for ensuring that 'hands-on' assessment occurs.

Media internalization and conformity to traditional masculine norms in relation to body image concerns among men

Previous studies have separately examined conformity to masculine norms and internalization of body ideals in the media in relation to the drive for muscularity (DM). This study was designed to examine these factors together in relation to DM, and further examine how they may differ in relation to drive for thinness (DT) and drive for leanness (DL). Participants were 284 Australian males between ages 18 and 42. They completed validated measures that assessed DM, DT, DL, male gender role norms, and internalization of body ideals. The findings showed that internalization of body ideals mediated the relationship between masculine role norms and body image in the case of both DM and DL. However, masculine norms and internalization were independent predictors of DT. Our findings contribute to further understanding of the roles that the media and masculine norms have in shaping men's drive for muscularity, leanness, and thinness. Longitudinal research is needed to confirm the nature and direction of these relationships.

Assessment of simulated clinical skills and distance students: can we do it better?

Australian universities have traditionally been able to supplement clinical education, for undergraduate nursing courses, delivered on placement with weekly clinical teaching in the simulated environment. The Objective Structured Clinical Assessment (OSCA) tool has been used in this simulated environment to assess clinical skills. Recently, however, online delivery of undergraduate nursing courses has become more common. The move from an internal mode of teaching to an online external mode is seen worldwide and poses challenges to staff and students as well as changing the teaching and learning culture of institutions (Philip and Wozniak, 2009). This cultural shift and the resulting diminishing timeframe for students to acquire and practice simulated clinical skills imply that it may become necessary to rethink assessment forms such as the OSCA assessment. This study examines whether or not the OSCA tool developed by Bujack et al. (1991a) is the best tool to be used in this new context, where online teaching is supplemented by very short, annual, intensive periods of study. Skills acquisition theories dictate that time is required to produce an ideal skills acquisition environment (Quinn, 2000) but the time constraints placed on students in such intensive periods of study could influence skills acquisition. This cross-sectional qualitative study used semi-structured interviews and focus groups to collect data. 65% of the nursing faculty participated in the study. The teaching of the Bachelor of Nursing (BN) occurred on two campuses and staff from both areas participated. This group of nurse academics was employed across the range of academic levels (from lecturer to professor) at the University. Data analysis followed a generic thematic analysis framework. Findings in this study show that there are a variety of attitudes and underpinning beliefs amongst staff in relation to the OSCAs. Doubts were raised in regard to the suitability of the use of the OSCA tool in this setting. It also became apparent during this study that the OSCA tool possibly serves purposes other than an assessment tool.

How technology shapes assessment design: findings from a study of university teachers

A wide range of technologies has been developed to enhance assessment, but adoption has been inconsistent. This is despite assessment being critical to student learning and certification. To understand why this is the case and how it can be addressed, we need to explore the perspectives of academics responsible for designing and implementing technology-supported assessment strategies. This paper reports on the experience of designing technology-supported assessment based on interviews with 33 Australian university teachers. The findings reveal the desire to achieve greater efficiencies and to be contemporary and innovative as key drivers of technology adoption for assessment. Participants sought to shape student behaviors through their designs and made adaptations in response to positive feedback and undesirable outcomes. Many designs required modification because of a lack of appropriate support, leading to compromise and, in some cases, abandonment. These findings highlight the challenges to effective technology-supported assessment design and demonstrate the difficulties university teachers face when attempting to negotiate mixed messages within institutions and the demands of design work. We use these findings to suggest opportunities to improve support by offering pedagogical guidance and technical help at critical stages of the design process and encouraging an iterative approach to design.

A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: a pre-post study using full immersion simulation

AIMS AND OBJECTIVES: The aim of this study was to evaluate the effect of the new evidence-informed nursing assessment framework HIRAID (History, Identify Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) on the quality of patient assessment and fundamental nontechnical skills including communication, decision making, task management and situational awareness. BACKGROUND: Assessment is a core component of nursing practice and underpins clinical decisions and the safe delivery of patient care. Yet there is no universal or validated system used to teach emergency nurses how to comprehensively assess and care for patients. DESIGN: A pre-post design was used. METHODS: The performance of thirty eight emergency nurses from five Australian hospitals was evaluated before and after undertaking education in the application of the HIRAID assessment framework. Video recordings of participant performance in immersive simulations of common presentations to the emergency department were evaluated, as well as participant documentation during the simulations. Paired parametric and nonparametric tests were used to compare changes from pre to postintervention. RESULTS: From pre to postintervention, participant performance increases were observed in the percentage of patient history elements collected, critical indicators of urgency collected and reported to medical officers, and patient reassessments performed. Participants also demonstrated improvement in each of the four nontechnical skills categories: communication, decision making, task management and situational awareness. CONCLUSION: The HIRAID assessment framework improves clinical patient assessments performed by emergency nurses and has the potential to enhance patient care. RELEVANCE TO CLINICAL PRACTICE: HIRAID should be considered for integration into clinical practice to provide nurses with a systematic approach to patient assessment and potentially improve the delivery of safe patient care.

Renewing assessment practices: literacy teaching and learning in digital environments

Interpretations of “literacy” and approaches to literacy pedagogy and assessment are under renewal as meaning-making and learning are increasingly situated in digitized environments. While the implications of these shifts are in part technological, they are also relational, as students are increasingly positioned as interactive with participatory roles in self-knowledge and increased responsibility for their learning. However, while shifts are occurring in understandings of literacy and approaches to literacy pedagogy, the same cannot be said for the way in which assessments of digital literacies are undertaken. There is a lack of valid, reliable, and practical assessments of new literacies to inform and help students to become better prepared for study, work, and citizenship in digital environments. This article maps five characteristics of effective formative assessment in print-based classrooms with seven affordancesin digital learning and assessment to suggest an analytical framework for examining teacher and student assessment in digital environments. Drawing on data from a research project in which a team of teachers introduced a one-to-one computing program and worked to renew their literacy assessment practices, this article discusses how each of the seven affordances are enacted in the assessment practices in a years five and six primary school classroom. The findings from this research project show that educational technologies have the potential to enable new approaches to teaching, learning, and assessment that better align with the needs of twenty-first century literacy learners. The findings alsosupport approaches to formative assessment that value print and multimodality and engage students in more flexible and differentiated ways. They can enable teachers and students to be re-positioned as designers, knowledge producers, and collaborative learners. The seven affordances provide a framework that holds rich possibilities for teacher learning and planning as prompts to support reflection on formative assessment practices, critique habitual practices, and considernew opportunities.

Avian responses to an emergent, wetland weed

African boxthorn (Lycium ferocissimum Solanaceae) is a Weed of National Significance in Australia. It is particularly problematic in Victoria and is thought to not only threaten native wildlife but also provide important habitat, particularly to birds, when there is no native alternative. In a wetland ecosystem such as a saltmarsh, boxthorn has the potential to increase structural complexity because it can stand as an emergent above surrounding vegetation. We compared bird assemblages and behaviour in saltmarsh vegetation with and without boxthorn in a coastal wetland in south-east Australia. Species assemblage, but not richness, changed with the presence of boxthorn. The presence of singing honeyeaters (Lichenostomus virescens) and white-fronted chats (Epthianura albifrons), the two most common native bird species (based on numerical and spatial dominance), appeared to drive these differences; singing honeyeaters preferred boxthorn while white-fronted chats avoided it. The presence of boxthorn increased the seasonal availability of fruit and flowers, which was reflected by a high frequency of foraging for fruit and nectar where boxthorn was present. In saltmarshes without boxthorn, there was a higher frequency of foraging for insects. Some, but not all, species responded to increased structural complexity and fruit/floral resources provided by boxthorn. Consequently, management by reducing boxthorn is likely to alter bird communities and the usage of sites by some native species, thus management success should consider fine-scale biodiversity objectives, such as managing for particular types or species of birds.

Assessing Australian undergraduate clinical learning

Determining the clinical preparedness of undergraduate nursing students is vital in developing graduates who are ready to assume the roles of registered nurses. This paper reports findings relating to clinical assessment in Australian undergraduate nursing programs. Using data collected in a national survey and selected case studies, current assessment practices are described. Although students were increasingly exposed to a narrower range of clinical experiences, claims to comprehensive preparation of nurses remain prominent. Issues in the congruity between assessment methods and purported outcomes of clinical learning programs are discussed.

An evaluation of self-report measures of cognitive distortions and empathy among Australian sex offenders

The modification of deviant cognitions and the enhancement of victim empathy are central components in many treatment programs for sex offenders. There appear to be three broad problems with self-report measures of these factors: variations in the psychometric evaluation of measures; the transparency of items and thus the likely influence of social desirability; and the difficulty of determining which measures are specific to particular types of sex offenders. The aim of this study was to investigate these three issues among child molesters (CMs), and men convicted of sex offences against adults (ASOs). Data were collected from 36 CMs and 31 ASOs and from two comparison groups (33 men convicted of nonsexual offences and 40 nonoffenders from the community), to assess the reliability (internal and test-retest) and validity (discriminant, construct, and face) of measures, the influence of sexual social desirability on responding and the specificity of measures to both sex offender groups. Collectively, the results raise issues related to the assessment of sex offenders that require further investigation. They also have theoretical implications about the relationship between cognitive and emotive processes among sex offenders.

The zebrafish spil promoter drives myeloid-specific expression in stable transgenic fish

The spi1 (pu.1) gene has recently been identified as a useful marker of early myeloid cells in zebrafish. To enhance the versatility of this organism as a model for studying myeloid development, the promoter of this gene has been isolated and characterized. Transient transgenesis revealed that a 5.3 kilobase promoter fragment immediately upstream of the spi1 coding sequence was sufficient to drive expression of enhanced green fluorescent protein (EGFP) in injected embryos in a manner that largely recapitulated the native spi1 gene expression pattern. This fragment was successfully used to produce a germ line transgenic line of zebrafish with EGFP-expressing myeloid cells. These TG(spi1:EGFP)pA301 transgenic zebrafish represent a valuable tool for further studies of myeloid development and its perturbation.