A survey to evaluate the implementation of a national clinical assessment form

Purpose: The Australian Universities Radiation Therapy Student Clinical Assessment Form (AURTSCAF) was designed to assess the clinical skills of radiation therapy (RT) students from the six universities that offer entry level RT programs. Given the AURTSCAF has now been in use for over two years, the Radiation Therapy Program Coordinators (RTPC) group initiated a post implementation evaluation survey. This formed the final phase of the AURTSCAF project and was funded by the Radiation Oncology Division of the Department of Health and Ageing. Methods: A cross-sectional designed survey using purposive sampling was distributed via email to all RT clinical sites. The survey asked questions about the requirements of a pass grade for students at different stages of their program, and the addition of a new category of assessment related to fitness to practise. Response types included both forced choice closed ended responses and open ended responses. There was also a section for open comments about the AURTSCAF. Results: There were 100 responses (55%) from clinicians who had utilised the assessment form over the previous 12 month period. Responses highlighted several positives with regard to the utility and implementation of the form. Comments regarding areas for improvement with the standardisation of the grading of students and consensus for the addition of a new domain in fitness for practise have informed the recommended changes proposed for 2012. Conclusion: This evaluation has provided a representative sample of the views of clinicians involved in assessing students on clinical placement. Recommendations include the addition of the sixth domain of assessment: Fitness for practise, the addition of descriptors and prompts for this domain in the user guide, the addition of a consensus statement about the use of the rating scale and dissemination of the proposed changes nationally.

Effect of caffeine on adenosine-induced reversible perfusion defects assessed by automated analysis

Objectives This prospective study investigated the effects of caffeine ingestion on the extent of adenosine-induced perfusion abnormalities during myocardial perfusion imaging (MPI). Methods Thirty patients with inducible perfusion abnormalities on standard (caffeine-abstinent) adenosine MPI underwent repeat testing with supplementary coffee intake. Baseline and test MPIs were assessed for stress percent defect, rest percent defect, and percent defect reversibility. Plasma levels of caffeine and metabolites were assessed on both occasions and correlated with MPI findings. Results Despite significant increases in caffeine [mean difference 3,106 μg/L (95% CI 2,460 to 3,752 μg/L; P < .001)] and metabolite concentrations over a wide range, there was no statistically significant change in stress percent defect and percent defect reversibility between the baseline and test scans. The increase in caffeine concentration between the baseline and the test phases did not affect percent defect reversibility (average change −0.003 for every 100 μg/L increase; 95% CI −0.17 to 0.16; P = .97). Conclusion There was no significant relationship between the extent of adenosine-induced coronary flow heterogeneity and the serum concentration of caffeine or its principal metabolites. Hence, the stringent requirements for prolonged abstinence from caffeine before adenosine MPI—based on limited studies—appear ill-founded.

The future of sustainable building assessment tools : a case study in Australia

Sustainability issues in built environment have attracted an increasingly level of attention from both the general public and the industry. As a result, a number of green building assessment tools have been developed such as the Leadership in Energy and Environmental Design (LEED) and the BRE Environmental Assessment Method (BREEAM), etc. This paper critically reviewed the assessment tools developed in Australian context, i.e. the Green Star rating tools developed by the Green Building Council of Australia. A particular focus is given to the recent developments of these assessment tools. The results showed that the office buildings take the biggest share of Green Star rated buildings. Similarly, sustainable building assessments seem to be more performance oriented which focuses on the operation stage of buildings. In addition, stakeholder engagement during the decision making process is encouraged. These findings provide useful references to the development of next generation of sustainable building assessment tools.

When non-significance may be significant : lessons learned from a study of the development, implementation and evaluation of a fleet risk assessment tool

This paper reports on the development and implementation of a self-report risk assessment tool that was developed in an attempt to increase the efficacy of crash prediction within Australian fleet settings. This study forms a part of a broader program of research into work related road safety and identification of driving risk. The first phase of the study involved a series of focus groups being conducted with 217 professional drivers which revealed that the following factors were proposed to influence driving performance: Fatigue, Knowledge of risk, Mood, Impatience and frustration, Speed limits, Experience, Other road users, Passengers, Health, and Culture. The second phase of the study involved piloting the newly developed 38 item Driving Risk Assessment Scale - Work Version (DRAS-WV) with 546 professional drivers. Factor analytic techniques identified a 9 factor solution that was comprised of speeding, aggression, time pressure, distraction, casualness, awareness, maintenance, fatigue and minor damage. Speeding and aggressive driving manoeuvres were identified to be the most frequent aberrant driving behaviours engaged in by the sample. However, a series of logistic regression analyses undertaken to determine the DRAS-WV scale’s ability to predict self-reported crashes revealed limited predictive efficacy e.g., 10% of crashes. This paper outlines proposed reasons for this limited predictive ability of the DRAS-WV as well as provides suggestions regarding the future of research that aims to develop methods to identify “at risk” drivers.

A Systems-level approach to building sustainable assessment cultures : moderation, quality task design and dependability of judgement

This paper considers the conditions that are necessary at system and local levels for teacher assessment to be valid, reliable and rigorous. With sustainable assessment cultures as a goal, the paper examines how education systems can support local level efforts for quality learning and dependable teacher assessment. This is achieved through discussion of relevant research and consideration of a case study involving an evaluation of a cross-sectoral approach to promoting confidence in school-based assessment in Queensland, Australia. Building on the reported case study, essential characteristics for developing sustainable assessment cultures are presented, including: leadership in learning; alignment of curriculum, pedagogy and assessment; the design of quality assessment tasks and accompanying standards, and evidence-based judgement and moderation. Taken together, these elements constitute a new framework for building assessment capabilities and promoting quality assurance.

…Where did I lose you? Accessing the literacy demands of assessment

In this study we sought to find out how teachers could make assessment fairer for Indigenous students in learning mathematics, given the context of the high stakes of the National Assessment Program Literacy and Numeracy (NAPLAN). Today, teachers are experiencing the full range of demands from their own students who require individual attention, through to system level expectations of improved performances for all students. Many staff experience reform fatigue with limited time for critical reflection and a reduction in support for the use and the analysis of the overwhelming amount of data that has become available in recent years. Over the past three years we worked with teachers in seven schools to gradually refine our research focus to centre on how we might best support teachers in this demanding context with the important outcome of improved teaching and learning of mathematics with particular consideration of how to respond to the cultural needs of Indigenous (Aboriginal and Torres Strait Islander) students.

The development of teacher assessment identity through participation in online moderation

Teachers’ professional conversations regarding the qualities evidenced in student work provide opportunities to develop a shared understanding of achievement standards. This research investigates social moderation conducted in a synchronous online mode as a specific form of professional conversation. The discussion considers the different factors that influenced these conversations which included the technologic medium of the meeting. The focus of the discussion is how participation in online moderation can support teachers to develop an assessment identity as one who works within a standards-based assessment system. Qualitative data were gathered from middle school teachers from different year levels, in different curriculum areas, in diverse geographic locations, and in a range of sociocultural contexts within Queensland, Australia. Analysis of the data through a sociocultural lens of becoming suggests that participation in online moderation, while challenging for teachers, can also provide opportunities to construct and to negotiate an identity as an assessor of student work.

The Australian curriculum : implications for teaching and assessment

Teachers will be aware of the raft of educational changes introduced recently and also of the associated challenges and opportunities that such educational reforms present. This PETAA Paper commences with an overview of the major educational changes and how they impinge on teachers’ classroom practice in the teaching of English and makes explicit the implications for policy support. This article aims to provide teachers with some insight into how they might respond in their teaching to develop their own assessment and pedagogic practices and in so doing support students to improve in their learning and to achieve higher standards. A group of teachers’ classroom practice, which has applicability to both Upper Primary and Middle School English teaching, is analysed to demonstrate how these teachers have pedagogically incorporated some of the ‘general capabilities’ and a cross-curriculum priority of ‘Aboriginal and Torres Strait Islander histories and cultures’ into their classroom practice.

Multimodal approaches to reflective teaching and assessment in higher education

Reflection is not a new concept in the teaching of higher education and is often an important component of many disciplinary courses. Despite this, past research shows that whilst there are examples of rich reflective strategies used in some areas of higher education, most approaches to and conceptualisations of reflective learning and assessment have been perfunctory and inconsistent. In many disciplinary areas reflection is often assessed as a written activity ‘tagged onto’ assessment practices. In creative disciplines however, reflective practice is an integral and cumulative form of learning and is often expressed in ways other than in the written form. This paper will present three case studies of reflective practice in the area of Creative Industries in higher education – Dance, Fashion and Music. It will discuss the ways in which higher education teachers and students use multi-modal approaches to expressing knowledge and reflective practice in context. The paper will argue that unless students are encouraged to participate in deep reflective disciplinary discourse via multi-modes then reflection will remain superficial in the higher education context.

Motivators and barriers to incorporating climate change-related health risks in environmental health impact assessment

Climate change presents risks to health that must be addressed by both decision-makers and public health researchers. Within the application of Environmental Health Impact Assessment (EHIA), there have been few attempts to incorporate climate change-related health risks as an input to the framework. This study used a focus group design to examine the perceptions of government, industry and academic specialists about the suitability of assessing the health consequences of climate change within an EHIA framework. Practitioners expressed concern over a number of factors relating to the current EHIA methodology and the inclusion of climate change-related health risks. These concerns related to the broad scope of issues that would need to be considered, problems with identifying appropriate health indicators, the lack of relevant qualitative information that is currently incorporated in assessment and persistent issues surrounding stakeholder participation. It was suggested that improvements are needed in data collection processes, particularly in terms of adequate communication between environmental and health practitioners. Concerns were raised surrounding data privacy and usage, and how these could impact on the assessment process. These findings may provide guidance for government and industry bodies to improve the assessment of climate change-related health risks.

Assessment of the health impacts of the 2011 summer floods in Brisbane

Objective To assess the effects of the 2011 floods in Brisbane, Australia, on residents’ physical and mental health. Methods Residents who had been affected by the floods completed a community-based survey that examined the direct impact of flooding on households and their perceived physical and mental health. Outcome variables included overall and respiratory health and mental health outcomes related to psychological distress, sleep quality, and posttraumatic stress disorder (PTSD). Multivariable logistic regression was used to examine the association between flooding and perceived health outcome variables, adjusted for current health status and sociodemographic factors. Results Residents whose households were directly affected by flooding were more likely to report poor overall (Odds Ratio [OR] 5.3; 95% CI, 2.8-10.1) and respiratory (OR 2.3; 95% CI, 1.1-4.6) health, psychological distress (OR 1.9; 95% CI, 1.1-3.5), poor sleep quality (OR 2.3; 95% CI, 1.2-4.4), and probable PTSD (OR 2.3; 95% CI, 1.2-4.5). Conclusions The 2011 Brisbane floods had significant impact on the physical and psychosocial health of residents. Improved support strategies may need to be integrated into existing disaster management programs to reduce flood-related health impacts, particularly those related to mental health.

An Assessment of Undergraduate Paramedic Students’ Empathy Levels

Abstract: Objectives Evidence suggests that improved empathy behaviours among healthcare professionals directly impacts on healthcare outcomes. However, the ‘nebulous’ properties of empathic behaviour often means that healthcare profession educators fail to incorporate the explicit teaching and assessment of empathy within the curriculum. The objective of this study was to assess the extent of empathy in paramedic students across seven Australian universities. Methods A cross-sectional study using a paper-based questionnaire employing a convenience sample of first, second, and third year undergraduate paramedic students. Student empathy levels were measured using the Medical Condition Regard Scale (MCRS). Results A total of 783 students participated in the study of which 57% were females. The medical conditions: intellectual disability, attempted suicide, and acute mental illness all produced mean scores above 50 suggesting good empathetic regard, while patients presenting with substance abuse produced the lowest mean score M= 41.57 (SD=12.29). There was a statistically significant difference between males (M= 49.79) and females (M=51.61) p=0.006, for patients with intellectual disability. Conclusions The findings from this study found that student reported poor empathetic regard for patients with substance abuse, while female students report higher levels of empathy than their male colleagues across each medical condition. The overall findings provide a framework for educators to begin constructing guidelines focusing on the need to incorporate, promote and instil empathy into paramedic students in order to better prepare them for future out-of-hospital healthcare practice.

Are you telling the truth? Psychopathy assessment and impression management in a community sample

Objectives: Researchers have suggested that approximately 1% of individuals within the community have psychopathic tendencies (Neumann and Hare, 2008), although confirmatory evidence is scant. Design: The current study aimed to extend previous research beyond university student samples to explore the effect of impression management and self-deception on the identification of psychopathic traits. Methods: A non-incarcerated community sample comprising of 300 adults completed the Self-Reported Psychopathy scale – version 3 (SRP-III; Paulhus, Hemphill & Hare, in press) as well as the Paulhus Deception Scales (PDS; Paulhus, 1998). Results: Results indicated that at least 1% of the current community sample had clear psychopathic tendencies, and that such tendencies were found in younger males who mis-used alcohol. Conclusions: Importantly, individuals with psychopathic traits did not present with an inflated propensity to distort assessment responses, which provides support for future research endeavours that aim to conduct larger-scale psychopathy assessments within the community. This paper further outlines the study implications in regards to the practical assessment of psychopathy.

Mandated literacy assessment and the reorganisation of teachers’ work : federal policy, local effects

This paper explores how mandated literacy assessment is reorganising teachers’ work in the context of Australia’s National Assessment Program – Literacy and Numeracy (NAPLAN), which was implemented in 2008. Students in Years 3, 5, 7 and 9 are tested annually, with school results publicly available. The wider policy context and the emergence of different forms of interconnected educational work associated with the testing phenomenon are described. Taking an Institutional Ethnography approach, the local effects of the federal policy regime are examined through a case study of one school. What mandated literacy assessment does to educators’ work in a culturally diverse low socioeconomic school community is discussed. Key themes include strategic exclusions of students from the testing process, appropriations and adaptations of literacy theory, work intensification, and ethical mediation of results. Questions concerning equity are raised about the differential effects of policy in different school contexts.

Interpretations of formative assessment in the teaching of English at two Chinese universities : a sociocultural perspective

Formative assessment is increasingly being implemented through policy initiatives in Chinese educational contexts. As an approach to assessment, formative assessment derives many of its key principles from Western contexts, notably through the work of scholars in the UK, the USA and Australia. The question for this paper is the ways that formative assessment has been interpreted in the teaching of College English in Chinese Higher Education. The paper reports on a research study that utilised a sociocultural perspective on learning and assessment to analyse how two Chinese universities – an urban-based Key University and a regional-based Non-Key University – interpreted and enacted a China Ministry of Education policy on formative assessment in College English teaching. Of particular interest for the research were the ways in which the sociocultural conditions of the Chinese context mediated understanding of Western principles and led to their adaptation. The findings from the two universities identified some consistency in localised interpretations of formative assessment which included emphases on process and student participation. The differences related to the specific sociocultural conditions contextualising each university including geographical location, socioeconomic status, and teacher and student roles, expectations and beliefs about English. The findings illustrate the sociocultural tensions in interpreting, adapting and enacting formative assessment in Chinese College English classes and the consequent challenges to and questions about retaining the spirit of formative assessment as it was originally conceptualised.