Investigating the complexity of judgement practice

Underlying all assessments are human judgements regarding the quality of students’ understandings. Despite their ubiquity, those judgements are conceptually elusive. The articles selected for inclusion in this issue explore the complexity of judgement practice raising critical questions that challenge existing views and accepted policy and practice.

Towards improving public understanding of judgement practice in standards-referenced assessment : an Australian perspective

Internationally there has been a move towards standards-referenced assessment with countries such as Australia developing a National Curriculum and Achievement Standards, New Zealand adopting National Standards for literacy and numeracy that involve schools making and reporting judgements about the reading, writing and mathematics achievement of children up to Year 8 (the end of primary school) and in Canada, classroom assessment standards aimed at the improvement of assessment practice of K-12 education are being formulated. Standards-driven reform has major implications for teachers’ work. The consequences of adopting a standards-driven approach to educational change by systems are often under-estimated with the unintended effects not fully understood by either the policy writers, and the public, including parents. It is for these reasons that the contention developed in this article relates to the teacher’s role, which it is argued remains central to policy focused on the improvement of the quality of education and educational standards.

STEM futures and practice, can we teach STEM in a more meaningful and integrated way?

Integrating Science, Technology, Engineering and Mathematics (STEM) subjects can be engaging for students, can promote problem-solving and critical thinking skills and can help build real-world connections. However, STEM has long been an area of some confusion for some educators. While they can see many of the conceptual links between the various domains of knowledge they often struggle to meaningfully integrate and simultaneously teach the content and methodologies of each these areas in a unified and effective way for their students. Essentially the question is;how can the content and processes of four disparate and yet integrated learning areas be taught at the same time? How can the integrity of each of the areas be maintained and yet be learnt in a way that is complementary? Often institutional barriers exitin schools and universities to the integration of STEM. Organizationally, at a departmental and administrative level, the teaching staff may be co-located, but when it comes to classroom practice or the teaching and learning of these areas they are usually taught very separately. They are usually taught in different kinds of spaces, in different ways (using different pedagogical approaches) and at different times. But is this the best way for students to engage with the STEM areas of learning? How can we make learning more integrated, meaningful and engaging for the students?

Arts-health intersections : a model of practice for consistency in the arts-health sector

The field of Arts-Health practice and research has grown exponentially in the past 30 years. While researchers are using applied arts as the subject of investigation in research, the evaluation of practice and participant benefits has a limited general focus. In recent years, the field has witnessed a growing concentration on the evaluation of health outcomes, outputs and tangential benefits for participants engaging in Arts-Health practice. The wide range of methodological approaches applied arts practitioners implement make the field difficult to define. This article introduces the term Arts-Health intersections as a model of practice and framework to promote consistency in design, implementation and evaluative processes in applied arts programmes promoting health outcomes. The article challenges the current trend to solely evaluate health outcomes in the field, and promotes a concurrent and multidisciplinary methodological approach that can be adopted to promote evaluation, consistency and best practice in the field of Arts-Health intersections. The article provides a theoretical overview of Arts-Health intersections, and then takes this theoretical platform and details a best model of practice for developing Arts-Health intersections and presents this model as a guide.

Cutting on action : interference strategies in contemporary art practice

The domestication of creative software and hardware has been a significant factor in the recent proliferation of still and moving image creation. Booming numbers of amateur image-makers have the resources, skills and ambitions to create and distribute their work on a mass scale. At the same time, contemporary art seems increasingly dominated by ‘post-medium’ practices that adopt and adapt the representational techniques of mass culture, rather than overtly reject or oppose them. As a consequence of this network of forces, the field of image and video production is no longer the exclusive specialty of art and the mass media, and art may no longer be the most prominent watchdog of mass image culture. Intuitively and intentionally, contemporary artists are responding to these shifting conditions. From the position of a creative practitioner and researcher, this paper examines the strategies that contemporary artists use to engage with the changing relationships between image culture, lived experience and artistic practice. By examining the intersections between W.J.T. Mitchell’s detailed understanding of visual literacy and Jacques Derrida’s philosophical models of reading and writing, I identify ‘editing’ as a broad methodology that describes how practitioners creatively and critically engage with the field of still and moving images. My contention is that by emphasising the intersections of looking and making, ‘reading’ and ‘writing’, artists provide crucial jump cuts, pauses and distortions in the medley of our mediated experiences.

Double blind : women as creative practice-led researchers

While the productive relationship between praxis and feminist research has been well established, the situation is more complicated for female artist/researchers in the fraught field of creative practice-led research. Firstly, their research is being conducted in the context of ongoing debate, as Andrea Phillips has summarized, over whether practice-led research has been embraced in order to potentially produce emancipatory knowledge, or whether it is simply the rationalization and quantification of creative processes. Secondly, there is a pervasive paradox whereby, rather than feeling empowered by the process of critical and reflective self-analysis, many women are inhibited by enduring insecurities about the value of their work and/or their ownership of it. The reasons for this appear to be twofold: they are disheartened by the ongoing disproportion of successful women artists, and they are intimidated by the fundamentally masculine discourse surrounding research in the university. Many of these anxieties appear to have been exacerbated by the research quality assessment process, the Excellence in Research for Australia Initiative (ERA). This collaborative paper draws on the authors' experiences as both artist-researchers and educators to contextualize this paradox and also discuss what forms of praxis intervention may be useful in the preparation for, and supervision of, creative practice-led research by women.

Theories of learning mathematics

According to Karl Popper, widely regarded as one of the greatest philosophers of science in the 20th century, falsifiability is the primary characteristic that distinguishes scientific theories from ideologies – or dogma. For example, for people who argue that schools should treat creationism as a scientific theory, comparable to modern theories of evolution, advocates of creationism would need to become engaged in the generation of falsifiable hypothesis, and would need to abandon the practice of discouraging questioning and inquiry. Ironically, scientific theories themselves are accepted or rejected based on a principle that might be called survival of the fittest. So, for healthy theories on development to occur, four Darwinian functions should function: (a) variation – avoid orthodoxy and encourage divergent thinking, (b) selection – submit all assumptions and innovations to rigorous testing, (c) diffusion – encourage the shareability of new and/or viable ways of thinking, and (d) accumulation – encourage the reuseability of viable aspects of productive innovations.

Managing the health effects of temperature in response to climate change : challenges ahead

BACKGROUND: Although many studies have shown that high temperatures are associated with an increased risk of mortality and morbidity, there has been little research on managing the process of planned adaptation to alleviate the health effects of heat events and climate change. In particular, economic evaluation of public health adaptation strategies has been largely absent from both the scientific literature and public policy discussion. OBJECTIVES: his paper aims to discuss how public health organizations should implement adaptation strategies, and how to improve the evidence base for policies to protect health from heat events and climate change. DISCUSSION: Public health adaptation strategies to cope with heat events and climate change fall into two categories: reducing the heat exposure and managing the health risks. Strategies require a range of actions, including timely public health and medical advice, improvements to housing and urban planning, early warning systems, and the assurance that health care and social systems are ready to act. Some of these actions are costly, and the implementation should be based on the cost-effectiveness analysis given scarce financial resources. Therefore, research is required not only on the temperature-related health costs, but also on the costs and benefits of adaptation options. The scientific community must ensure that the health co-benefits of climate change policies are recognized, understood and quantified. CONCLUSIONS: The integration of climate change adaptation into current public health practice is needed to ensure they increase future resilience. The economic evaluation of temperature-related health costs and public health adaptation strategies are particularly important for policy decisions.

Symposium - How effective are brief motivational interviewing interventions : Are they necessary? Do they require enhancement? Can they be translated into routine clinical practice?

Brief interventions are effective for problem drinking and reductions are known to occur in association with screening and assessment. Design and methods: This study aimed to determine how much change occurred between baseline assessment and a one-session brief intervention (S1), and the predictors of early change among adults with comorbid depression and alcohol misuse (n=202) participating in a clinical trial. The primary focus was on changes in Beck Depression Inventory fastscreen scores and alcohol consumption (standard drinks per week) prior to random allocation to nine further sessions addressing either depression, alcohol, or both problems. Results: There were large and clinically significant reductions between baseline and S1, with the strongest predictors being baseline scores in the relevant domain and change in the other domain. Client engagement was also predictive of early depression changes. Discussion and Conclusion: Monitoring progress in both domains from first contact, and provision of empathic care, followed by brief intervention appear to be useful for this high prevalence comorbidity...

Preparing citizens for a complex world : the grand challenge of teaching socio-scientific issues in science education

The dawn of the twenty-first century encouraged a number of scientific and technological organisations to identify what they saw as ‘Grand Challenges and Opportunities’. Issues of environment and health featured very prominently in these quite short lists, as can be seen from a sample of these challenges in Table 1. Indeed, the first two lists of challenges in Table 1 were identified as for the environment and for health, respectively.

New graduate occupational therapists feelings of preparedness for practice in Australia and Aotearoa/New Zealand

Aim The development of competent future allied health professionals through academic programmes, professional support and practical education is continually evolving. The aim of this study was to explore the feelings of newly graduated occupational therapists in Australia and Aotearoa/New Zealand regarding their education and work preparedness. Methods Newly graduated occupational therapists from Australia (n = 178) and Aotearoa/New Zealand (n = 53) who had completed their occupational therapy studies in 2007 were recruited. Participants completed an online survey which explored their preparedness for work; based on professional competencies. Results Most newly graduated occupational therapists felt somewhat prepared for practice. However, only 17.1% of Australian new graduates, and even fewer (8.5%) of Aotearoa/New Zealand new graduates felt very well prepared. Participants felt more prepared for the competencies required for ‘managing inwards’ (including interpersonal skills) and less prepared for those required for ‘managing outwards’ (including evidence-based practice). Conclusions This study provides the first international comparison into the feelings of competence and preparedness for practice of new graduates of occupational therapy from Australia and Aotearoa/New Zealand. Given the importance of competencies, such as evidence-based practice to the progress of the profession, there is a need to further explore methods to increase feelings of preparedness in these areas.

A model for enhancing assessment and teaching practice at the coalface : Insights from a Fellow-In-Residence engagement program

Australian universities are currently engaging with new governmental policies and regulations that require them to demonstrate enhanced quality and accountability in teaching and research. The development of national academic standards for learning outcomes in higher education is one such instance of this drive for excellence. These discipline-specific standards articulate the minimum, or Threshold Learning Outcomes, to be addressed by higher education institutions so that graduating students can demonstrate their achievement to their institutions, accreditation agencies, and industry recruiters. This impacts not only on the design of Engineering courses (with particular emphasis on pedagogy and assessment), but also on the preparation of academics to engage with these standards and implement them in their day-to-day teaching practice on a micro level. This imperative for enhanced quality and accountability in teaching is also significant at a meso level, for according to the Australian Bureau of Statistics, about 25 per cent of teachers in Australian universities are aged 55 and above and more than 54 per cent are aged 45 and above (ABS, 2006). A number of institutions have undertaken recruitment drives to regenerate and enrich their academic workforce by appointing capacity-building research professors and increasing the numbers of early- and mid-career academics. This nationally driven agenda for quality and accountability in teaching permeates also the micro level of engineering education, since the demand for enhanced academic standards and learning outcomes requires both a strong advocacy for a shift to an authentic, collaborative, outcomes-focused education and the mechanisms to support academics in transforming their professional thinking and practice. Outcomes-focused education means giving greater attention to the ways in which the curriculum design, pedagogy, assessment approaches and teaching activities can most effectively make a positive, verifiable difference to students’ learning. Such education is authentic when it is couched firmly in the realities of learning environments, student and academic staff characteristics, and trustworthy educational research. That education will be richer and more efficient when staff works collaboratively, contributing their knowledge, experience and skills to achieve learning outcomes based on agreed objectives. We know that the school or departmental levels of universities are the most effective loci of changes in approaches to teaching and learning practices in higher education (Knight & Trowler, 2000). Heads of Schools are being increasingly entrusted with more responsibilities - in addition to setting strategic directions and managing the operational and sometimes financial aspects of their school, they are also expected to lead the development and delivery of the teaching, research and other academic activities. Guiding and mentoring individuals and groups of academics is one critical aspect of the Head of School’s role. Yet they do not always have the resources or support to help them mentor staff, especially the more junior academics. In summary, the international trend in undergraduate engineering course accreditation towards the demonstration of attainment of graduate attributes poses new challenges in addressing academic staff development needs and the assessment of learning. This paper will give some insights into the conceptual design, implementation and empirical effectiveness to date, of a Fellow-In-Residence Engagement (FIRE) program. The program is proposed as a model for achieving better engagement of academics with contemporary issues and effectively enhancing their teaching and assessment practices. It will also report on the program’s collaborative approach to working with Heads of Schools to better support academics, especially early-career ones, by utilizing formal and informal mentoring. Further, the paper will discuss possible factors that may assist the achievement of the intended outcomes of such a model, and will examine its contributions to engendering an outcomes-focussed thinking in engineering education.

Standardising radiation therapy undergraduate competency levels

QUT Bachelor of Radiation Therapy students progress from first visiting a radiation therapy department to graduation and progression into the NPDP over a span of three years. Although there are clear guidelines as to expected competency level post-NPDP, there is still a variety of perceived levels prior to this. Staff and students feedback both suggest that different centres and within centres different staff have differing opinions of these levels. Indeed, many staff members object to the use of the word “competency” for a pre-NPODP undergraduate, preferring the term “achievement”. While it is acknowledged that students progress at different rates, it is vitally important for equity that staff expectations of students at different academic levels are identical. Provision of guidelines for different stages of progression are essential for equitable assessment and most assessments, including the NRTAT are complemented by statements to enable level to be determined. For the University-specific competency assessments some level of consensus between clinical staff is required, especially where students are placed at a large number of different placement sites. Aims The main aim of this initial study is to gauge staff opinions of levels of student progression in order to judge cross-centres consistency. A secondary objective is to evaluate the degree of correlation between staff seniority and perception of student levels. Informal feedback suggests that staff at or just post NPDP level have a different perception of student competency expectations than more senior staff. If these perceptions change with level it will make agreement of guidelines statements more challenging. Study Methods A standard evaluation questionnaire was provided to RT staff participating in ongoing updates to clinical assessment. As part of curriculum development staff were asked to provide anonymous and optional answers to further questions in order to audit current practice. This involved assigning level of student progression to different statements relating to tasks or competencies. After data collation, scores were assigned to level and totals used to rank statements according to perceived student level. Descriptive statistical analysis was used to identify which statements were easier to assign to student level and which were more ambiguous. Further sub-analysis was performed for each category of staff seniority to judge differences in perception. Strength of correlation between seniority and expectation was calculated to confirm or contradict the informal feedback. Results By collating different staff perceptions of competencies for different student levels commonly agreed statements can be used to define achievement level. This presentation outlines the results of the audit including statements that most staff perceived as relevant to a specific student group and statements that staff found to be harder to attribute. Strength of correlation between staff perception and seniority will be outlined where statistically significant.

Creative intersections : supervision, practice and the space between

Supervision in the creative arts is a topic of growing significance since the increase in creative practice PhDs across universities in Australasia. This presentation will provide context of existing discussions in creative practice and supervision. Creative practice – encompassing practice-based or practice-led research – has now a rich history of research surrounding it. Although it is a comparatively new area of knowledge, great advances have been made in terms of how practice can influence, generate, and become research. The practice of supervision is also a topic of interest, perhaps unsurprisingly considering its necessity within the university environment. Many scholars have written much about supervision practices and the importance of the supervisory role, both in academic and more informal forms. However, there is an obvious space in between: there is very little research on supervision practices within creative practice higher degrees, especially at PhD or doctorate level. Despite the existence of creative practice PhD programs, and thus the inherent necessity for successful supervisors, there remain minimal publications and limited resources available. Creative Intersections explores the existing publications and resources, and illustrates that a space for new published knowledge and tools exists.