Measuring impact: Positioning evaluation in the Australian arts and culture landscape

Arts culture organisations and funding authorities increasingly need to evaluate the impact of festivals, events and performances. Economic impacts are often privileged over 'soft data' about community experience and engagement. This new book offers a timely and scholarly demonstration of how cultural value and impact can be evaluated. It offers an innovative approach whereby the relationship developed between the researchers/evaluator and the commissioning arts and cultural producer provides an opportunity to rethink the traditional process of reporting back on value and impact through the singular entity of funds acquittal. Using three commissioned evaluations undertaken at an Australian university as an extended case study, the book investigates the two positions most often adopted by researchers/evaluators - embedded and collaborative, or external and distanced - and argues the merits and deficiencies of the two approaches. Offering an examination of how arts evaluation 'works' in theory and practice and more importantly, why it is needed now and in the future to demonstrate the reach and cultural gains from arts and cultural projects, this will be essential reading for students in arts management, professionals working in arts and cultural organisations, scholars working in association with creative industries and cultural development.

Trans-disciplinary research in synthesis of grass pollen aerobiology and its importance for respiratory health in Australasia

Grass pollen is a major trigger for allergic rhinitis and asthma, yet little is known about the timing and levels of human exposure to airborne grass pollen across Australasian urban environments. The relationships between environmental aeroallergen exposure and allergic respiratory disease bridge the fields of ecology, aerobiology, geospatial science and public health. The Australian Aerobiology Working Group comprised of experts in botany, palynology, biogeography, climate change science, plant genetics, biostatistics, ecology, pollen allergy, public and environmental health, and medicine, was established to systematically source, collate and analyse atmospheric pollen concentration data from 11 Australian and six New Zealand sites. Following two week-long workshops, post-workshop evaluations were conducted to reflect upon the utility of this analysis and synthesis approach to address complex multidisciplinary questions. This Working Group described i) a biogeographically dependent variation in airborne pollen diversity, ii) a latitudinal gradient in the timing, duration and number of peaks of the grass pollen season, and iii) the emergence of new methodologies based on trans-disciplinary synthesis of aerobiology and remote sensing data. Challenges included resolving methodological variations between pollen monitoring sites and temporal variations in pollen datasets. Other challenges included “marrying” ecosystem and health sciences and reconciling divergent expert opinion. The Australian Aerobiology Working Group facilitated knowledge transfer between diverse scientific disciplines, mentored students and early career scientists, and provided an uninterrupted collaborative opportunity to focus on a unifying problem globally. The Working Group provided a platform to optimise the value of large existing ecological datasets that have importance for human respiratory health and ecosystems research. Compilation of current knowledge of Australasian pollen aerobiology is a critical first step towards the management of exposure to pollen in patients with allergic disease and provides a basis from which the future impacts of climate change on pollen distribution can be assessed and monitored.

Bayesian predictive modeling and comparison of oil samples

Statistical comparison of oil samples is an integral part of oil spill identification, which deals with the process of linking an oil spill with its source of origin. In current practice, a frequentist hypothesis test is often used to evaluate evidence in support of a match between a spill and a source sample. As frequentist tests are only able to evaluate evidence against a hypothesis but not in support of it, we argue that this leads to unsound statistical reasoning. Moreover, currently only verbal conclusions on a very coarse scale can be made about the match between two samples, whereas a finer quantitative assessment would often be preferred. To address these issues, we propose a Bayesian predictive approach for evaluating the similarity between the chemical compositions of two oil samples. We derive the underlying statistical model from some basic assumptions on modeling assays in analytical chemistry, and to further facilitate and improve numerical evaluations, we develop analytical expressions for the key elements of Bayesian inference for this model. The approach is illustrated with both simulated and real data and is shown to have appealing properties in comparison with both standard frequentist and Bayesian approaches

Learner driver mentor programs: Stakeholder perspectives on an ideal program

This study investigated the development and operation of Learner Driver Mentor Programs (LDMPs). LDMPs are used throughout Australia to assist young learner drivers to gain supervised on-road driving experience through coordinated access to vehicles and supervisors. There is a significant lack of research regarding these programs. In this study, 41 stakeholders including representatives from existing or ceased LDMPs as well as representatives of other groups completed a questionnaire in either survey or interview format. The questionnaire sought information about the objectives of LDMPs, any social problems that were targeted as well as the characteristics of an ideal program and what could be done to improve them. Stakeholders indicated that LDMPs were targeted at local communities and, therefore, there should be a clear local need for the program as well as community ownership and involvement in the program. Additionally, the program needed to be accessible and provide clear positive outcomes for mentees. The most common suggestion to improve LDMPs related to the provision of greater funding and sponsorship, particularly in relation to the vehicles used within the programs. LDMPs appear to have an important role in facilitating young learner drivers to acquire the appropriate number of supervised hours of driving practice. However, while a number of factors appear related to a successful program, the program must remain flexible and suitable for its local community. There is a clear need to complete evaluations of existing programs to ensure that future LDMPs and modifications to existing programs are evidence-based.

Evaluation of safety treatments at roadwork zones

A major 3-year research project to improve safety at roadworks has recently been completed by the Centre for Accident Research and Road Safety – Queensland (CARRS-Q) and industry partners. This project involved developing strategies to mitigate roadwork hazards including speeding. This paper presents three on-road evaluation studies on the effectiveness of some current and new safety treatments: use of pilot vehicles, variable message signage (VMS), police enforcement with and without VMS, and remote-controlled traffic control devices. The speed reduction potential of pilot vehicles was evaluated at a highway site. Results showed that pilot vehicles reduced average speeds within the work area, but not at a downstream location. Combinations of VMS and police enforcement were evaluated at a motorway site and results showed that police enforcement accompanied with VMS had greater effects on reducing speeds than either of these treatments alone. Three new remote-controlled traffic control devices—red and amber lights, red light and amber arrow, and a robotic stop/slow sign—were evaluated at a highway site. Results showed that the red light and amber arrow option produced consistent effects on the speeds at the approach to traffic controls and at a location inside the work area. This paper presents the first rigorous evaluations of these roadwork safety treatments in Queensland.

Digital innovation in social marketing: A systematic literature of interventions using digital channels for engagement

Social marketing uses commercial marketing techniques to deliver interventions for social benefit in order to improve quality of life for individuals and communities. Behaviour change is the primary objective of social marketing interventions (Andreasen 2002). The aim of this systematic review is to provide insight into social marketing interventions and their evaluations published in peer-reviewed journals so as to identify the key elements of social marketing employed by these interventions. as well as understand the use of digital channels for engagement.

Pedagogical tools designed to promote engagement and active learning in the biomedical sciences and allied health disciplines

Perceiving students, science students especially, as mere consumers of facts and information belies the importance of a need to engage them with the principles underlying those facts and is counter-intuitive to the facilitation of knowledge and understanding. Traditional didactic lecture approaches need a re-think if student classroom engagement and active learning are to be valued over fact memorisation and fact recall. In our undergraduate biomedical science programs across Years 1, 2 and 3 in the Faculty of Health at QUT, we have developed an authentic learning model with an embedded suite of pedagogical strategies that foster classroom engagement and allow for active learning in the sub-discipline area of medical bacteriology. The suite of pedagogical tools we have developed have been designed to enable their translation, with appropriate fine-tuning, to most biomedical and allied health discipline teaching and learning contexts. Indeed, aspects of the pedagogy have been successfully translated to the nursing microbiology study stream at QUT. The aims underpinning the pedagogy are for our students to: (1) Connect scientific theory with scientific practice in a more direct and authentic way, (2) Construct factual knowledge and facilitate a deeper understanding, and (3) Develop and refine their higher order flexible thinking and problem solving skills, both semi-independently and independently. The mindset and role of the teaching staff is critical to this approach since for the strategy to be successful tertiary teachers need to abandon traditional instructional modalities based on one-way information delivery. Face-to-face classroom interactions between students and lecturer enable realisation of pedagogical aims (1), (2) and (3). The strategy we have adopted encourages teachers to view themselves more as expert guides in what is very much a student-focused process of scientific exploration and learning. Specific pedagogical strategies embedded in the authentic learning model we have developed include: (i) interactive lecture-tutorial hybrids or lectorials featuring teacher role-plays as well as class-level question-and-answer sessions, (ii) inclusion of “dry” laboratory activities during lectorials to prepare students for the wet laboratory to follow, (iii) real-world problem-solving exercises conducted during both lectorials and wet laboratory sessions, and (iv) designing class activities and formative assessments that probe a student’s higher order flexible thinking skills. Flexible thinking in this context encompasses analytical, critical, deductive, scientific and professional thinking modes. The strategic approach outlined above is designed to provide multiple opportunities for students to apply principles flexibly according to a given situation or context, to adapt methods of inquiry strategically, to go beyond mechanical application of formulaic approaches, and to as much as possible self-appraise their own thinking and problem solving. The pedagogical tools have been developed within both workplace (real world) and theoretical frameworks. The philosophical core of the pedagogy is a coherent pathway of teaching and learning which we, and many of our students, believe is more conducive to student engagement and active learning in the classroom. Qualitative and quantitative data derived from online and hardcopy evaluations, solicited and unsolicited student and graduate feedback, anecdotal evidence as well as peer review indicate that: (i) our students are engaging with the pedagogy, (ii) a constructivist, authentic-learning approach promotes active learning, and (iii) students are better prepared for workplace transition.

The impact of private and shared open space on liveability in subtropical apartment buildings

The study explores the relationship between open space design, factors impacting open space provision, and resident satisfaction with open space in multistorey apartment buildings in the context of the subtropical lifestyle and climate of Brisbane Australia. The purpose of the paper is to identify the specific physical and spatial design characteristics residents perceive to be important in open spaces associated with their private dwellings and with shared open spaces. Firsthand resident evaluations of everyday experiences of residing in inner urban high density environments are explored through a survey of 636 residents and interviews with 24 residents. Private balconies are highly valued, but residents’ satisfaction would be enhanced by spaciousness for diverse activities, privacy and climate responsive design. Communal spaces and facilities are used infrequently by many residents who prefer interactions with community outside of the building. This is related to preferences for a level of anonymity in a setting where privacy is difficult to achieve due to physical proximity of neighbours.

Analysis of an inter-centre, web-based radiation oncology peer-review case conference

Purpose Peer-review programmes in radiation oncology are used to facilitate the process and evaluation of clinical decision-making. However, web-based peer-review methods are still uncommon. This study analysed an inter-centre, web-based peer-review case conference as a method of facilitating the decision-making process in radiation oncology. Methodology A benchmark form was designed based on the American Society for Radiation Oncology targets for radiation oncology peer review. This was used for evaluating the contents of the peer-review case presentations on 40 cases, selected from three participating radiation oncology centres. A scoring system was used for comparison of data, and a survey was conducted to analyse the experiences of radiation oncology professionals who attended the web-based peer-review meetings in order to identify priorities for improvement. Results The mean scores for the evaluations were 82·7, 84·5, 86·3 and 87·3% for cervical, prostate, breast and head and neck presentations, respectively. The survey showed that radiation oncology professionals were confident about the role of web-based peer-reviews in facilitating sharing of good practice, stimulating professionalism and promoting professional growth. The participants were satisfied with the quality of the audio and visual aspects of the web-based meeting. Conclusion The results of this study suggest that simple inter-centre web-based peer-review case conferences are a feasible technique for peer review in radiation oncology. Limitations such as data security and confidentiality can be overcome by the use of appropriate structure and technology. To drive the issues of quality and safety a step further, small radiotherapy departments may need to consider web-based peer-review case conference as part of their routine quality assurance practices.

The need for cost-effectiveness analyses of antimicrobial stewardship programmes: A structured review

The cost effectiveness of antimicrobial stewardship (AMS) programmes was reviewed in hospital settings of Organisation for Economic Co-operation and Development (OECD) countries, and limited to adult patient populations. In each of the 36 studies, the type of AMS strategy and the clinical and cost outcomes were evaluated. The main AMS strategy implemented was prospective audit with intervention and feedback (PAIF), followed by the use of rapid technology, including rapid polymerase chain reaction (PCR)-based methods and matrix-assisted laser desorption/ionisation time-of-flight (MALDI-TOF) technology, for the treatment of bloodstream infections. All but one of the 36 studies reported that AMS resulted in a reduction in pharmacy expenditure. Among 27 studies measuring changes to health outcomes, either no change was reported post-AMS, or the additional benefits achieved from these outcomes were not quantified. Only two studies performed a full economic evaluation: one on a PAIF-based AMS intervention; and the other on use of rapid technology for the selection of appropriate treatment for serious Staphylococcus aureus infections. Both studies found the interventions to be cost effective. AMS programmes achieved a reduction in pharmacy expenditure, but there was a lack of consistency in the reported cost outcomes making it difficult to compare between interventions. A failure to capture complete costs in terms of resource use makes it difficult to determine the true cost of these interventions. There is an urgent need for full economic evaluations that compare relative changes both in clinical and cost outcomes to enable identification of the most cost-effective AMS strategies in hospitals.

Individual difference predictors of change in career adaptability over time

Career adaptability is a psychosocial construct that reflects individuals' resources for managing career tasks and challenges. This study investigated the effects of demographic characteristics and three sets of individual difference variables (Big Five personality traits, core self-evaluations, and temporal focus) on changes over time in career adaptability and its dimensions (concern, control, curiosity, and confidence). Data came from 659 full-time employees in Australia who participated in two measurement waves six months apart. Results showed that age and future temporal focus predicted change in overall career adaptability. In addition, age, education, extraversion, neuroticism, openness to experience, core self-evaluations, and future temporal focus differentially predicted change over time in one or more of the four career adaptability dimensions. While the lagged effects found in this study were generally small, the findings suggest that certain individual difference characteristics predispose employees to experience change in career adaptability over time.

Within-person relationships between daily individual and job characteristics and daily manifestations of career adaptability

Previous research showed that daily manifestations of career adaptability fluctuate within individuals over short periods of time, and predict important daily job and career outcomes. Using a quantitative daily diary study design (N = 156 employees; 591 daily entries), the author investigated daily job characteristics (i.e., daily job demands, daily job autonomy, and daily supervisory career mentoring) and daily individual characteristics (i.e., daily Big Five personality characteristics, daily core self-evaluations, and daily temporal focus) as within-person predictors of daily career adaptability and its four dimensions (concern, control, curiosity, and confidence). Results showed that daily job demands, daily job autonomy, daily conscientiousness, daily openness to experience, as well as daily past and future temporal focus positively predicted daily career adaptability. Differential results emerged for the four career adaptability dimensions. Implications for future research on within-person variability in career adaptability are discussed.

The clinical effectiveness and cost-effectiveness of exercise referral schemes: A systematic review and economic evaluation

- Background Exercise referral schemes (ERS) aim to identify inactive adults in the primary-care setting. The GP or health-care professional then refers the patient to a third-party service, with this service taking responsibility for prescribing and monitoring an exercise programme tailored to the needs of the individual. - Objective To assess the clinical effectiveness and cost-effectiveness of ERS for people with a diagnosed medical condition known to benefit from physical activity (PA). The scope of this report was broadened to consider individuals without a diagnosed condition who are sedentary. - Data sources MEDLINE; EMBASE; PsycINFO; The Cochrane Library, ISI Web of Science; SPORTDiscus and ongoing trial registries were searched (from 1990 to October 2009) and included study references were checked. - Methods Systematic reviews: the effectiveness of ERS, predictors of ERS uptake and adherence, and the cost-effectiveness of ERS; and the development of a decision-analytic economic model to assess cost-effectiveness of ERS. - Results Seven randomised controlled trials (UK, n = 5; non-UK, n = 2) met the effectiveness inclusion criteria, five comparing ERS with usual care, two compared ERS with an alternative PA intervention, and one to an ERS plus a self-determination theory (SDT) intervention. In intention-to-treat analysis, compared with usual care, there was weak evidence of an increase in the number of ERS participants who achieved a self-reported 90-150 minutes of at least moderate-intensity PA per week at 6-12 months' follow-up [pooled relative risk (RR) 1.11, 95% confidence interval 0.99 to 1.25]. There was no consistent evidence of a difference between ERS and usual care in the duration of moderate/vigorous intensity and total PA or other outcomes, for example physical fitness, serum lipids, health-related quality of life (HRQoL). There was no between-group difference in outcomes between ERS and alternative PA interventions or ERS plus a SDT intervention. None of the included trials separately reported outcomes in individuals with medical diagnoses. Fourteen observational studies and five randomised controlled trials provided a numerical assessment of ERS uptake and adherence (UK, n = 16; non-UK, n = 3). Women and older people were more likely to take up ERS but women, when compared with men, were less likely to adhere. The four previous economic evaluations identified suggest ERS to be a cost-effective intervention. Indicative incremental cost per quality-adjusted life-year (QALY) estimates for ERS for various scenarios were based on a de novo model-based economic evaluation. Compared with usual care, the mean incremental cost for ERS was £169 and the mean incremental QALY was 0.008, with the base-case incremental cost-effectiveness ratio at £20,876 per QALY in sedentary people without a medical condition and a cost per QALY of £14,618 in sedentary obese individuals, £12,834 in sedentary hypertensive patients, and £8414 for sedentary individuals with depression. Estimates of cost-effectiveness were highly sensitive to plausible variations in the RR for change in PA and cost of ERS. - Limitations We found very limited evidence of the effectiveness of ERS. The estimates of the cost-effectiveness of ERS are based on a simple analytical framework. The economic evaluation reports small differences in costs and effects, and findings highlight the wide range of uncertainty associated with the estimates of effectiveness and the impact of effectiveness on HRQoL. No data were identified as part of the effectiveness review to allow for adjustment of the effect of ERS in different populations. - Conclusions There remains considerable uncertainty as to the effectiveness of ERS for increasing activity, fitness or health indicators or whether they are an efficient use of resources in sedentary people without a medical diagnosis. We failed to identify any trial-based evidence of the effectiveness of ERS in those with a medical diagnosis. Future work should include randomised controlled trials assessing the cinical effectiveness and cost-effectivenesss of ERS in disease groups that may benefit from PA. - Funding The National Institute for Health Research Health Technology Assessment programme.

Shaping urban consolidation debates: Social representations in Brisbane newspaper media

Recent international trends towards urban consolidation, intended to reduce outward urban sprawl by concentrating growth within existing neighbourhoods, can cause contention in cities. Understanding how the mass media represents urban consolidation can lead to more informed and democratic planning practices. This paper employs Social Representations Theory to identify and understand representations of urban consolidation in newspaper media. The theory recognises that the media is a key purveyor of public discourse and can reflect, shape or suppress ideas circulating in society. This novel approach has not previously been applied to understanding social representations of urban consolidation strategies in the mass media. The rapidly growing and changing city of Brisbane, Australia, is utilised as a case study. Brisbane is situated in South East Queensland, the fastest growing region in Australia, and is governed by regional and local planning policies that strongly support increased densities in existing urban areas. Findings from a quantitative textual analysis of 449 articles published in Brisbane newspapers between 2007 and 2014 reveal key clusters and classes of co-occurring words that represent dominant social representations apparent in the newspaper corpus. The paper provides two key conclusions. The first is that social representations occurring in mass media represent an important source of information about ‘common sense’ understandings and evaluations of urban consolidation debates. The second is that urban consolidation is represented as a ultifaceted issue, including interrelated themes of housing,sustainable population growth, investment strategies and the interplay between politics and planning

Hyperferritinemia -cataract syndrome: Long-term ophthalmic observations in an Italian family

Background Hyperferritinemia-cataract syndrome (HCS) is a rare Mendelian condition characterized by bilateral cataract and high levels of serum ferritin in the absence of iron overload. Methods HCS was diagnosed in three adult siblings. In two of them it was possible to assess lens changes initially in 1995 and again in 2013. Serum ferritin, iron, transferrin concentrations and transferrin saturation percentage were also measured, and the Iron Responsive Element (IRE) region of the L-ferritin gene (FTL) was studied. Results Serum ferritin concentrations were considerably elevated while serum iron, transferrin and transferrin saturation levels were within the normal range in each sibling. Cataract changes in our patients were consistent with those previously reported in the literature. Progression of the cataract, an aspect of few studies in this syndrome, appeared to be quite limited in extent. The heterozygous +32G to T (-168G>T) substitution in the IRE of the FTL gene was detected in this family. Conclusions Ophthalmic and biochemical studies together with genetic testing confirmed HCS in three family members. Although the disorder has been extensively described in recent years, little is known regarding cataract evolution over time. In our cases, lens evaluations encompassed many years, identified bilateral cataract of typical morphology and supported the hypothesis that this unique clinical feature of the disease tends to be slowly progressive in nature, at least in adults.