Measuring impact: Positioning evaluation in the Australian arts and culture landscape

Arts culture organisations and funding authorities increasingly need to evaluate the impact of festivals, events and performances. Economic impacts are often privileged over 'soft data' about community experience and engagement. This new book offers a timely and scholarly demonstration of how cultural value and impact can be evaluated. It offers an innovative approach whereby the relationship developed between the researchers/evaluator and the commissioning arts and cultural producer provides an opportunity to rethink the traditional process of reporting back on value and impact through the singular entity of funds acquittal. Using three commissioned evaluations undertaken at an Australian university as an extended case study, the book investigates the two positions most often adopted by researchers/evaluators - embedded and collaborative, or external and distanced - and argues the merits and deficiencies of the two approaches. Offering an examination of how arts evaluation 'works' in theory and practice and more importantly, why it is needed now and in the future to demonstrate the reach and cultural gains from arts and cultural projects, this will be essential reading for students in arts management, professionals working in arts and cultural organisations, scholars working in association with creative industries and cultural development.

The first-year experience in law school: A new beginning?

The first-year experience at university is a "purgatorial zone". There is the shock of the new: navigating a new campus, choosing and enrolling in courses, locating classrooms, finding new friends and establishing new social networks, buying armloads of textbooks, making sense of subject outlines, balancing work and study, completing multiple assignments on time. But there are also the growing pains associated with intellectual development. Not only must first-year students take responsibility for their own learning; they must also accept that there are no "right" or "wrong" answers or "good" or "bad" positions, but judgements they must make and defend through analysis, reasoning and argument.

The First-Year Law Experience: A New Beginning

The first-year experience at university is a "purgatorial zone”. There is the shock of the new: navigating a new campus, choosing and enrolling in courses, locating classrooms, finding new friends and establishing new social networks, buying arm loads of textbooks, making sense of subject outlines, balancing work and study, completing multiple assignments on time. But there are also the growing pains associated with intellectual development. Not only must first-year students take responsibility for their own learning; they must also accept that there are no "right" or "wrong" answers or "good" or "bad" positions, but judgements they must make and defend through analysis, reasoning and argument: ... the student [must] shift from passivity to activity; [university] is no longer an environment in which professors have the sole responsibility to teach but, rather; one in which the student has an equal responsibility to learn. They [need] . .. to becom[e] critical thinkers who are, in the words of Richard Paul and Linda Elder, "self-directed, self-disciplined, self-monitored, and self-corrective".

Transdisciplinary synthesis for ecosystem science, policy and management: The Australian experience

Mitigating the environmental effects of global population growth, climatic change and increasing socio-ecological complexity is a daunting challenge. To tackle this requires synthesis: the integration of disparate information to generate novel insights from heterogeneous, complex situations where there are diverse perspectives. Since 1995, a structured approach to inter-, multi- and trans-disciplinary1 collaboration around big science questions has been supported through synthesis centres around the world. These centres are finding an expanding role due to ever-accumulating data and the need for more and better opportunities to develop transdisciplinary and holistic approaches to solve real-world problems. The Australian Centre for Ecological Analysis and Synthesis (ACEAS ) has been the pioneering ecosystem science synthesis centre in the Southern Hemisphere. Such centres provide analysis and synthesis opportunities for time-pressed scientists, policy-makers and managers. They provide the scientific and organisational environs for virtual and face-to-face engagement, impetus for integration, data and methodological support, and innovative ways to deliver synthesis products. We detail the contribution, role and value of synthesis using ACEAS to exemplify the capacity for synthesis centres to facilitate trans-organisational, transdisciplinary synthesis. We compare ACEAS to other international synthesis centres, and describe how it facilitated project teams and its objective of linking natural resource science to policy to management. Scientists and managers were brought together to actively collaborate in multi-institutional, cross-sectoral and transdisciplinary research on contemporary ecological problems. The teams analysed, integrated and synthesised existing data to co-develop solution-oriented publications and management recommendations that might otherwise not have been produced. We identify key outcomes of some ACEAS working groups which used synthesis to tackle important ecosystem challenges. We also examine the barriers and enablers to synthesis, so that risks can be minimised and successful outcomes maximised. We argue that synthesis centres have a crucial role in developing, communicating and using synthetic transdisciplinary research.

Cost-effectiveness of bone-anchored prosthesis: the Queensland experience

Individuals with limb amputation fitted with conventional socket-suspended prostheses often experience socket-related discomfort leading to a significant decrease in quality of life. Bone-anchored prostheses are increasingly acknowledged as viable alternative method of attachment of artificial limb. In this case, the prosthesis is attached directly to the residual skeleton through a percutaneous fixation. To date, a few osseointegration fixations are commercially available. Several devices are at different stages of development particularly in Europe and the US. [1-15] Clearly, surgical procedures are currently blooming worldwide. Indeed, Australia and Queensland, in particular, have one of the fastest growing populations. Previous studies involving either screw-type implants or press-fit fixations for bone-anchorage have focused on biomechanics aspects as well as the clinical benefits and safety of the procedure. In principle, bone-anchored prostheses should eliminate lifetime expenses associated with sockets and, consequently, potentially alleviate the financial burden of amputation for governmental organizations. Unfortunately, publications focusing on cost-effectiveness are sparse. In fact, only one study published by Haggstrom et al (2012), reported that “despite significantly fewer visits for prosthetic service the annual mean costs for osseointegrated prostheses were comparable with socket-suspended prostheses”. Consequently, governmental organizations such as Queensland Artificial Limb Services (QALS) are facing a number of challenges while adjusting financial assistance schemes that should be fair and equitable to their clients fitted with bone-anchored prostheses. Clearly, more scientific evidence extracted from governmental databases is needed to further consolidate the analyses of financial burden associated with both methods of attachment (i.e., conventional sockets prostheses, bone-anchored prostheses). The purpose of the presentation will be to share the current outcomes of a cost-analysis study lead by QALS. The specific objectives will be: • To outline methodological avenues to assess the cost-effectiveness of bone-anchored prostheses compared to conventional sockets prostheses, • To highlight the potential obstacles and limitations in cost-effectiveness analyses of bone-anchored prostheses, • To present cohort results of a cost-effectiveness (QALY vs cost) including the determination of fair Incremental cost-effectiveness Ratios (ICER) as well as cost-benefit analysis focusing on the comparing costs and key outcome indicators (e.g., QTFA, TUG, 6MWT, activities of daily living) over QALS funding cycles for both methods of attachment.

Mathematical modeling for improved greenhouse gas balances, agro-ecosystems, and policy development: Lessons from the Australian experience

If the land sector is to make significant contributions to mitigating anthropogenic greenhouse gas (GHG) emissions in coming decades, it must do so while concurrently expanding production of food and fiber. In our view, mathematical modeling will be required to provide scientific guidance to meet this challenge. In order to be useful in GHG mitigation policy measures, models must simultaneously meet scientific, software engineering, and human capacity requirements. They can be used to understand GHG fluxes, to evaluate proposed GHG mitigation actions, and to predict and monitor the effects of specific actions; the latter applications require a change in mindset that has parallels with the shift from research modeling to decision support. We compare and contrast 6 agro-ecosystem models (FullCAM, DayCent, DNDC, APSIM, WNMM, and AgMod), chosen because they are used in Australian agriculture and forestry. Underlying structural similarities in the representations of carbon flows though plants and soils in these models are complemented by a diverse range of emphases and approaches to the subprocesses within the agro-ecosystem. None of these agro-ecosystem models handles all land sector GHG fluxes, and considerable model-based uncertainty exists for soil C fluxes and enteric methane emissions. The models also show diverse approaches to the initialisation of model simulations, software implementation, distribution, licensing, and software quality assurance; each of these will differentially affect their usefulness for policy-driven GHG mitigation prediction and monitoring. Specific requirements imposed on the use of models by Australian mitigation policy settings are discussed, and areas for further scientific development of agro-ecosystem models for use in GHG mitigation policy are proposed.

Programming: Reading, writing and reversing

In this paper, we look at the concept of reversibility, that is, negating opposites, counterbalances, and actions that can be reversed. Piaget identified reversibility as an indicator of the ability to reason at a concrete operational level. We investigate to what degree novice programmers manifest the ability to work with this concept of reversibility by providing them with a small piece of code and then asking them to write code that undoes the effect of that code. On testing entire cohorts of students in their first year of learning to program, we found an overwhelming majority of them could not cope with such a concept. We then conducted think aloud studies of novices where we observed them working on this task and analyzed their contrasting abilities to deal with it. The results of this study demonstrate the need for better understanding our students' reasoning abilities, and a teaching model aimed at that level of reality.

From mountaintop to corporate ladder: What new professionals really really want in a capstone experience!

Capstone subjects are increasingly used in Universities worldwide to complete the undergraduate program experience and to transition graduates into the workplace. As such, capstones fulfil a large role consolidating one experience and traversing the gap to another. Yet, little is known or understood about their design, their implementation or evaluation. In this study we investigate the final-year experience from the student's perspective. We surveyed graduates from five Business Schools in Australia to identify perceptions of their final-year experience. Findings indicate that the transition experience of the student to professional is unique. In their liminal or intermediate state between student and professional they recognise the value of process skills, in particular the development of generic business skills related to application and the importance of opportunities for experiencing the application of theory in practice. The findings add a new understanding to the current literature which has not previously acknowledged the insight of the transitioning professional.

The correlation between reading and mathematics ability at age twelve has a substantial genetic component

Dissecting how genetic and environmental influences impact on learning is helpful for maximizing numeracy and literacy. Here we show, using twin and genome-wide analysis, that there is a substantial genetic component to children’s ability in reading and mathematics, and estimate that around one half of the observed correlation in these traits is due to shared genetic effects (so-called Generalist Genes). Thus, our results highlight the potential role of the learning environment in contributing to differences in a child’s cognitive abilities at age twelve.

Art museums and the global tourist: Experience centers in experiencescapes

Art museums are playing an important role is attracting cultural tourists to global cities and regions. Traditionally, art museums were primarily known for their didactic role. In a post-avant-garde era however museums are more focused on appealing to a broader clientele that want art to be novel and entertaining. Art museums have also come to play a greater role in gentrification projects and cultural precincts. This is because they are ideally suited for tourist-centric environments that offer a variety of immersive sensory experiences, and combine museums (often designed by star-architects), international hotels, restaurants, high-end shopping zones, and other leisure platforms. These "experiencescapes" include Port Maravilha urban waterfront development in Rio de Janiero, the Shanghai Bund, and the Broad project in Los Angeles. The Museum of Old and New Art in Hobart Australia is a boutique player in the global market for experiencescapes. It is smaller than many of its competitors and is situated in a remote part of the world, yet it has made an important contribution to Tasmania’s tourism industry.

Relationships between user experience and intuitiveness of visual and physical interactions

This paper investigates the effects of experience on the intuitiveness of physical and visual interactions performed by airport security screeners. Using portable eye tracking glasses, 40 security screeners were observed in the field as they performed search, examination and interface interactions during airport security x-ray screening. Data from semi structured interviews was used to further explore the nature of visual and physical interactions. Results show there are positive relationships between experience and the intuitiveness of visual and physical interactions performed by security screeners. As experience is gained, security screeners are found to perform search, examination and interface interactions more intuitively. In addition to experience, results suggest that intuitiveness is affected by the nature and modality of activities performed. This inference was made based on the dominant processing styles associated with search and examination activities. The paper concludes by discussing the implications that this research has for the design of visual and physical interfaces. We recommend designing interfaces that build on users’ already established intuitive processes, and that reduce the cognitive load incurred during transitions between visual and physical interactions.

Acute liver failure in children : a regional experience

Objective: To review the outcome of acute liver failure (ALF) and the effect of liver transplantation in children in Australia. Methodology: A retrospective review was conducted of all paediatric patients referred with acute liver failure between 1985 and 2000 to the Queensland Liver Transplant Service, a paediatric liver transplant centre based at the Royal Children's Hospital, Brisbane, that is one of three paediatric transplant centres in Australia. Results: Twenty-six patients were referred with ALF. Four patients did not require transplantation and recovered with medical therapy while two were excluded because of irreversible neurological changes and died. Of the 20 patients considered for transplant, three refused for social and/or religious reasons, with 17 patients listed for transplantation. One patient recovered spontaneously and one died before receiving a transplant. There were 15 transplants of which 40% (6/15) were < 2 years old. Sixty-seven per cent (10/15) survived > 1 month after transplantation. Forty per cent (6/15) survived more than 6 months after transplant. There were only four long term survivors after transplant for ALF (27%). Overall, 27% (6/22) of patients referred with ALF survived. Of the 16 patients that died, 44% (7/16) were from neurological causes. Most of these were from cerebral oedema but two patients transplanted for valproate hepatotoxicity died from neurological disease despite good graft function. Conclusions: Irreversible neurological disease remains a major cause of death in children with ALF. We recommend better patient selection and early referral and transfer to a transplant centre before onset of irreversible neurological disease to optimize outcome of children transplanted for ALF.

The trend toward pre-graduation professional work experience for Australian young planners: Essential experience or essentially exploitation

This paper explores the changing employment expectations that frame the early professional work experiences of young planners in Australia. In particular, it considers the rising popularity of pre-graduation professional work experience as a precursor to formal entry into the workforce as a practising planner. This shift is being driven in part by employer expectations that graduates will already have ‘real world’ and relevant work experience. However, an equally significant driver appears to be a growing desire for early career and graduate planners to find ways to distinguish themselves from their peers in an increasingly tight labour market. Using data from an ongoing research project into the formative work experiences of young people this paper describes the three main types of pre-graduation professional work experience undertaken by young planners. It highlights the potential challenges and benefits of pre-graduation work experience from a legal, social and ethical perspective as well as from the perspective of young planners themselves. The paper concludes by reflecting on the role of the planning profession – employers, peak bodies and planning educators – in managing the tensions between producing ‘work ready’ graduates and safeguarding the employment conditions of early career planning professionals.

Architectural experience in the everyday context

Informed by phenomenology and grounded theory this research identifies the general community's contextual sense-making in relation to their everyday experience of buildings producing a comprehensive theoretical framework that acknowledges a person's relationship with a building as dynamic and unfolding, as opposed to static and constant; and as emotive and existential as well as conceptual and perceptual. In this regard, the research makes an original contribution to environmental psychology, architecture and design and through this discipline knowledge to the design of more habitable buildings, and interior and urban environments.

Questionnaire design for airport passenger experience survey

Assessing airport service performance requires understanding of a complete set of passenger experiences covering all activities from departures to arrivals. Weight-based indicator models allow passengers to express their priority on certain evaluation criteria (airport domains) and their service attributes over the others. The application of multilevel regression analysis in questionnaire design is expected to overcome limitations of traditional questionnaires, which require application of all indicators with equal weight. The development of a Taxonomy of Passenger Activities (TOPA), which captures all passenger processing and discretionary activities, has provided a novel perspective in understanding passenger experience in various airport domains. Based on further literature reviews on various service attributes at airport passenger terminals, this paper constitutes questionnaire design to employ a weighting method for all activities from the time passengers enter an airport domain at the departure terminal until leaving the arrival terminal (i.e. seven airport domains for departure, four airport domains during transit, and seven airport domains for arrival). The procedure of multilevel regression analysis is aimed not only at identifying the ranking of each evaluation criterion from the most important to the least important but also to explain the relationship between service attributes in each airport domain and overall service performance.