An evaluation framework for assessing the impact of public bicycle share schemes

INTRODUCTION • Public bicycle share schemes have emerged as a method of increasing rates of bicycle riding. • The overwhelming majority of schemes have begun since 2005, taking advantage of various tracking and payment technologies making short term rental practical and affordable. • Very little research has been undertaken to determine their potentially broad impact on transport behaviour and consequently, it is difficult to understand the performance of these schemes in terms of reduced emissions and congestion, as well as possible increases in physical activity.

When non-significance maybe significant: lessons learned from a study into the development, implementation and evaluation of a risk assessment tool for fleet settings

Introduction This study reports on the development of a self report assessment tool to increase the efficacy of crash prediction within Australian Fleet settings Over last 20 years an array of measures have been produced (Driver anger scale, Driving Skill Inventory, Manchester Driver Behaviour Questionnaire, Driver Attitude Questionnaire, Driver Stress Inventory, Safety Climate Questionnaire) While these tools are useful, research has demonstrated limited ability to accurately identify individuals most likely to be involved in a crash. Reasons cited include; - Crashes are relatively rare - Other competing factors may influence crash event - Ongoing questions regarding the validity of self report measures (common method variance etc) - Lack of contemporary issues relating to fleet driving performance

Evaluation of the 2010 child restraint legislation in Queensland

Occupant injury comprises the largest proportion of child road crash trauma in most highly motorised countries. In Australia, road crashes are the primary cause of death for children aged 1-14 years and are among the top three causes of serious injury to this age group. For this reason considerable research attention has been focused on understanding the contributing factors and the most effective ways of improving children’s safety as car passengers. Australia has been particularly active in this area, with well regarded work being conducted on levels of use of dedicated child restraints, restraint crash performance in laboratory conditions, examination of real world restraint crash performance (case review), and studies of psychosocial factors influencing perceptions about restraints and their use (Brown & Bilston, 2006; Brown, McCaskill, Henderson & Bilston, 2006; Edwards, Anderson & Hutchinson, 2006; Lennon, 2005, 2007). New legislation for the restraint of children as vehicle passengers was enacted in Queensland in March 2010. This new legislation recognises the importance of dedicated restraint use for children up to at least age 7 years and the protective benefits of rear seating position in the event of a crash. As part of improving children’s safety and addressing key priority areas, the Queensland Injury Prevention Council (QIPC) and Department of Transport and Main Roads (TMR) commissioned the Centre for Accident Research and Road Safety, Queensland (CARRS-Q) to evaluate the impact of the new legislation. Although at the time of commencing the research the legislation had only been in force for 14 months, it was deemed critical to review its effectiveness in guiding parental choices and compliance in order to inform the design and focus of further supporting initiatives and interventions. Specifically, the research sought clear evidence of exactly what impact, if any, the legislation has had on compliance levels and what difficulties (if any) parents/carers experience in relation to interpreting as well as complying with the requirements of the new law. Knowledge about these barriers or difficulties will allow any future changes or improvements to the legislation to address such barriers and thus improve its effectiveness. Moreover, better information about how the legislation has affected parents will provide a basis to plan non-legislative comprehensive multi-strategy interventions such as community, educational or behavioural interventions with parents/carers and other stakeholder groups. In addition, it will allow identification of the most effective aspects of the legislation and those areas in need of extra attention to improve effectiveness/compliance and thus better protect children travelling in cars and improve their health and safety. This report presents the findings from the four components of the research: the literature review; observational study; intercept interviews and focus group with parents; and the interviews with key stakeholders.

Performance evaluation of eight contemporary passive solar homes in subtropical Australia

Subtropical south-east Queensland’s expanding population is expected to lead to a demand for an additional 754,000 dwellings by 2031. A legacy of poor housing design, minimal building regulations, an absence of building performance evaluation and various social and market factors has lead to a high and growing penetration of, and reliance on, air conditioners to provide comfort in this relatively benign climate. This reliance impacts on policy goals to adapt to and mitigate against global warming, electricity infrastructure investment and household resilience. Based on the concept of bioclimatic design, this field study scrutinizes eight non-air conditioned homes to develop a deeper understanding of the role of contemporary passive solar architecture in the delivery of thermally comfortable and resilient homes in the subtropics. These homes were found to provide inhabitants with an acceptable level of thermal comfort (18-28oC) for 77 – 97% of the year. Family expectations and experiences of comfort, and the various design strategies utilized were compared against the measured performance outcomes. This comparison revealed issues that limited quantification and implementation of design intent and highlighted factors that constrained system optimisation.

Evaluation of an Australian solar community : implications for education and training

1.1 Background What is renewable energy education and training? A cursory exploration of the International Solar Energy Society website (www.ises.org) reveals numerous references to education and training, referring collectively to concepts of the transfer and exchange of information and good practices, awareness raising and skills development. The purposes of such education and training relate to changing policy, stimulating industry, improving quality control and promoting the wider use of renewable energy sources. The primary objective appears to be to accelerate a transition to a better world for everyone (ISEE), as the greater use of renewable energy is seen as key to climate recovery; world poverty alleviation; advances in energy security, access and equality; improved human and environmental health; and a stabilized society. The Solar Cities project – Habitats of Tomorrow – aims at promoting the greater use of renewable energy within the context of long term planning for sustainable urban development. The focus is on cities or communities as complete systems; each one a unique laboratory allowing for the study of urban sustainability within the context of a low carbon lifestyle. The purpose of this paper is to report on an evaluation of a Solar Community in Australia, focusing specifically on the implications (i) for our understandings and practices in renewable energy education and training and (ii) for sustainability outcomes. 1.2 Methodology The physical context is a residential Ecovillage (a Solar Community) in sub-tropical Queensland, Australia (latitude 28o south). An extensive Architectural and Landscape Code (A&LC) ‘premised on the interconnectedness of all things’ and embracing ‘both local and global concerns’ governs the design and construction of housing in the estate: all houses are constructed off-ground (i.e. on stumps or stilts) and incorporate a hybrid approach to the building envelope (mixed use of thermal mass and light-weight materials). Passive solar design, gas boosted solar water heaters and a minimum 1kWp photovoltaic system (grid connected) are all mandatory, whilst high energy use appliances such as air conditioners and clothes driers are not permitted. Eight families participated in an extended case study that encompassed both quantitative and qualitative approaches to better understand sustainable housing (perceived as a single complex technology) through its phases of design, construction and occupation. 1.3 Results The results revealed that the level of sustainability (i.e. the performance outcomes in terms of a low-carbon lifestyle) was impacted on by numerous ‘players’ in the supply chain, such as architects, engineers and subcontractors, the housing market, the developer, product manufacturers / suppliers / installers and regulators. Three key factors were complicit in the level of success: (i) systems thinking; (ii) informed decision making; and (iii) environmental ethics and business practices. 1.4 Discussion The experiences of these families bring into question our understandings and practices with regard to education and training. Whilst increasing and transferring knowledge and skills is essential, the results appear to indicate that there is a strong need for expanding our education efforts to incorporate foundational skills in complex systems and decision making processes, combined with an understanding of how our individual and collective values and beliefs impact on these systems and processes.

Victoria's “Day in Prison Program” : an evaluation and critique

The use of “Day in Prison” programs to deter young adult offenders is a concept which originated in the United States and was replicated in Australia during the late 1970s. After almost a decade of uncertainty this model of ‘crime prevention’ re-emerged in Victoria with the introduction of a pilot “Day in Prison” program. This article traces the development and operation of the Victorian experience and provides evaluation research findings which conclude that coercive, intimidatory and degrading aversion techniques should not be utilised by the criminal justice system for the purposes of individual deterrence.

Evaluation of the Airdrie Sheriff Youth Court Pilot

A pilot Youth Court was introduced at Airdrie Sheriff Court in June 2004. Its objectives were to: • reduce the frequency and seriousness of re-offending by 16 and 17 year old offenders, particularly persistent offenders (and some 15 year olds who are referred to the court); • promote the social inclusion, citizenship and personal responsibility of these young offenders while maximising their potential; • establish fast track procedures for those young persons appearing before the Youth Court; • enhance community safety, by reducing the harm caused to individual victims of crime and providing respite to those communities which are experiencing high levels of crime; and • test the viability and usefulness of a Youth Court using existing legislation and to demonstrate whether legislative and practical improvements might be appropriate. An evaluation of the pilot commissioned by the Scottish Executive found that it appeared in many respects to be working well. It was a tightly run court that dealt with a heavy volume of business. With its fast track procedures and additional resources it was regarded as a model to be aspired to in all summary court business. Whether a dedicated Youth Court was required or whether procedural improvements would have been possible in the absence of dedicated resources and personnel was, however, more difficult to assess. Two issues in particular required further attention. First, consideration needed to be given to whether the Youth Court should be more explicitly youth focused and what this might entail. Second, greater clarity was required regarding for whom the Youth Court was intended to avoid the risk of net-widening and its consequences for young people.

Evaluation of the Hamilton Youth Court Pilot 2003-2005

Pilot Youth Courts were introduced at Hamilton Sheriff Court in June 2003 and at Airdrie Sheriff Court in June 2004. Although introduced as one of a number of measures aimed at responding more effectively to youth crime (including young people dealt with through the Children’s Hearings System), the Youth Courts were intended for young people who would otherwise have been dealt with in the adult Sheriff Summary Court. The objectives of the pilot Youth Courts were to: • reduce the frequency and seriousness of re-offending by 16 and 17 year old offenders, particularly persistent offenders (and some 15 year olds who are referred to the court); • promote the social inclusion, citizenship and personal responsibility of these young offenders while maximising their potential; • establish fast track procedures for those young persons appearing before the Youth Court; • enhance community safety, by reducing the harm caused to individual victims of crime and providing respite to those communities which are experiencing high levels of crime; and • test the viability and usefulness of a Youth Court using existing legislation and to demonstrate whether legislative and practical improvements might be appropriate. Evaluation of the Hamilton and Airdrie Sheriff Youth Court pilots suggested that they had been successful in meeting the objectives set for them by the Youth Court Feasibility Group. Both were tightly run courts that dealt with a heavy volume of business. The particular strengths of the Youth Court model over previous arrangements included the fast-tracking of young people to and through the court, the reduction in trials, the availability of a wider range of resources and services for young people and ongoing judicial review. The successful operation of the pilot Youth Courts was dependent upon effective teamwork among the relevant agencies and professionals concerned. Good information sharing, liaison and communication appeared to exist across agencies and the procedures that were in place to facilitate the sharing of information seemed to be working well. This was also facilitated by the presence of dedicated staff within agencies, resulting in clear channels of communication, and in the opportunity provided by the multi-agency Implementation Groups to identify and address operational issues on an ongoing basis. However, whether Youth Courts are required in Scotland or whether procedural improvement were possible in the absence of dedicated resources and personnel was more difficult to assess. Two issues in particular required further attention. First, consideration needed to be given to whether the Youth Courts should be more explicitly youth focused and what this might entail. Second, greater clarity was required regarding for whom the Youth Courts were intended. This suggested the need for further discussion of Youth Court targeting and its potential consequences among the various agencies concerned.

Lean supply chain performance evaluation method

Increasing global competitiveness worldwide has forced manufacturing organizations to produce high-quality products more quickly and at a competitive cost which demand of continuous improvements techniques. In this paper, we propose a fuzzy based performance evaluation method for lean supply chain. To understand the overall performance of cost competitive supply chain, we investigate the alignment of market strategy and position of the supply chain. Competitive strategies can be achieved by using a different weight calculation for different supply chain situations. By identifying optimal performance metrics and applying performance evaluation methods, managers can predict the overall supply chain performance under lean strategy.

The implementation of performance based planning in Queensland under the integrated planning act 1997 : an evaluation of perceptions and planning schemes

Performance based planning is a form of planning regulation that is not well understood and the theoretical advantages of this type of planning are rarely achieved in practice. Normatively, this type of regulation relies on performance standards that are quantifiable and technically based which are designed to manage the effects of development, where performance standards provide certainty in respect of the level of performance and the means of achievement is flexible. Few empirical studies have attempted to examine how performance based planning has been conceptualised and implemented in practice. Existing literature is predominately anecdotal and consultant based (Baker et al. 2006) and has not sought to quantitatively examine how land use has been managed or determine how context influences implementation. The Integrated Planning Act 1997 (IPA) operated as Queensland’s principal planning legislation between March 1998 and December 2009. The IPA prevented Local Governments from prohibiting development or use and the term zone was absent from the legislation. While the IPA did not use the term performance based planning, the system is widely considered to be performance based in practice (e.g. Baker et al. 2006; Steele 2009a, 2009b). However, the degree to which the IPA and the planning system in Queensland is performance based is debated (e.g. Yearbury 1998; England 2004). Four research questions guided the research framework using Queensland as the case study. The questions sought to: determine if there is a common understanding of performance based planning; identify how performance based planning was expressed under the IPA; understand how performance based planning was implemented in plans; and explore the experiences of participants in the planning system. The research developed a performance adoption spectrum. The spectrum describes how performance based planning is implemented, ranging between pure and hybrid interpretations. An ex-post evaluation of seventeen IPA plans sought to determine plan performativity within the conceptual spectrum. Land use was examined from the procedural dimension of performance (Assessment Tables) and the substantive dimension of performance (Codes). A documentary analysis and forty one interviews supplemented the research. The analytical framework considered how context influenced performance based planning, including whether: the location of the local government affected land use management techniques; temporal variation in implementation exists; plan-making guidelines affected implementation; different perceptions of the concept exist; this type of planning applies to a range of spatial scales. Outcomes were viewed as the medium for determining the acceptability of development in Queensland, a significant departure from pure approaches found in the United States. Interviews highlighted the absence of plan-making direction in the IPA, which contributed to the confusion about the intended direction of the planning system and the myth that the IPA would guarantee a performance based system. A hybridised form of performance based planning evolved in Queensland which was dependent on prescriptive land use zones and specification of land use type, with some local governments going to extreme lengths to discourage certain activities in a predetermined manner. Context had varying degrees of influence on plan-making methods. Decision-making was found to be inconsistent and the system created a range of unforeseen consequences including difficulties associated with land valuation, increased development speculation, and the role of planners in court was found to be less critical than in the previous planning system.

Re-engaging marginalized youth through digital music production: performance, audience and evaluation

This paper presents two case studies of marginalised youth experimenting with digital music production in flexible education settings. The cases were drawn from a three-year study of alternative assessment in flexible learning centres that enrol 650+ students who have left formal schooling in Queensland, Australia. The cases are framed in reference to the literature on cultural studies approaches to education and the digital arts. Each case describes the student’s histories, cultural background and experiences, music productions, evidence of learning and re-engagement with education. Findings document how digital music production can re-engage and extend participation among students who have left formal education. They do so by theorising the online judgements and blog comments about the digital music production as a social field of exchange. It also raises critical questions about the adequacy of current approaches to evaluating and accounting for the learning and development of such youth, especially where this has occurred through creative arts and digital production.

Evaluation of the Type I child car restraints fitting service in WA

Child passenger injury remains a major road safety issue despite advances in biomechanical understanding and child restraint design. In Australia, one intervention with parents to encourage universal and consistent use of the most appropriate restraint as well as draw their attention to critical aspects of installation is the RoadWise Type 1 Child Car Restraints Fitting Service, WA. A mixed methods evaluation of this service was conducted in early 2010. Evaluation results suggest that it has been effective in ensuring good quality training of child restraint fitters. In addition, stakeholder and user satisfaction with the Service is high, with participants agreeing that the Service is valuable to the community, and fitters regarding the training course, materials and post-training support as effective. However, a continuing issue for interventions of this type is whether the parents who need them perceive this need. Evidence from the evaluation suggests that only about 25% of parents who could benefit from the Service actually use it. This may be partly due to parental perceptions that such services are not necessary or relevant to them, or to overconfidence about the ease of installing restraints correctly. Thus there is scope for improving awareness of the Service amongst groups most likely to benefit from it (e.g. new parents) and for alerting parents to the importance of correct installation and getting their self-installed restraints checked. Efforts to inform and influence parents should begin when their children are very young, preferably at or prior to birth and/or before the parent installs the first restraint.

Evaluation of the skills for preventing injury in youth program : impact on health risk behaviors, injury and school connectedness

Injury is the leading cause of death among young people, and involvement in health risk behaviors, such as alcohol use and transport-related risks, is related to increased risk for injury. Effective health promotion programs for adolescents focus on multiple levels, including relationships with peers and parents, student knowledge, behavior and attitudes, and school-level factors such as school connectedness. This study describes the pilot evaluation of a comprehensive, multi-level injury prevention program for 13-14 year old adolescents, targeting change in injury associated with transport and alcohol risks. The program, called Skills for Preventing Injury in Youth (SPIY), incorporates two primary elements: an 8-week, teacher delivered attitude and behavior change curriculum with peer protection and first aid messages; and professional development for program teachers focusing on strategies to increase students’ connectedness to school. Five Australian high schools were recruited for the pilot evaluation research, with three being assigned to receive intervention components and two assigned as curriculum-as-usual controls. In the intervention schools, 118 Year 8 students participated in surveys at baseline, with 105 completing surveys at follow up, six months following the intervention. In the control schools, 196 Year 8 students completed surveys at baseline and 207 at follow up. Survey measures included self-reported injury, risk taking behavior and school connectedness. Results showed that students in the control schools were significantly more likely to report riding bikes without helmets, riding with dangerous drivers, having driven cars on the road, and using alcohol six months after the program, while the intervention group showed no such increase in these behaviors. Additionally, students in the control schools were significantly more likely to report having had pedestrian-related injuries at follow up than they were at the baseline measurement, while intervention school students showed no change. There was also a trend observed in terms of a decrease in bicycle related injuries among intervention school students, compared with a slight increasing trend in bicycle injuries among control students. Overall, scores on the school connectedness scale decreased significantly from baseline to follow up for both intervention and control students, however measurement limitations may have impacted on results relating to students’ connectedness. Overall, the SPIY program has shown promising results in regards to prevention of students’ health risk behavior and injuries. Evidence suggests that the curriculum component was important; however there was limited evidence to suggest that teacher training in school connectedness strategies contributed to these promising results. While school connectedness may be an important factor to target in risk and injury prevention programs, programs may need to incorporate whole-of-school strategies or target a broader range of teachers than were selected for the current research.

New evaluation methodologies for public art programs in cultural instiutions

I put my abstract in for this conference back in March, based on some evaluation work I had been doing in 2010 with my colleague Professor Greg Hearn for the 3C Regional Writing NeoGreography Project. I had been swapping notes with a colleague from the Smithsonian’s Centre for Folklife and Cultural Heritage about their evaluation work, and stuck inside during the rains of January, I decided to apply for a Qld Smithsonian fellowship based on the quandary of evaluation-particular in public histories (oral histories) and digital storytelling. In July I was awarded the fellowship, so I have tweaked my presentation to talk about what we hope to do with this collaboration, to propel the importance placed on evaluation in public arts programs in Qld and beyond.