The development of the extended adolescent injury checklist (E-AIC) : a measure for injury prevention program evaluation

The Extended Adolescent Injury Checklist (E-AIC), a self-report measure of injury based on the model of the Adolescent Injury Checklist (AIC), was developed for use in the evaluation of school-based interventions. The three stages of this development involved focus groups with adolescents and consultations with medical staff, pilot testing of the revised AIC in a high school context, and use of the finalised checklist in pre- and post-questionnaires to examine its utility. Results revealed that responses to the final version of the E-AIC were meaningful and remained consistent over time. The E-AIC appears to be a promising measure of adolescent injury that is simple, time-efficient and appropriate for use in the evaluation of school-based injury prevention programs.

A Process and Outcome Evaluation of the Under the Limit (UTL) Therapeutic Drink Driving Program for Recidivist and High Range Offenders

Drink driving is a major public health issue and this report examines the experiences of convicted offenders who participated in an established drink driving rehabilitation program Under the Limit (UTL). Course completers were surveyed at least three months after they had finished the 11-week UTL course. The aim of this study was to examine whether the UTL program reduced the level of alcohol consumption either directly as a result of participation in the UTL drink driving program or through increased use of community alcohol program by participants. The research involved a self-report outcome evaluation to determine whether the self-reported levels of alcohol use after the course had changed from the initial alcohol use reported by offenders. The findings are based on the responses of 30 drink-driving offenders who had completed the UTL program (response rate: 20%). While a process evaluation was proposed in the initial application, the low response rate meant that this follow up research was not feasible. The response rate was low for two reasons, it was difficult to: recruit participants who consented to follow up, and subsequently locate and survey those who had consented to involvement.

Barriers and facilitators of a designated driver program

The general aim of designated driver programs is to reduce the level of drink driving by encouraging potential drivers to travel with a driver who has abstained from (or at least limited) consuming alcohol. Designated driver programs are quite widespread around the world, however a limited number have been rigorously evaluated. This paper reports the qualitative results from an evaluation of a designated driver program known as ‘Skipper’, in a provincial city in Queensland. Focus groups were conducted with 108 individuals from the intervention area. These focus groups aimed to assess the barriers and facilitators to the programs’ effectiveness by obtaining information about the patrons’ views on various aspects of the program, as well as designated driver and travelling after drinking more generally. A brief questionnaire was also given to participants in order to present responses in terms of the participants’ characteristics. Results suggest general support for the designated driver concept and the ‘Skipper’ program specifically. Facilitating factors reported by participants included the media coverage highlighting the risks associated with drink driving and the social acceptability of choosing not to drink. However, there was also some suggestion that the impact of the program was mainly to encourage those who already engage in designated driver behaviour to continue doing so, rather than encouraging the uptake of the behaviour among potential new users. Some of the suggested barriers to this kind of behaviour change include: social pressure to drink; alcohol dependency; and a failure to plan ahead.

"Listening, hearing and drawing things together to work on solutions" : NAPCAN Play a Part, Queensland, 2010-2013, Evaluation-Research Report

Responding to the idea of child friendly communities, Play a Part is an innovative program advancing preventative strategies for children and young people to minimise exposure to abuse and neglect. The program was developed ensuing an increase in notifications of suspected child abuse and neglect in 2007. Now completing the second phase, the program is a community engagement strategy that aims to prevent child abuse. Play a Part is described as “a whole of community approach to creating child friendly communities” (NAPCAN, 2012). The Play a Part program was piloted between 2007 and 2010 in five southeast Queensland communities, and is currently operating in parts of Logan City region and the Redlands region. To assess the merit of the second phase of the program the Children and Youth Research Centre at Queensland University of Technology was contracted to undertake an evaluation-research at the beginning of 2013.

The effectiveness of designated driver programs

Designated driver programs aim to reduce alcohol related crashes by encouraging and facilitating a safe means of transport for those who have been drinking and by influencing attitudes and knowledge. This review discusses the use and effectiveness of designated driver programs in preventing drink driving and ultimately reducing alcohol related road trauma. The limitations of studies examining designated driver programs and recommendations for further research are also discussed. The available evidence suggests that while designated driver campaigns can successfully increase the awareness and use of designated drivers, it is less clear whether these programs lead to a reduction in drink driving and/or alcohol related crashes. Differences in the way that designated driver programs have historically been implemented may account for the inconsistent evidence for their effectiveness in reducing drink driving. There are also a variety of methodological problems relating to the evaluation of designated driver programs which need to be addressed by future research.

Reconnect action research kit

This kit, designed for youth and family services and practitioners, provides an outline of action research, suggested strategies and tools for undertaking action research, as well as discussion of various challenges.

The parents at playgroup research report : engaging families in supported playgroups

The past decade has seen increasing numbers of government programs funded to support vulnerable families with young children. Supported playgroups are one important strategy in Australia’s current family policies that are provided in all states and territories (ARTD, 2008). National policies have increasingly invested in family support programs, such as supported playgroups. Despite known challenges in engaging vulnerable families in support programs, little is known about the capacity of supported playgroups to effectively engage families to achieve desired outcomes. This project explores family patterns of attendance in supported playgroups and examines the extent to which parental characteristics and experiences of the playgroup explain variations in engagement. The findings can inform the delivery of other family support programs...

Ageing of people with an intellectual disability: Effective training for frontline workers

While the attainment of late life represents a significant achievement for people with an intellectual disability, increased life expectancy has resulted in growing concerns about the extent to which disability service providers are ready to meet the changing needs of increasing numbers of older people and facilitate their ongoing social inclusion. Training of frontline disability staff is widely accepted as an effective strategy for increasing organisational capacity to contribute to improved quality of life for people with an intellectual disability. The study identifies training needs analyses and 'ready-to-deliver' training programs for frontline disability services staff working with adults with an intellectual disability who are ageing, assesses whether the training programs contribute to improved quality of life outcomes for service users, and makes recommendations for future research and development of training for disability services staff who work with older people with intellectual disability.

Editorial : Action research, action learning and community services

This edition of ALARj has a focus on the contribution of action learning and action research to the development of community services, particularly nonprofits. The landscape of community services has been changing rapidly in recent decades, and can be typified by the notion of complexity. Complexity in the nature of issues that services seek to respond to, complexity in the policy environment and systems of support that have tended to silo and compartmentalise problems and people, and complexity in the institutional location non-profit services occupy in ‘helping’ those who are seen as ‘in need’ or marginalised. In addition to being typified by complexity the environment in which community services are located is dynamic, undergoing profound and ongoing change as neo-liberal approaches to understanding and responding to human need, which emphasise the individualisation of risk, and market principles such as choice, competition and innovation, drive social policy. How can long held values of empowerment, care, inclusivity and benefit to individuals and communities have expression in community services as they grapple with the challenges of being viable and relevant in such a dynamically changing environment? This edition brings together a range of contributions which speak to these challenges. The thematic through these is that processes are needed which engage services and communities in ongoing processes of inquiry about how they can best proceed in contexts typified by complexity and change. Action learning and action research can provide processes of this character.

Socially inclusive learning in a community setting

People with mental health problems, learning difficulties and poor literacy and numeracy are at risk of social exclusion including homelessness. They are often disconnected from the Vocational Education and Training (VET) system, with few opportunities for education and employment. Academic research has demonstrated a link between literacy and numeracy and social inclusion, however, the pathways to enact this are not well understood. This report presents insights into how a community based adult literacy program in West End, Brisbane, was first established and has since evolved into a successful model of what we are calling ‘socially inclusive learning’. The research informing the report was conducted as a twelve-month study from April 2013 to April 2014 funded through a partnership involving Anglicare Southern Queensland, A Place to Belong and the School of Public Health and Social Work, Queensland University of Technology. The research was conducted by Greg Marston and Jeffrey Johnson- Abdelmalik. The aim of the study was to clarify the principles, practice and methodology of the Reading and Writing group (hereafter RAW) and identify the characteristics of RAW that support the social inclusion of the individual being provided literacy learning. The questions guiding the research included: • What are the key principles and practices of the RAW model? • How does the acquisition of literacy and numeracy skills contribute to the recovery of people with mental health and other issues? • How can the acquisition of literacy and numeracy skills support people’s social inclusion, including achieving employment and further education outcomes? A related aim of the project was to document how this community based literacy and numeracy program operates so that other organisations with an interest in addressing similar needs can learn from the model, particularly organisations that co-locate support and education and organisations that adopt a recovery approach when working with people with mental health challenges and intellectual and psychiatric disabilities. The report highlights the background to RAW, the learning philosophy of RAW, the profile of the participants in the program and the various roles and responsibilities and structure that supports the work of RAW. The report presents perspectives from the teachers, student participants and tutors on how the group is designed and the principles implemented.

Victoria's Child FIRST and IFS differential response system : progress and issues

Differential response has long been utilized by statutory child protection systems in Australia. This article describes the advent and history of Victoria's differential response system, with a particular focus on the Child FIRST and IFS programme. This program entails a partnership arrangement between the Department of Human Services child protection services and community-based, not-for-profit agencies to provide a diverse range of early intervention and prevention services. The findings of a recent external service system evaluation, a judicial inquiry, and the large-scale Child and Family Services Outcomes Survey of parents/carers perspectives of their service experiences are used to critically examine the effectiveness of this differential response approach. Service-user perspectives of the health and wellbeing of children and families are identified, as well as the recognized implementation issues posing significant challenges for the goal of an integrated partnership system. The need for ongoing reform agendas is highlighted along with the policy, program and structural tensions that exist in differential response systems, which are reliant upon partnerships and shared responsibilities for protecting children and assisting vulnerable families. Suggestions are made for utilizing robust research and evaluation that gives voice to service users and promotes their rights and interests.

The Mirror Room Project: A Critical Ethnographic Program Evaluation of a Teaching Personal and Social Responsibility Based Youth Development Program

Amongst a host of other benefits, proper physical education has the possibility to create a safe place where responsibility can be transferred from the teacher/facilitator, to the student. This is especially true with an underserved population. This critical program evaluation of the program CHARM was done for the purpose of program improvement. This research was a place for participants to share their experiences of the program. The participants were 5 underserved youth, 5 undergraduate students, 3 teachers and 1 graduate student. Observations, interviews, and document analysis were used to gather data. Data was analyzed using a first level read-through, and two second-level analyses. Summaries were written, and cross-case analyses were completed. The main finding of the research was the development of a Handbook, which is a guide to running the program. Secondary findings include issues of program structure, goal setting, meaningful relationships, roles, SNAP, and an outlier in the data.

Sources of selection bias in evaluating social programs: An interpretation of conventional measures and evidence on the effectiveness of matching as a program evaluation method

This paper decomposes the conventional measure of selection bias in observational studies into three components. The first two components are due to differences in the distributions of characteristics between participant and nonparticipant (comparison) group members: the first arises from differences in the supports, and the second from differences in densities over the region of common support. The third component arises from selection bias precisely defined. Using data from a recent social experiment, we find that the component due to selection bias, precisely defined, is smaller than the first two components. However, selection bias still represents a substantial fraction of the experimental impact estimate. The empirical performance of matching methods of program evaluation is also examined. We find that matching based on the propensity score eliminates some but not all of the measured selection bias, with the remaining bias still a substantial fraction of the estimated impact. We find that the support of the distribution of propensity scores for the comparison group is typically only a small portion of the support for the participant group. For values outside the common support, it is impossible to reliably estimate the effect of program participation using matching methods. If the impact of participation depends on the propensity score, as we find in our data, the failure of the common support condition severely limits matching compared with random assignment as an evaluation estimator.