Purposeful program theory: Effective use of theories of change and logic models [Book Review]

The purpose of this book by two Australian authors is to: introduce the audience to the full complement of contextual elements found within program theory; offer practical suggestions to engage with theories of change, theories of action and logic models; and provide substantial evidence for this approach through scholarly literature, practice case studies together with the authors' combined experience of 60 years.

Workshop: ASSIP - Attempted Suicide Short Intervention Program. Theory, Practice, and 24 Months Follow-up RCT.

Background: ASSIP is a manualized brief therapy based on a model of suicide as goal-directed action, aimed at establishing a therapeutic alliance in a patient-oriented, collaborative approach. The main goals of the three-session program ASSIP are for patients to understand, from an observer’s position, patterns leading to a suicidal crisis, recognize triggers and warning signs, and to establish individual safety strategies for future suicidal crises. An ongoing therapeutic support is provided with regular letters over 24 months. Method: The study was conducted in a naturalistic setting. 120 Patients were randomly assigned to an intervention group (60 participants) treated with ASSIP combined with follow-up contact through letters, and a control group (60 participants) receiving a single session of clinical assessment. Both groups had treatment as usual. Patients completed a set of psychosocial and clinical questionnaires every six months over a period of 24 months. Results: In the ASSIP group 5 patients made a total of 5 reattempts, compared to 15 patients with 41 reattempts in the control group. The survival analysis yielded a significant difference with a Wald Chi2 of .000003. The ASSIP group had significantly lower suicidal ideation and fewer days of inpatient treatment compared to the control group. Higher scores in the Penn Helping Alliance Questionnaire were associated with lower suicidal ideation during follow-up. Conclusions: ASSIP is a highly effective brief therapy for patients with recent suicide attempts. Forming a strong therapeutic alliance is considered to be a major factor for outcome. ASSIP can be used with minimal training by experienced therapists. An English version of the manual will be published in May 2015.

Unpacking black boxes: Mechanisms and theory building in evaluation

There is growing interest in the concept of ‘‘mechanism’’ across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of mechanism-based thinking in both the social science and evaluation literature. In this article we attempt to clarify what is meant by mechanisms in the context of program evaluation by identifying three main characteristics of mechanisms and outlining a possible typology of mechanisms. A number of theoretical and practical implications for evaluators are also discussed, along with some precautions to consider when investigating mechanisms that might plausibly account for program outcomes.

A model for engaging and evaluating innovative cross-sectoral education reform : case studies from Queensland, Australia

This paper will explore how a general education can contribute successfully to vocational outcomes using both Participatory Action Research (PAR) and Program Theory methodology. The paper will focus on the development aspects of ‘marrying’ vocational and general education including engagement processes, student, teacher, institute and employer preparation and the pathway possibilities that emerge. Successful cases presented include the: Healthy Futures program (pathways into the Health and Allied industries); Accounting Pathways program (simultaneously studying a general Accounting subject and a Certificate III vocational qualification); and Sustainable Sciences initiative (development of a vocational qualification that focuses on the emerging renewable energy industry and is linked to school science programs). The case studies have been selected because they are unique in character and application and can be used as a basis for future program development in other settings or curriculum areas.

When sparks fly : developing formal mentoring programs for the career development of young and emerging artists

Formal mentoring programs are accepted as a valuable strategy for developing young and emerging artists. This thesis presents the results of an evaluation of the SPARK National Young Artists Mentoring Program (SPARK). SPARK was a ten-month formal mentoring program managed by Youth Arts Queensland (YAQ) on behalf of the Australia Council for the Arts from 2003-2009. The program aimed to assist young and emerging Australian artists between the ages of 18-26 to establish a professional career in the arts. It was a highly successful formal arts mentoring program that facilitated 58 mentorships between young and emerging artists and professional artists from across Australia in five program rounds over its seven year lifespan. Interest from other cultural organisations looking to develop their own formal mentoring programs encouraged YAQ to commission this research to determine how the program works to achieve its effects. This study was conducted with young and emerging artists who participated in SPARK from 2003 to 2008. It took a theory-driven evaluation approach to examine SPARK as an example of what makes formal arts mentoring programs effective. It focused on understanding the program’s theory or how the program worked to achieve its desired outcomes. The program activities and assumed responses to program activities were mapped out in a theories of change model. This theoretical framework was then used to plan the points for data collection. Through the process of data collection, actual program developments were compared to the theoretical framework to see what occurred as expected and what did not. The findings were then generalised for knowledge and wider application. The findings demonstrated that SPARK was a successful and effective program and an exemplar model of a formal mentoring program preparing young and emerging artists for professional careers in the arts. They also indicate several ways in which this already strong program could be further improved, including: looking at the way mentoring relationships are set up and how the mentoring process is managed; considering the balance between artistic and professional development; developing career development competencies and networking skills; taking into account the needs of young and emerging artists to develop their professional identity and build confidence; and giving more thought to the desired program outcomes and considering the issue of timeliness and readiness for career transition. From these findings, together with principles outlined in the mentoring and career development literature, a number of necessary conditions have been identified for developing effective mentoring programs in the career development of young and emerging artists.

Confronting the shortage of skilled and professional workers : A large scale industry-school partnership initiative

In most of the advanced economies, students are losing interest in careers especially in engineering and related industries. Hence, western economies are confronting a critical skilled labour shortage in areas of technology, science and engineering. The aim of this paper is to document how the organisational and institutional elements of one industry-school partnerships initiative – The Gateway Schools Program - contribute to productive knowledge sharing and networking. In particular this paper focuses on an initiative of an Australian State government in response to a perceived crisis around the skills shortage in an economy transitioning from a localised to a global knowledge production economy. The Gateway Schools initiative signals the first sustained attempt in Australia to incorporate schools into production networks through strategic partnerships linking them to partner organisations at the industry level. We provide case examples of how four schools operationalise the partnerships with the mining and energy industries and how these partnerships as knowledge assets impact the delivery of curriculum and capacity building among teachers. A program theory approach to analysis, informed by theoretical perspectives of Bailey (1994), Bagnall (2007) and Walsh (2004) was adopted. Each of these theorists provides a related but different perspective on the establishment, purpose, and effectiveness respectively of partnerships. Our ultimate goal is to define those characteristics of successful partnerships that do contribute to enhanced interest and engagement by students in those careers that are currently experiencing critical shortages.

Predicting people’s intention to donate their body to medical science and research

Predictors of people’s intention to register with a body bequest program for donating their deceased body to medical science and research were examined using standard theory of planned behavior (TPB) predictors (attitude, subjective norm, perceived behavioral control) and adding moral norm, altruism, and knowledge. Australian students (N = 221) at a university with a recently established body bequest program completed measures of the TPB’s underlying beliefs (behavioral, normative, and control beliefs) and standard and extended TPB predictors, with a sub-sample reporting their registration-related behavior 2 months later. The standard TPB accounted for 43.6%, and the extended predictors an additional 15.1% of variance in intention. The significant predictors were attitude, subjective norm, and moral norm, partially supporting an extended TPB in understanding people’s body donation intentions. Further, important underlying beliefs can inform strategies to target prospective donors.

Research around practice partnerships: An example of building partnerships to address overweight and obesity in children

Prevention and management of childhood overweight and obesity is a health priority for governments and communities throughout the developed world. A conceptual model, Research around Practice in Childhood Obesity (RAPICO), has been developed to guide capacity building in a coordinated 'bench to fieldwork' initiative to address this public health problem. Translation of research findings into sustainable responses with optimal fit requires consideration of context-specific relevance, cost-effectiveness, feasibility and levels of available support. The RAPICO model uses program theory to describe a framework for progressing practitionercommunityresearch partnerships to address low, medium and high levels of risk for childhood overweight and obesity within community settings. A case study describing the development of a logic model to inform risk-linked responses to childhood overweight and obesity is presented for the Ipswich community in south-east Queensland.

Lessons from established breeding programs: terrestrial and aquatic animals

Some relevant components of selection program theory and implementation are reviewed. This includes pedigree recording, genetic evaluation, balancing genetic gains and genetic diversity and tactical integration of key issues. Lessons learned are briefly described – illustrating how existing method and tools can be useful when launching a program in a novel species, and yet highlighting the importance of proper understanding and custom application according to the biology and environments of that species.

Resan till samhället : En kvalitativ utvärderingsstudie av en mottagningsenhet i mellansverige

In present study interviews with five officials and the gathering of documentation carried out in a reception center for newly arrived refugees located in a medium-sized municipality in central Sweden. The aim has been on the basis of the collected empirical data to evaluate how the municipality worked to promote the integration of newcomers, what measures were available, whether there were existing goals, and how they were formulated, and the extent to which they were implemented. This constituted, together with earlier research and systems theory based framework for the study's conclusions. The study showed that communication between and within the investigated unit was partly flawed. It has also showed that there was a degree of conflict in organizational approaches within the examined entity which could cause bottlenecks in the activity. The current study also showed the difficulty in estimating the resources currently needed to cover the need of, among others, Swedish for immigrants.

Assessing for work integrated learning experiences : a pre-service teacher perspective

A critical aspect of the debate about work integrated learning in the university context is the blurring of boundaries and responsibilities in terms of student learning. In an Australian pre-service teacher education program this blurring of boundaries is apparent in stakeholder tensions about the nature and role of assessment during the practicum. In the study reported in this paper students responded positively to the content of assessment tasks but maintained that their efforts to implement the associated planning in the workplace were stymied because of disparate understandings between university and school staff about the purpose of the task.

Certificates for Incremental Type Checking

The central topic of this thesis is the study of algorithms for type checking, both from the programming language and from the proof-theoretic point of view. A type checking algorithm takes a program or a proof, represented as a syntactical object, and checks its validity with respect to a specification or a statement. It is a central piece of compilers and proof assistants. We postulate that since type checkers are at the interface between proof theory and program theory, their study can let these two fields mutually enrich each other. We argue by two main instances: first, starting from the problem of proof reuse, we develop an incremental type checker; secondly, starting from a type checking program, we evidence a novel correspondence between natural deduction and the sequent calculus.

Learning What Works: Demonstrating Practice Effectiveness with Children and Families Through Retrospective Investigation

Intensive family preservation services (IFPS), designed to stabilize at-risk families and avert out-of-home care, have been the focus of many randomized, experimental studies. Employing a retrospective “clinical data-mining” (CDM) methodology (Epstein, 2001), this study makes use of available information extracted from client records in one IFPS agency over the course of two years. The primary goal of this descriptive and associational study was to gain a clearer understanding of IFPS service delivery and effectiveness. Interventions provided to families are delineated and assessed for their impact on improved family functioning, their impact on the reduction of family violence, as well as placement prevention. Findings confirm the use of a wide range of services consistent with IFPS program theory. Because the study employs a quasi-experimental, retrospective use of available information, clinical outcomes described cannot be causally attributed to interventions employed as with randomized controlled trials. With regard to service outcomes, findings suggest that family education, empowerment services and advocacy are most influential in placement prevention and in ameliorating unmanageable behaviors in children as well as the incidence of family violence.

Looking Inside The Black Box

Intensive family preservation services (IFPS), designed to stabilize at-risk families and avert out-of-home care, have been the focus of many randomized, experimental studies. The emphasis on "gold-standard" evaluation of IFPS has resulted in fewer "black box" studies that describe actual IFPS service patterns and the fidelity with which they adhere to IFPS program theory. Intervention research is important to the advancement of programs designed to protect the safety of children, improve family functioning, as well as prevent out-of-home placement. Employing a retrospective “clinical data-mining” (CDM) methodology, this exploratory study of Families First, an IFPS program, makes use of available information extracted from client records to describe interventions and service patterns provided over a two year period. This study uncovers actual IFPS service patterns, demonstrates IFPS program fidelity, as well as reveals the usefulness of CDM as a social work research methodology. These findings are particularly valuable for program planning and treatment, policy development and evidence-based practice research.