Evaluation of Indigenous justice programs.: final report / Project D, Safe Aboriginal Youth Patrol Programs in New South Wales and Northbridge Policy and Juvenile Aid Group in Western Australia

The Australian Government has provided funding to evaluate the effectiveness of Indigenous law and justice programs across five subject areas to identify the best approaches to tackling crime and justice issues and better inform government funding decisions in the future. This report presents the findings of subject area "D", which examined two different approaches to delivering community and night patrol services for young people: the Safe Aboriginal Youth Patrol programs in New South Wales, and the Northbridge Policy project (the Young People in Northbridge project), in Western Australia. Night patrols can address crime either directly or indirectly, by prevention work or by addressing the social causes of crime through community development.

Economic evaluation of adolescent reproductive health education interventions in Chilinh, Vietnam

This research was an economic analysis of two novel health education interventions compared to existing practice for reproductive health among young people in northern Vietnam. The research showed that implementing an educational intervention including school-based and health facility-based components was cost effective for males and females. The findings will assist decision makers in efficient allocation of scarce resources for adolescent health promotion in Vietnam and similar socio-economic contexts in Asia.

Design, construction and evaluation of systems to predict risk in obstetrics

We present a systematic, practical approach to developing risk prediction systems, suitable for use with large databases of medical information. An important part of this approach is a novel feature selection algorithm which uses the area under the receiver operating characteristic (ROC) curve to measure the expected discriminative power of different sets of predictor variables. We describe this algorithm and use it to select variables to predict risk of a specific adverse pregnancy outcome: failure to progress in labour. Neural network, logistic regression and hierarchical Bayesian risk prediction models are constructed, all of which achieve close to the limit of performance attainable on this prediction task. We show that better prediction performance requires more discriminative clinical information rather than improved modelling techniques. It is also shown that better diagnostic criteria in clinical records would greatly assist the development of systems to predict risk in pregnancy. We present a systematic, practical approach to developing risk prediction systems, suitable for use with large databases of medical information. An important part of this approach is a novel feature selection algorithm which uses the area under the receiver operating characteristic (ROC) curve to measure the expected discriminative power of different sets of predictor variables. We describe this algorithm and use it to select variables to predict risk of a specific adverse pregnancy outcome: failure to progress in labour. Neural network, logistic regression and hierarchical Bayesian risk prediction models are constructed, all of which achieve close to the limit of performance attainable on this prediction task. We show that better prediction performance requires more discriminative clinical information rather than improved modelling techniques. It is also shown that better diagnostic criteria in clinical records would greatly assist the development of systems to predict risk in pregnancy.

An evaluation of the neocognitron

We describe a sequence of experiments investigating the strengths and limitations of Fukushima's neocognitron as a handwritten digit classifier. Using the results of these experiments as a foundation, we propose and evaluate improvements to Fukushima's original network in an effort to obtain higher recognition performance. The neocognitron's performance is shown to be strongly dependent on the choice of selectivity parameters and we present two methods to adjust these variables. Performance of the network under the more effective of the two new selectivity adjustment techniques suggests that the network fails to exploit the features that distinguish different classes of input data. To avoid this shortcoming, the network's final layer cells were replaced by a nonlinear classifier (a multilayer perceptron) to create a hybrid architecture. Tests of Fukushima's original system and the novel systems proposed in this paper suggest that it may be difficult for the neocognitron to achieve the performance of existing digit classifiers due to its reliance upon the supervisor's choice of selectivity parameters and training data. These findings pertain to Fukushima's implementation of the system and should not be seen as diminishing the practical significance of the concept of hierarchical feature extraction embodied in the neocognitron. © 1997 IEEE.

A critical evaluation of written discharge advice for people with mild traumatic brain injury : what should we be looking for?

Objective: To formally evaluate the written discharge advice for people with mild traumatic brain injury (mTBI). Methods: Eleven publications met the inclusion criteria: (1) intended for adults; (2) ≤two A4 pages; (3) published in English; (4) freely accessible; and (5) currently used (or suitable for use) in Australian hospital emergency departments or similar settings. Two independent raters evaluated the content and style of each publication against established standards. The readability of the publication, the diagnostic term(s) contained in it and a modified Patient Literature Usefulness Index (mPLUI) were also evaluated. Results: The mean content score was 19.18 ± 8.53 (maximum = 31) and the mean style score was 6.8 ± 1.34 (maximum = 8). The mean Flesch-Kincaid reading ease score was 66.42 ± 4.3. The mean mPLUI score was 65.86 ± 14.97 (maximum = 100). Higher scores on these metrics indicate more desirable properties. Over 80% of the publications used mixed diagnostic terminology. One publication scored optimally on two of the four metrics and highly on the others. Discussion: The content, style, readability and usefulness of written mTBI discharge advice was highly variable. The provision of written information to patients with mTBI is advised, but this variability in materials highlights the need for evaluation before distribution. Areas are identified to guide the improvement of written mTBI discharge advice.

Learnings, case studies and guidelines for establishing shared and collaborative service delivery in the non-government sector: Evaluation of the Multi-Tenant Service Centre (MTSC) Pilots Project

This report presents learnings, case studies, guidelines and resources for non-government organisations that are planning to implement shared or collaborative arrangements with other agencies. It summarises results from an evaluation of the implementation phase of the Multi-Tenant Service Centre (MTSC) Pilots Project, which was completed in June 2008. This evaluation shows that developing and implementing shared and collaborative arrangements is a complex process that presents many risks, challenges and barriers to success, but can have many potential benefits for non government organisations. As this report makes clear, there is no ‘one size fits all’ approach to this process. The MTSC Pilots Project was conducted by the Department of Communities (DoC), Queensland Government, as part of its Strengthening Non-Government Organisations strategy. The objective of the MTSC Pilots initiative was to co-locate separate service providers in an appropriately located centre, operating with effective and transparent management, which enabled service providers to improve client services. Three MTSC consortiums in Mackay, Caboolture and Toowoomba were selected as the pilots over a four year period from 2006 – 2010.

Evaluation of channel congestion in dedicated short-range communication networks

This thesis presents a novel idea for an adaptive prioritized cross-layer design (APCLD) control algorithm to achieve comprehensive channel congestion control for vehicular safety communication based on DSRC technology. An appropriate evaluation metric and two control parameters have been established. Simulation studies have evaluated the DSRC network performance in different traffic scenario and under different channel conditions. The APCLD algorithm is derived from the results of the simulation analysis.

Evaluation of knowledge management performance: An organic approach

Knowledge management (KM) strategy is the planned or actual coordination of a firm's major goals and learning in time; this coordination continually co-aligns the firm's knowledge-based resources with the environment. Based on the organic perspective of strategy, a KM performance evaluation approach should be able to 1) review the knowledge governance mechanisms and learning routines that underpin the KM strategy, as well as the performance outcomes driven by the strategy, and 2) predict the evolution of performance drivers and outcomes into the future to facilitate strategic planning. This study combined a survey study and a system dynamics (SD) simulation to demonstrate the transformation from a mechanistic to an organic perspective on KM strategy and performance evaluation. The survey study was conducted based on a sample of 143 construction contractors and used structural equation modeling (SEM) techniques to develop a KM performance index for reviewing the key elements that underpin KM strategy. The SD simulation predicted the development of KM strategy configurations and the evolution of KM performance over time. The organic KM performance evaluation approach demonstrated by this study has significant potential to improve the alignment of KM strategy within an increasingly dynamic business environment.

A stakeholder process evaluation of a social marketing walking intervention targeting children

One quarter of Australian children are overweight or obese (ABS, 2010), putting them at increased risk of physical and psychological health problems (Reilly et al., 2003). Overweight and obesity in childhood tends to persist into adulthood and is associated with premature death and morbidity (Reilly & Kelly, 2011). Increases in Australian children’s weight have coincided with declines in active transportation, such as walking, to school (Salmon et al., 2005). To address this problem, the Victorian Health Promotion Foundation (VicHealth), which is an independent statutory authority which advises government and contributes to promoting good health in Victoria (VicHealth, 2014), developed the Walk to School program. Walk to School aims to encourage primary school children in Victoria to walk to and from school more often. Walking to school is a low cost and effective means of reducing excess weight (Rosenberg et al., 2006) that can be easily integrated into daily routine (Brophy et al., 2011). The purpose of this paper is to present the results of the stakeholder process evaluation of Walk to School 2013, which forms part of a broader outcome evaluation that is currently in field. Although there is an emphasis on outcome evaluation of programs, process evaluation can be equally important in determining program success (Saunders et al., 2005). Further, process evaluation to assess program delivery and utilization is explicitly recommended by two social marketing frameworks (see Lefebvre et al., 1988; Walsh et al., 1993).