THE meaning of effectiveness

As the Industry Commission prepares to engage in its examination of the Australian nonprofit sector as defined in its draft terms of reference, it confronts what it should regard as a fundamental dilemma; the meaning of the construct `effectiveness'. I should at this point state clearly that the potential difficulties are not unique to the task of the Commission, but have instead plagued human service evaluation for many a long year. At the level of human service or welfare practice, a favoured method of resolving the conundrum has been to dismiss it as irrelevant to the human services as it pursues its task of working for human betterment however understood. Such a response highlights a fundamental characteristic of the human services generally, not only in the nonprofit arena: their relative freedom from evaluation. While there are many reasons for this, some of which we will canvass later in this paper, one stems from a lack of clarity about the meaning of effectiveness coupled with a lack of consensus about its purpose.

Effectiveness of cysteine proteases on protein/pigment film removal

Objective: Theaflavin (TF) from the black tea can react to human salivary proline-rich proteins (PRPs) to form stains on exposed dental surfaces. Here, we employed a model of protein/pigment film using TF and dephosphorylated bovine b-casein (Db-CN), which has an extended conformation, similar to that of salivary PRPs, on a sensor surface to assess the efficacy of cysteine proteases (CPs) including papain, stem bromelain, and ficin, on removing TF bound to Db-CN and the control TF readsorption on the residual substrate surfaces was also measured. Methods: The protein/pigment complex film was built by using a quartz crystal microbalance with dissipation (QCM-D). The efficacies of CPs were assessed by Boltzman equation model. The surface details were detected by grazing angle infrared spectroscopy spectra, atomic force microscopy images, and contact angles. Results: The efficacy order of CPs on hydrolyzing protein/pigment complex film is ficin > papain > bromelain. The results from grazing angle infrared spectroscopy spectra, atomic force microscopy images, and contact angles demonstrated that TF bound on the Db- CN was effectively removed by the CPs, and the amount of TF readsorption on both the residual film of the Db-CN/TF and the Db-CN was markedly decreased after hydrolysis. Conclusion: This study indicates the potential application of the CPs for tooth stain removal and suggests that these enzymes are worthy of further investigation for use in oral healthcare.

Effectiveness of 7-valent pneumococcal conjugate vaccine against radiologically diagnosed pneumonia in indigenous infants in Australia

Objective To evaluate the effectiveness of the 7-valent pneumococcal conjugate vaccine (PCV7) in preventing pneumonia, diagnosed radiologically according to World Health Organization (WHO) criteria, among indigenous infants in the Northern Territory of Australia. Methods We conducted a historical cohort study of consecutive indigenous birth cohorts between 1 April 1998 and 28 February 2005. Children were followed up to 18 months of age. The PCV7 programme commenced on 1 June 2001. All chest X-rays taken within 3 days of any hospitalization were assessed. The primary endpoint was a first episode of WHO-defined pneumonia requiring hospitalization. Cox proportional hazards models were used to compare disease incidence. Findings There were 526 pneumonia events among 10 600 children - an incidence of 3.3 per 1000 child-months; 183 episodes (34.8%) occurred before 5 months of age and 247 (47.0%) by 7 months. Of the children studied, 27% had received 3 doses of vaccine by 7 months of age. Hazard ratios for endpoint pneumonia were 1.01 for 1 versus 0 doses; 1.03 for 2 versus 0 doses; and 0.84 for 3 versus 0 doses. Conclusion There was limited evidence that PCV7 reduced the incidence of radiologically confirmed pneumonia among Northern Territory indigenous infants, although there was a non-significant trend towards an effect after receipt of the third dose. These findings might be explained by lack of timely vaccination and/or occurrence of disease at an early age. Additionally, the relative contribution of vaccine-type pneumococcus to severe pneumonia in a setting where multiple other pathogens are prevalent may differ with respect to other settings where vaccine efficacy has been clearly established.

Biological markers of stress in pediatric acute burn injury

BACKGROUND Burns and their associated wound care procedures evoke significant stress and anxiety, particularly for children. Little is known about the body's physiological stress reactions throughout the stages of re-epithelialization following an acute burn injury. Previously, serum and urinary cortisol have been used to measure stress in burn patients, however these measures are not suitable for a pediatric burn outpatient setting. AIM To assess the sensitivity of salivary cortisol and sAA in detecting stress during acute burn wound care procedures and to investigate the body's physiological stress reactions throughout burn re-epithelialization. METHODS Seventy-seven participants aged four to thirteen years who presented with an acute burn injury to the burn center at the Royal Children's Hospital, Brisbane, Australia, were recruited between August 2011 and August 2012. RESULTS Both biomarkers were responsive to the stress of burn wound care procedures. sAA levels were on average 50.2U/ml higher (p<0.001) at 10min post-dressing removal compared to baseline levels. Salivary cortisol levels showed a blunted effect with average levels at ten minutes post dressing removal decreasing by 0.54nmol/L (p<0.001) compared to baseline levels. sAA levels were associated with pain (p=0.021), no medication (p=0.047) and Child Trauma Screening Questionnaire scores at three months post re-epithelialization (p=0.008). Similarly, salivary cortisol was associated with no medication (p<0.001), pain scores (p=0.045) and total body surface area of the burn (p=0.010). CONCLUSION Factors which support the use of sAA over salivary cortisol to assess stress during morning acute burn wound care procedures include; sensitivity, morning clinic times relative to cortisol's diurnal peaks, and relative cost.

Modeling the effectiveness of counterterrorism interventions

After the terrorist attacks in the United States on 11 September 2001, terrorism and counter-terrorism efforts moved to the front of popular consciousness and became the focus of national security for governments worldwide. With this increased attention came an urgent interest in understanding and identifying what works in fighting terrorism (Belasco 2010). For Australia, understanding the relative effectiveness of counter-terrorism efforts in nearby neighbours of Indonesia, Thailand and the Philippines is highly relevant for our country's national security. Indonesia, Thailand and the Philippines are all countries that are important to Australia not just because of geographic proximity, but also because of a history of economic ties and the role these countries play as Australia’s regional partners...

The effectiveness of an intervention in reducing risk of dioxin exposure in Da Nang : changes in community knowledge, attitudes and prevention practices after 2.5 years

Introduction Environmental and biological samples taken around Da Nang Air Base have shown elevated levels of dioxin over many years [1-3]. A pre-intervention knowledge, attitudes and practices (KAP) survey (2009), a risk reduction program (2010) and a post intervention KAP survey (2011) were undertaken in four wards surrounding Danang Airbase. A follow-up evaluation was undertaken in 2013. Methods A KAP survey was implemented among 400 randomly selected food handlers. Eleven indepth interviews and four focus group discussions were also undertaken. Results The knowledge of respondents remained positive and/or improved at 2.5 years follow-up. There were no significant differences in attitudes toward preventing dioxin exposure across surveys; most respondents were positive in all three surveys. An increase in households (69.5%) undertaking measures to prevent exposure was observed, which was higher than in the pre-intervention survey (39.6%) and post- intervention survey (60.4%) (χ2 = 95.6; p < 0.001). The proportion of respondents practicing appropriate preventive measures was also significantly improved. Conclusions Despite most of the intervention program’s activities ceasing in 2010, the risk reduction program has resulted in positive outcomes over the longer-term, with many knowledge and attitude measures remaining stable or imporving. Some KAP indicators decreased, but these KAP indicators were still significantly higher than the pre-intervention levels.

Stop and revive? The effectiveness of nap and active rest breaks for reducing drivers sleepiness

The purpose of this study was to compare the effects of two commonly utilised sleepiness countermeasures: a nap break and an active rest break. The effects of the countermeasures were evaluated by physiological (EEG), subjective, and driving performance measures. Participants completed two hours of simulated driving, followed by a 15 minute nap break or a 15 minute active rest break then completed the final hour of simulated driving. The nap break reduced EEG and subjective sleepiness. The active rest break did not reduce EEG sleepiness, with sleepiness levels eventually increasing, and resulted in an immediate reduction of subjective sleepiness. No difference was found between the two breaks for the driving performance measure. The immediate reduction of subjective sleepiness after the active rest break could leave drivers with erroneous perceptions of their sleepiness, particularly with increases of physiological sleepiness after the break.

Priority Threat Management for Pilbara Species of Conservation Significance

This project provides a costed and appraised set of management strategies for mitigating threats to species of conservation significance in the Pilbara IBRA bioregion of Western Australia (hereafter 'the Pilbara'). Conservation significant species are either listed under federal and state legislation, international agreements or considered likely to be threatened in the next 20 years. Here we report on the 17 technically and socially feasible management strategies, which were drawn from the collective experience and knowledge of 49 experts and stakeholders in the ecology and management of the Pilbara region. We determine the relative ecological cost-effectiveness of each strategy, calculated as the expected benefit of management to the persistence of 53 key threatened native fauna and flora species, divided by the expected cost of management. Finally we provide decision support to assist prioritisation of the strategies on the basis of ecological cost-effectiveness.

Standard business reporting in Australia : efficiency, effectiveness, or both?

The benefits of using eXtensible Business Reporting Language (XBRL) as a business reporting standard have been widely canvassed in the extant literature, in particular, as the enabling technology for standard business reporting tools. One of the key benefits noted is the ability of standard business reporting to create significant efficiencies in the regulatory reporting process. Efficiency-driven cost reductions are highly desirable by data and report producers. However, they may not have the same potential to create long-term firm value as improved effectiveness of decision making. This study assesses the perceptions of Australian business stakeholders in relation to the benefits of the Australian standard business reporting instantiation (SBR) for financial reporting. These perceptions were drawn from interviews of persons knowledgeable in XBRL-based standard business reporting and submissions to Treasury relative to SBR reporting options. The combination of interviews and submissions permit insights into the views of various groups of stakeholders in relation to the potential benefits. In line with predictions based on a transaction-cost economics perspective, interviewees who primarily came from a data and report-producer background mentioned benefits that centre largely on asset specificity and efficiency. The interviewees who principally came from a data and report-consumer background mentioned benefits that centre on reducing decision-making uncertainty and decision-making effectiveness. The data and report consumers also took a broader view of the benefits of SBR to the financial reporting supply chain. Our research suggests that advocates of SBR have successfully promoted its efficiency benefits to potential users. However, the effectiveness benefits of SBR, for example, the decision-making benefits offered to investors via standardised reports, while becoming more broadly acknowledged, remain not a priority for all stakeholders.

What is the available evidence concerning relative performance of different designs of mixed-species plantings for smallholder and community forestry in the tropics? A systematic map protocol

Background There has been growing interest in mixed species plantation systems because of their potential to provide a range of socio-economic and bio-physical benefits which can be matched to the diverse needs of smallholders and communities. Potential benefits include the production of a range of forest products for home and commercial use; improved soil fertility especially when nitrogen fixing species are included; improved survival rates and greater productivity of species; a reduction in the amount of damage from pests or disease; and improved biodiversity and wildlife habitats. Despite these documented services and growing interest in mixed species plantation systems, the actual planting areas in the tropics are low, and monocultures are still preferred for industrial plantings and many reforestation programs because of perceived higher economic returns and readily available information about the species and their silviculture. In contrast, there are few guidelines for the design and management of mixed-species systems, including the social and ecological factors of successful mixed species plantings. Methods This protocol explains the methodology used to investigate the following question: What is the available evidence for the relative performance of different designs of mixed-species plantings for smallholder and community forestry in the tropics? This study will systematically search, identify and describe studies related to mixed species plantings across tropical and temperate zones to identify the social and ecological factors that affect polyculture systems. The objectives of this study are first to identify the evidence of biophysical or socio-economic factors that have been considered when designing mixed species systems for community and smallholder forestry in the tropics; and second, to identify gaps in research of mixed species plantations. Results of the study will help create guidelines that can assist practitioners, scientists and farmers to better design mixed species plantation systems for smallholders in the tropics.

Effectiveness of on-line resources to enhance student learning and engagement

BACKGROUND For engineering graduates to be work-ready with marketable skills they must not only be well-versed with engineering science and its applications, but also able to adapt to using commercial software that is widely used in engineering practice. Hydrological/hydraulic modelling is one aspect of engineering practice which demands the ability to apply fundamentals into design and construction using software. The user manuals for such software are usually tailored for the experienced engineer but not for undergraduates who typically are novices to concepts of modelling and software tools. As the focus of a course such as Advanced Water Engineering is on the wider aspects of engineering application of hydrological and hydraulic concepts, it is ineffective for the lecturers to direct the students to user manuals as students have neither the time nor the desire to sift through numerous pages in a manual. An alternative and efficient way to demonstrate the use of the software is enabling students to develop a model to simulate real-world scenario using the tools of the software and directing them to make informed decisions based on outcomes. PURPOSE Past experience of the lecturer showed that the resources available for the students left a knowledge gap leading to numerous student queries outside contact hours. The purpose of this study is to assess how effective purpose-built video resources can be in supplementing the traditional learning resources to enhance student learning. APPROACH Short-length animated video clips comprising guided step-by-step instructions were prepared using screen capture software to capture screen activity and later edited to focus on specific features using pop-up annotations; Vocal narration was purposely excluded to avoid disturbances due to noise and allow different learning paces of individual students. The video clips were made available to the students alongside the traditional resources/approaches such as in-class demonstrations, guideline notes, and tips for efficient and error-free procedural descriptions. The number of queries the lecturer received from the student cohort outside the lecture times was recorded. An anonymous survey to assess the usefulness and adequacy of the courseware was conducted. OUTCOMES While a significant decline in the number of student queries was noted, an overwhelming majority of the survey respondents confirmed the usefulness of the purpose-developed courseware. CONCLUSIONS/RECOMMENDATIONS/SUMMARY The survey and lecturer’s experience indicated that animated demonstration video clips illustrating the various steps involved in developing hydrologic and hydraulic models and simulating design scenarios is an effective supplement for traditional learning resources. Among the many advantages of the custom-made video clips as a learning resource are that they (1) highlight the aspects that are important to undergraduate learning but not available in the software manuals as the latter are designed for more mature users/learners; (2) provide short, to-the point communication in a step-by-step manner; (3) allow students flexibility to self-learn at their own pace; (4) enhance student learning; and (5) enable time savings for the lecturer in the long term by avoiding queries of a repetitive nature. It is expected that these newly developed resources will be improved to incorporate students’ suggestions before being offered to future cohorts of students. The concept can also be expanded to other relevant courses where animated demonstrations of key modelling steps are beneficial to student learning.

The need for cost-effectiveness analyses of antimicrobial stewardship programmes: A structured review

The cost effectiveness of antimicrobial stewardship (AMS) programmes was reviewed in hospital settings of Organisation for Economic Co-operation and Development (OECD) countries, and limited to adult patient populations. In each of the 36 studies, the type of AMS strategy and the clinical and cost outcomes were evaluated. The main AMS strategy implemented was prospective audit with intervention and feedback (PAIF), followed by the use of rapid technology, including rapid polymerase chain reaction (PCR)-based methods and matrix-assisted laser desorption/ionisation time-of-flight (MALDI-TOF) technology, for the treatment of bloodstream infections. All but one of the 36 studies reported that AMS resulted in a reduction in pharmacy expenditure. Among 27 studies measuring changes to health outcomes, either no change was reported post-AMS, or the additional benefits achieved from these outcomes were not quantified. Only two studies performed a full economic evaluation: one on a PAIF-based AMS intervention; and the other on use of rapid technology for the selection of appropriate treatment for serious Staphylococcus aureus infections. Both studies found the interventions to be cost effective. AMS programmes achieved a reduction in pharmacy expenditure, but there was a lack of consistency in the reported cost outcomes making it difficult to compare between interventions. A failure to capture complete costs in terms of resource use makes it difficult to determine the true cost of these interventions. There is an urgent need for full economic evaluations that compare relative changes both in clinical and cost outcomes to enable identification of the most cost-effective AMS strategies in hospitals.

The clinical effectiveness and cost-effectiveness of exercise referral schemes: A systematic review and economic evaluation

- Background Exercise referral schemes (ERS) aim to identify inactive adults in the primary-care setting. The GP or health-care professional then refers the patient to a third-party service, with this service taking responsibility for prescribing and monitoring an exercise programme tailored to the needs of the individual. - Objective To assess the clinical effectiveness and cost-effectiveness of ERS for people with a diagnosed medical condition known to benefit from physical activity (PA). The scope of this report was broadened to consider individuals without a diagnosed condition who are sedentary. - Data sources MEDLINE; EMBASE; PsycINFO; The Cochrane Library, ISI Web of Science; SPORTDiscus and ongoing trial registries were searched (from 1990 to October 2009) and included study references were checked. - Methods Systematic reviews: the effectiveness of ERS, predictors of ERS uptake and adherence, and the cost-effectiveness of ERS; and the development of a decision-analytic economic model to assess cost-effectiveness of ERS. - Results Seven randomised controlled trials (UK, n = 5; non-UK, n = 2) met the effectiveness inclusion criteria, five comparing ERS with usual care, two compared ERS with an alternative PA intervention, and one to an ERS plus a self-determination theory (SDT) intervention. In intention-to-treat analysis, compared with usual care, there was weak evidence of an increase in the number of ERS participants who achieved a self-reported 90-150 minutes of at least moderate-intensity PA per week at 6-12 months' follow-up [pooled relative risk (RR) 1.11, 95% confidence interval 0.99 to 1.25]. There was no consistent evidence of a difference between ERS and usual care in the duration of moderate/vigorous intensity and total PA or other outcomes, for example physical fitness, serum lipids, health-related quality of life (HRQoL). There was no between-group difference in outcomes between ERS and alternative PA interventions or ERS plus a SDT intervention. None of the included trials separately reported outcomes in individuals with medical diagnoses. Fourteen observational studies and five randomised controlled trials provided a numerical assessment of ERS uptake and adherence (UK, n = 16; non-UK, n = 3). Women and older people were more likely to take up ERS but women, when compared with men, were less likely to adhere. The four previous economic evaluations identified suggest ERS to be a cost-effective intervention. Indicative incremental cost per quality-adjusted life-year (QALY) estimates for ERS for various scenarios were based on a de novo model-based economic evaluation. Compared with usual care, the mean incremental cost for ERS was £169 and the mean incremental QALY was 0.008, with the base-case incremental cost-effectiveness ratio at £20,876 per QALY in sedentary people without a medical condition and a cost per QALY of £14,618 in sedentary obese individuals, £12,834 in sedentary hypertensive patients, and £8414 for sedentary individuals with depression. Estimates of cost-effectiveness were highly sensitive to plausible variations in the RR for change in PA and cost of ERS. - Limitations We found very limited evidence of the effectiveness of ERS. The estimates of the cost-effectiveness of ERS are based on a simple analytical framework. The economic evaluation reports small differences in costs and effects, and findings highlight the wide range of uncertainty associated with the estimates of effectiveness and the impact of effectiveness on HRQoL. No data were identified as part of the effectiveness review to allow for adjustment of the effect of ERS in different populations. - Conclusions There remains considerable uncertainty as to the effectiveness of ERS for increasing activity, fitness or health indicators or whether they are an efficient use of resources in sedentary people without a medical diagnosis. We failed to identify any trial-based evidence of the effectiveness of ERS in those with a medical diagnosis. Future work should include randomised controlled trials assessing the cinical effectiveness and cost-effectivenesss of ERS in disease groups that may benefit from PA. - Funding The National Institute for Health Research Health Technology Assessment programme.

The cost-effectiveness of exercise referral schemes

Background Exercise referral schemes (ERS) aim to identify inactive adults in the primary care setting. The primary care professional refers the patient to a third party service, with this service taking responsibility for prescribing and monitoring an exercise programme tailored to the needs of the patient. This paper examines the cost-effectiveness of ERS in promoting physical activity compared with usual care in primary care setting. Methods A decision analytic model was developed to estimate the cost-effectiveness of ERS from a UK NHS perspective. The costs and outcomes of ERS were modelled over the patient's lifetime. Data were derived from a systematic review of the literature on the clinical and cost-effectiveness of ERS, and on parameter inputs in the modelling framework. Outcomes were expressed as incremental cost per quality-adjusted life-year (QALY). Deterministic and probabilistic sensitivity analyses investigated the impact of varying ERS cost and effectiveness assumptions. Sub-group analyses explored the cost-effectiveness of ERS in sedentary people with an underlying condition. Results Compared with usual care, the mean incremental lifetime cost per patient for ERS was £169 and the mean incremental QALY was 0.008, generating a base-case incremental cost-effectiveness ratio (ICER) for ERS at £20,876 per QALY in sedentary individuals without a diagnosed medical condition. There was a 51% probability that ERS was cost-effective at £20,000 per QALY and 88% probability that ERS was cost-effective at £30,000 per QALY. In sub-group analyses, cost per QALY for ERS in sedentary obese individuals was £14,618, and in sedentary hypertensives and sedentary individuals with depression the estimated cost per QALY was £12,834 and £8,414 respectively. Incremental lifetime costs and benefits associated with ERS were small, reflecting the preventative public health context of the intervention, with this resulting in estimates of cost-effectiveness that are sensitive to variations in the relative risk of becoming physically active and cost of ERS. Conclusions ERS is associated with modest increase in lifetime costs and benefits. The cost-effectiveness of ERS is highly sensitive to small changes in the effectiveness and cost of ERS and is subject to some significant uncertainty mainly due to limitations in the clinical effectiveness evidence base.

Quarantine and surveillance strategies for plant pathogen detection and control

Incursions of plant pests and diseases pose serious threats to food security, agricultural productivity and the natural environment. One of the challenges in confidently delimiting and eradicating incursions is how to choose from an arsenal of surveillance and quarantine approaches in order to best control multiple dispersal pathways. Anthropogenic spread (propagules carried on humans or transported on produce or equipment) can be controlled with quarantine measures, which in turn can vary in intensity. In contrast, environmental spread processes are more difficult to control, but often have a temporal signal (e.g. seasonality) which can introduce both challenges and opportunities for surveillance and control. This leads to complex decisions regarding when, where and how to search. Recent modelling investigations of surveillance performance have optimised the output of simulation models, and found that a risk-weighted randomised search can perform close to optimally. However, exactly how quarantine and surveillance strategies should change to reflect different dispersal modes remains largely unaddressed. Here we develop a spatial simulation model of a plant fungal-pathogen incursion into an agricultural region, and its subsequent surveillance and control. We include structural differences in dispersal via the interplay of biological, environmental and anthropogenic connectivity between host sites (farms). Our objective was to gain broad insights into the relative roles played by different spread modes in propagating an invasion, and how incorporating knowledge of these spread risks may improve approaches to quarantine restrictions and surveillance. We find that broad heuristic rules for quarantine restrictions fail to contain the pathogen due to residual connectivity between sites, but surveillance measures enable early detection and successfully lead to suppression of the pathogen in all farms. Alternative surveillance strategies attain similar levels of performance by incorporating environmental or anthropogenic dispersal risk in the prioritisation of sites. Our model provides the basis to develop essential insights into the effectiveness of different surveillance and quarantine decisions for fungal pathogen control. Parameterised for authentic settings it will aid our understanding of how the extent and resolution of interventions should suitably reflect the spatial structure of dispersal processes.