Dismantling the public sector bastion : evaluation capital works

Purpose: The determination of the most appropriate procurement system for a capital works project is a challenging task for public sector clients considering the array of assessment criteria that are considered and the procurement methods that are available. This is particularly pertinent to the Western Australian public sector where they have had a propensity to use traditional lump sum as the default procurement solution despite knowing that the selection of an inappropriate procurement method may lead to cost and time overruns, claims, and disputes’ on projects. This paper presents a six step procurement method evaluation approach that requires public sector agencies to consider in detail an array of options so as to obtain value for money. Design/methodology/approach: A procurement evaluation approach is developed and is examined using a focus group of 12 participants comprising of a public sector client, project team and key stakeholders. The focus group was used to examine the developed approach in the context of a real-life capital works project. Findings: The procurement method evaluation approach was deemed to be pragmatic and enabled decision-makers to re-evaluate outcomes from previous steps in the process. All focus group participants stated the six step process enabled a recommendation that was grounded in reflection and detailed evaluation. Practical implications: The developed procurement approach has enabled the public sector client evaluate the way in which they view procurement method selection and examine how they obtain ‘value for money’. Originality/value: The six step procurement approach makes use of quantitative and qualitative techniques and is reliant on discourse and reflection in making a procurement method recommendation. Consequently, the approach enables public sector clients to account for the complexities often associated with procurement selection.

Evaluation of the in vitro bioactivity of bioceramics

Two common methods have been used to evaluate the in vitro bioactivity of bioceramics for the application of bone repair. One is to evaluate the ability of apatite formation by soaking ceramics in simulated body fluids (SBF); the other method is to evaluate the effect of ceramics on osteogenic differentiation using cell experiments. Both methods have their own drawbacks in evaluating the in vitro bioactivity of bioceramics. In this commentary paper we review the application of both methods in bioactivity of bioceramics and conclude that (i) SBF method is an efficient method to investigate the in vitro bioactivity of silicate-based bioceramics, (ii) cellular bioactivity of bioceramics should be investigated by evaluating their stimulatory ability using standard bioceramics as controls; and (iii) the combination of these two methods to evaluate the in vitro bioactivity of bioceramics can improve the screening efficiency for the selection of bioactive ceramics for bone regeneration.

Property Education : an evaluation of how well undergraduate property students are prepared for commencing their careers

The evolution of property education to adapt to the changing business environment requires changes to course content, method of delivery and assessment. Many universities have a special interest in understanding how the students transition in and transition out of the property programs. The impact of the first year student experience is often easier to assess through students’ progression in the course and performance in their intermediate and advanced units. However, the students’ success in transitioning from university student to property professional is often more difficult to determine. In an environment where many property students commence their professional careers while still completing their undergraduate property qualification, a survey of current final year students was undertaken to identify the students’ perception of their level of preparedness for entry into the professional world. This study has also been informed by feedback received from and informal discussions held with industry representative bodies, alumni and senior members of professional organisations. The QUT UD40 Bachelor of Urban Development, Property Economics course has been designed to achieve graduate capabilities in core technical skills and generic professional skills which are required by property professionals. The results of this study were that some units in the program were perceived to provide direct preparation for students commencing their professional careers whilst the impact of other units was less tangible. Valuable feedback received during the study included an assessment of the relevance of many multi-disciplinary units, the appropriateness of the programming of units within the course and the appropriateness of repetition of content during the course. The further research question arises as to how universities can better assist students in the transition to the professional environment when frequently this occurs prior to completion of the property course.

Aligning policy with practice: an evaluation of vocational education and training in the library and information services sector

Vocational education and training for the library and information services (LIS) sector in Australia offers students the career pathway to become library technicians. Library technicians play a valuable role in drawing on sound practical knowledge and skills to support the delivery of library and information services that meet client needs. Over the past forty years, the Australian Library and Information Association (ALIA) has monitored the quality of library technician courses. Since 2005, ALIA has run national professional development days for library technician educators with the goal of establishing an alternative model for course recognition focusing on the process of peer review to benchmark good practice and stimulate continuous improvement in library technician education. This initial developmental work has culminated in 2009 with site visits to all library technician courses in Australia. The paper presents a whole-of-industry case study to critically review the work undertaken to date.

Changing motorcycle rider safety attitudes and motives for risk taking : process evaluation of a rider training intervention

Risk-taking behaviour by motorcyclists has been shown to contribute to a substantial proportion of road crashes in Australia and abroad. Concern has been expressed that traditional motorcycle licence training programs do not sufficiently address such behaviour. Accordingly, the Three Steps to Safer Riding program was developed to address risk taking behaviour by riders as an adjunct to existing skills-based rider training. The program was designed to be delivered in a one hour classroom session at the start of training, with a 20 minute debrief to revise the key concepts at the end of training. This paper reports on the key training concepts, methodology and implementation of the pilot program with a major rider training organisation in Queensland and presents findings from a process evaluation. The Three Steps to Safer Riding intervention pilot was delivered to 518 learner riders over a three month period. Follow-up focus groups and one interview with intervention participants (N=18) five to eight months after completion of the program suggest that new riders (absolute novices) embraced and internalised many of the intervention concepts. However, some riders who had previous riding experience prior to training stated these issues were common sense, yet still expressed riding styles that were contrary to some of the key intervention messages. This is discussed in terms of raising awareness of risk issues for motorcyclists versus behaviour change. Additionally, interviews conducted with riding instructors are discussed regarding logistical challenges of implementation, training consistency, skills required to deliver the program, support for the program, and student engagement.

An evaluation of brief correspondence programs for problem drinkers

The provision of accessible and cost-effective treatment to a large number of problem drinkers is a significant challenge to health services. Previous data suggest that a correspondence intervention may assist in these efforts. We recruited 277 people with alcohol abuse problems and randomly allocated them to immediate cognitive behavioral treatment by correspondence (ICBT), 2 months in a waiting list (WL2-CBT), self-monitoring (SM2-CBT), or extended self-monitoring (SM6-CBT). Everyone received correspondence CBT after the control period. Over 2 months later, no drop in alcohol intake occurred in the waiting list, and CBT had a greater impact than SM. No further gains from SM were seen after 2 months. Effects of CBT were well maintained and were equivalent, whether it was received immediately or after 2 to 6 months of self-monitoring. Weekly alcohol intake fell 48% from pretreatment to 18.6 alcohol units at 12 months. Our results confirmed that correspondence CBT for alcohol abuse was accessible and effective for people with low physical dependence.

Moderating drinking by correspondence : an evaluation of a new method of intervention

Recognizing the need to offer alternative methods of brief interventions, this study developed correspondence treatments for low-dependent problem drinkers and evaluated their impact. One hundred and twenty-one problem drinkers were recruited by media advertisements and were randomly allocated to a full cognitive behavioural treatment programme (CBT) or to a minimal intervention condition (MI) that gave information regarding alcohol misuse and instructions to record drinking. As predicted, CBT was more effective than MI in reducing alcohol consumption over the 4-month controlled trial period. CBT produced a 50% fall in consumption, bringing the average intake of subjects within recommended maximum levels. Treatment gains at 6 months were well maintained to 12 months. High levels of consumer satisfaction, a high representation of women and a substantial participation from isolated rural areas attested to the feasibility of the correspondence programme as an alternative treatment. However, some drinking occasions still involved high intake for a significant subgroup of subjects, and this issue will be addressed in future programmes. The results supported the use of correspondence delivery as a means of promoting early engagement and equity of access between city and country areas.

Alcohol and other drugs in the Australian construction industry : A national evaluation and the best way forward

Anecdotal evidence highlights issues of alcohol and other drugs (AODs) and its association with safety risk on construction sites. Information is limited however regarding the prevalence of AODs in the workplace and there is limited evidential guidance regarding how to effectively address it. This research aimed to scientifically evaluate the use of AODs within the Australian construction industry in order to reduce the potential resulting safety and performance impacts and engender a cultural change in the workforce. A national qualitative and quantitative evaluation of the use of AODs was conducted with approximately 500 employees. Results indicate that as in the general population, a proportion of those sampled in the construction sector may be at risk of hazardous alcohol consumption and support the need for evidence-based, tailored responses. This is the first known study to scientifically evaluate the use of AODs and potential workplace safety impacts in the construction sector.

Development and validation of 3-Minute Nutrition Screening (3-MinNS) tool for acute hospital patients in Singapore

It is important to detect and treat malnutrition in hospital patients so as to improve clinical outcome and reduce hospital stay. The aim of this study was to develop and validate a nutrition screening tool with a simple and quick scoring system for acute hospital patients in Singapore. In this study, 818 newly admitted patients aged above 18 years old were screened using five parameters that contribute to the risk of malnutrition. A dietitian blinded to the nutrition screening score assessed the same patients using the reference standard, Subjective Global Assessment (SGA) within 48 hours. The sensitivity and specificity were established using the Receiver Operator Characteristics (ROC) curve and the best cutoff scores determined. The nutrition parameter with the largest Area Under the ROC Curve (AUC) was chosen as the final screening tool, which was named 3-Minute Nutrition Screening (3-MinNS). The combination of the parameters weight loss, intake and muscle wastage (3-MinNS), gave the largest AUC when compared with SGA. Using 3-MinNS, the best cutoff point to identify malnourished patients is three (sensitivity 86%, specificity 83%). The cutoff score to identify subjects at risk of severe malnutrition is five (sensitivity 93%, specificity 86%). 3-Minute Nutrition Screening is a valid, simple and rapid tool to identify patients at risk of malnutrition in Singapore acute hospital patients. It is able to differentiate patients at risk of moderate malnutrition and severe malnutrition for prioritization and management purposes.

Prevention of postnatal distress or depression : an evaluation of an intervention at preparation for parenthood classes.

Determined the effectiveness of a psychosocial intervention, provided to expectant couples in routine antenatal classes, on the postpartum psychosocial adjustment of women and men. Preparation for Parenthood programs were randomly allocated to one of three conditions: usual service ('control'), experimental ('empathy'), or non-specific control ('baby-play'). The latter condition controlled for the non-specific effects of the intervention, these being: the provision of an extra class; asking couples to consider the early postpartum weeks; and receiving booster information after the antenatal class, and again shortly after the birth. Women and men were categorised into three levels of self-esteem, as measured antenatally: low, medium and high. 268 participants were recruited antenatally. Interview data and self-report information was collected from 202 of these women at 6 weeks postpartum, and 180 women at 6 months postpartum. The intervention consisted of a session focusing on psychosocial issues related to becoming first-time parents. Participants discussed possible postpartum concerns in separate gender groups for part of the session, and then discussed these issues with their partners

Evaluation of multiple sewage-associated bacteroides PCR markers for sewage pollution tracking

The host specificity of the five published sewage-associated Bacteroides markers (i.e., HF183, BacHum, HuBac, BacH and Human-Bac) was evaluated in Southeast Queensland, Australia by testing fecal DNA samples (n = 186) from 11 animal species including human fecal samples collected via influent to a sewage treatment plant (STP). All human fecal samples (n = 50) were positive for all five markers indicating 100% sensitivity of these markers. The overall specificity of the HF183 markers to differentiate between humans and animals was 99%. The specificities of the BacHum and BacH markers were > 94%, suggesting that these markers are suitable for sewage pollution in environmental waters in Australia. The BacHum (i.e., 63% specificity) and Human-Bac (i.e., 79% specificity) markers performed poorly in distinguishing between the sources of human and animal fecal samples. It is recommended that the specificity of the sewage-associated markers must be rigorously tested prior to its application to identify the sources of fecal pollution in environmental waters.

EMG biofeedback in the treatment of tinnitus : an experimental evaluation

26 tinnitus patients received either electromyogram (EMG) biofeedback with counterdemand instructions, EMG biofeedback with neutral demand instructions, or no treatment. Assessment was conducted on self-report measures of the distress associated with tinnitus, the loudness, annoyance and awareness of tinnitus, sleep-onset difficulties, depression, and anxiety. Audiological assessment of tinnitus was also conducted and EMG levels were measured (the latter only in the 2 treatment groups). No significant treatment effects were found on any of the measures. There was a significant decrease in the ratings of tinnitus awareness over the assessment occasions, but the degree of change was equivalent for treated and untreated groups. Results do not support the assertion that EMG biofeedback is an effective treatment for tinnitus.

An evaluation framework for educational reform projects for teacher quality improvements in developing countries : a case study of Egyptian education reform

The role of the evaluation for Official Development Assistance (ODA) enterprises including educational development has become critical after increasing “aid fatigue” experienced by the international community in the 1990s. To date, however, monitoring and evaluating outcomes of the projects has been limited to the project life. Consequently these have been mainly through the international aid agencies. Furthermore, the monitoring and evaluation led by international aid agencies have paid little attention to aspects of the sustainability of technical cooperation in educational development. To sustain the impact of technical cooperation, the reinforcement of evaluation has drawn increasing attention in light of the emerging modalities in international development. Therefore this research was inspired to investigate alternative evaluation frameworks for an educational reform project for teacher quality improvement that may increase possibilities for long term sustainability. Importantly, the new modalities in international development and educational issues provide new options. In addition, the research reviewed theoretical and practical issues surrounding evaluation in general, and highlighted the evaluation of education reform projects. The research reported explored via case studies, the evaluation processes employed by the Egyptian education reform projects implemented by the Japan International Cooperation Agency (JICA) and the United Nations Children’s Fund (UNICEF). The case studies used three data sources (archival and relevant documents, a survey questionnaire and interviews) to illuminate the contextually-embedded evaluation processes. The research found that process evaluation is a potential alternative method since it is likely to be locally institutionalised, which may yield long-term sustainability of the projects.