When non-significance may be significant : lessons learned from a study of the development, implementation and evaluation of a fleet risk assessment tool

This paper reports on the development and implementation of a self-report risk assessment tool that was developed in an attempt to increase the efficacy of crash prediction within Australian fleet settings. This study forms a part of a broader program of research into work related road safety and identification of driving risk. The first phase of the study involved a series of focus groups being conducted with 217 professional drivers which revealed that the following factors were proposed to influence driving performance: Fatigue, Knowledge of risk, Mood, Impatience and frustration, Speed limits, Experience, Other road users, Passengers, Health, and Culture. The second phase of the study involved piloting the newly developed 38 item Driving Risk Assessment Scale - Work Version (DRAS-WV) with 546 professional drivers. Factor analytic techniques identified a 9 factor solution that was comprised of speeding, aggression, time pressure, distraction, casualness, awareness, maintenance, fatigue and minor damage. Speeding and aggressive driving manoeuvres were identified to be the most frequent aberrant driving behaviours engaged in by the sample. However, a series of logistic regression analyses undertaken to determine the DRAS-WV scale’s ability to predict self-reported crashes revealed limited predictive efficacy e.g., 10% of crashes. This paper outlines proposed reasons for this limited predictive ability of the DRAS-WV as well as provides suggestions regarding the future of research that aims to develop methods to identify “at risk” drivers.

Environmental and economic evaluation of N fertilizer rates in a maize crop in Italy : a spatial and temporal analysis using crop models

Crop simulation models have the potential to assess the risk associated with the selection of a specific N fertilizer rate, by integrating the effects of soil-crop interactions on crop growth under different pedo-climatic and management conditions. The objective of this study was to simulate the environmental and economic impact (nitrate leaching and N2O emissions) of a spatially variable N fertilizer application in an irrigated maize field in Italy. The validated SALUS model was run with 5 nitrogen rates scenarios, 50, 100, 150, 200, and 250 kg N ha−1, with the latter being the N fertilization adopted by the farmer. The long-term (25 years) simulations were performed on two previously identified spatially and temporally stable zones, a high yielding and low yielding zone. The simulation results showed that N fertilizer rate can be reduced without affecting yield and net return. The marginal net return was on average higher for the high yield zone, with values ranging from 1550 to 2650 € ha−1 for the 200 N and 1485 to 2875 € ha−1 for the 250 N. N leaching varied between 16.4 and 19.3 kg N ha−1 for the 200 N and the 250 N in the high yield zone. In the low yield zone, the 250 N had a significantly higher N leaching. N2O emissions varied between 0.28 kg N2O ha−1 for the 50 kg N ha−1 rate to a maximum of 1.41 kg N2O ha−1 for the 250 kg N ha−1 rate.

Integration of medical images to the teaching of systematic pathology : an evaluation of relevance

A sound knowledge of pathological disease processes is required for professional practice within health professions. The project described in this paper reviewed the resources currently available for the delivery of systematic pathology tutorials. Additional complementary resources were developed and the inclusion of these additional learning resources in practical tutorial sessions was evaluated for their impact on student learning. Student evaluation of the learning resources was undertaken across one semester with two different cohorts of health profession students using questionnaires and focus group discussion. Both cohorts reported an enhancement to their understanding of pathological disease processes through the use of the additional resources. Results indicate student perception of the value of the resources correlates with staff perception and is independent of prior experiences.

Exploratory factor analysis and psychometric evaluation of the Teachers Reporting Attitude Scale for Child Sexual Abuse

This paper presents an evaluation of an instrument to measure teachers’ attitudes towards reporting child sexual abuse and discusses the instrument’s merit for research into reporting practice. Based on responses from 444 Australian teachers, the Teachers’ Reporting Attitude Scale for Child Sexual Abuse (TRAS - CSA) was evaluated using exploratory factor analysis. The scale isolated three dimensions: commitment to the reporting role; confidence in the system’s response to reports; and concerns about reporting. These three factors accounted for 37.5% of the variance in the 14-item measure. Alpha coefficients for the subscales were 0.769 (commitment), 0.617 (confidence), and 0.661 (concerns). The findings provide insights into the complexity of studying teachers’ attitudes towards reporting of child sexual abuse, and have implications for future research.

Evaluation of methods for cultivating limbal mesenchymal stromal cells

Background: Mesenchymal stromal cells (MSC) with similar properties to bone marrow derived mesenchymal stromal cells (BM-MSC) have recently been grown from the limbus of the human cornea. We presently contribute to this novel area of research by evaluating methods for culturing human limbal MSC (L-MSC). Methods: Four basic strategies are compared: serum-supplemented medium (10% foetal bovine serum; FBS), standard serum-free medium supplemented with B-27, epidermal growth factor, and fibroblast growth factor 2, or one of two commercial serum-free media including Defined Keratinocyte Serum Free Medium (Invitrogen), and MesenCult-XF (Stem Cell Technologies). The phenotype of resulting cultures was examined using photography, flow cytometry (for CD34, CD45, CD73, CD90, CD105, CD141, CD271), immunocytochemistry (α-sma), differentiation assays (osteogenesis, adipogenesis, chrondrogenesis), and co-culture experiments with human limbal epithelial (HLE) cells. Results: While all techniques supported to varying degrees establishment of cultures, sustained growth and serial propagation was only achieved in 10% FBS medium or MesenCult-XF medium. Cultures established in 10% FBS medium were 70-80% CD34-/CD45-/CD90+/CD73+/CD105+, approximately 25% α-sma+, and displayed multi-potency. Cultures established in MesenCult-XF were >95% CD34-/CD45-/CD90+/CD73+/CD105+, 40% CD141+, rarely expressed α-sma, and displayed multi-potency. L-MSC supported growth of HLE cells, with the largest epithelial islands being observed in the presence of MesenCult-XF-grown L-MSC. All HLE cultures supported by L-MSC widely expressed the progenitor cell marker ∆Np63, along with the corneal differentiation marker cytokeratin 3. Conclusions: We conclude that MesenCult-XF® is a superior culture system for L-MSC, but further studies are required to explore the significance of CD141 expression in these cells.

Evaluation of the GHR car following model for traffic safety studies

Traffic safety studies mandate more than what existing micro-simulation models can offer as they postulate that every driver exhibits a safe behaviour. All the microscopic traffic simulation models are consisting of a car-following model and the Gazis–Herman–Rothery (GHR) car-following model is a widely used model. This paper highlights the limitations of the GHR car-following model capability to model longitudinal driving behaviour for safety study purposes. This study reviews and compares different version of the GHR model. To empower the GHR model on precise metrics reproduction a new set of car-following model parameters is offered to simulate unsafe vehicle conflicts. NGSIM vehicle trajectory data is used to evaluate the new model and short following headways and Time to Collision are employed to assess critical safety events within traffic flow. Risky events are extracted from available NGSIM data to evaluate the modified model against the generic versions of the GHR model. The results from simulation tests illustrate that the proposed model does predict the safety metrics better than the generic GHR model. Additionally it can potentially facilitate assessing and predicting traffic facilities’ safety using microscopic simulation. The new model can predict Near-miss rear-end crashes.

Vaccination of healthy and diseased koalas (Phascolarctos cinereus) with a Chlamydia pecorum multi-subunit vaccine : evaluation of immunity and pathology

Chlamydial infections represent a major threat to the long-term survival of the koala and a successful vaccine would provide a valuable management tool. Vaccination however has the potential to enhance inflammatory disease in animals exposed to a natural infection prior to vaccination, a finding in early human and primate trials of whole cell vaccines to prevent trachoma. In the present study, we vaccinated both healthy koalas as well as clinically diseased koalas with a multi-subunit vaccine consisting of Chlamydia pecorum MOMP and NrdB mixed with immune stimulating complex as adjuvant. Following vaccination, there was no increase in inflammatory pathological changes in animals previously infected with Chlamydia. Strong antibody (including neutralizing antibodies) and lymphocyte proliferation responses were recorded in all vaccinated koalas, both healthy and clinically diseased. Vaccine induced antibodies specific for both vaccine antigens were observed not only in plasma but also in ocular secretions. Our data shows that an experimental chlamydial vaccine is safe to use in previously infected koalas, in that it does not worsen infection-associated lesions. Furthermore, the prototype vaccine is effective, as demonstrated by strong levels of neutralizing antibody and lymphocyte proliferation responses in both healthy and clinically diseased koalas. Collectively, this work illustrates the feasibility of developing a safe and effective Chlamydia vaccine as a tool for management of disease in wild koalas.

Performance evaluation of onsite sewage treatment : summary report

The following summary report provides a concise overview of the research undertaken and the outcomes derived from the performance evaluation study of onsite sewage treatment systems. Additionally, a number of recommendations have been provided to enhance the treatment performance of these systems. This report also identifies a number of areas, which merit further investigations. The focus of the study was on subsurface effluent disposal systems. The reader is referred to the three project reports that were produced for more detailed information.

Evaluation of the luminous environment in open-plan offices with skylights

High Dynamic Range (HDR) imaging was used to collect luminance information at workstations in 2 open-plan office buildings in Queensland, Australia: one lit by skylights, vertical windows and electric light, and another by skylights and electric light. This paper compares illuminance and luminance data collected in these offices with occupant feedback to evaluate these open-plan environments based on available and emerging metrics for visual comfort and glare. This study highlights issues of daylighting quality and measurement specific to open plan spaces. The results demonstrate that overhead glare is a serious threat to user acceptance of skylights, and that electric and daylight integration and controls have a major impact on the perception of daylighting quality. With regards to measurement of visual comfort it was found that the Daylight Glare Probability (DGP) gave poor agreement with occupant reports of discomfort glare in open-plan spaces with skylights, and the CIE Glare Index (CGI) gave the best agreement. Horizontal and vertical illuminances gave no indication of visual comfort in these spaces.

Agronomic and economic evaluation of irrigation strategies on cotton lint yield in Australia

Cotton is one of the most important irrigated crops in subtropical Australia. In recent years, cotton production has been severely affected by the worst drought in recorded history, with the 2007–08 growing season recording the lowest average cotton yield in 30 years. The use of a crop simulation model to simulate the long-term temporal distribution of cotton yields under different levels of irrigation and the marginal value for each unit of water applied is important in determining the economic feasibility of current irrigation practices. The objectives of this study were to: (i) evaluate the CROPGRO-Cotton simulation model for studying crop growth under deficit irrigation scenarios across ten locations in New South Wales (NSW) and Queensland (Qld); (ii) evaluate agronomic and economic responses to water inputs across the ten locations; and (iii) determine the economically optimal irrigation level. The CROPGRO-Cotton simulation model was evaluated using 2 years of experimental data collected at Kingsthorpe, Qld. The model was further evaluated using data from nine locations between northern NSW and southern Qld. Long-term simulations were based on the prevalent furrowirrigation practice of refilling the soil profile when the plant -available soil water content is<50%. The model closely estimated lint yield for all locations evaluated. Our results showed that the amounts of water needed to maximise profit and maximise yield are different, which has economic and environmental implications. Irrigation needed to maximise profits varied with both agronomic and economic factors, which can be quite variable with season and location. Therefore, better tools and information that consider the agronomic and economic implications of irrigation decisions need to be developed and made available to growers.

Augmenting public participation : enhancing planning outcomes through the use of social media and web 2.0

Social media and web 2.0 tools offer opportunities to devise novel participation strategies that can engage previously difficult to reach as well as new segments of society in urban planning. This paper examines participatory planning in the four local government areas of Brisbane City Council, Gold Coast City Council, Redland City Council, and Toowoomba Regional Council, all situated in South East Queensland, Australia. The paper discusses how social media and web 2.0 tools can deliver a more engaging planning experience to citizens, and investigates local government’s current use and receptiveness to social media tools for plan making and community engagement. The study’s research informed the development of criteria to assess the level of participation reached through the current use of social media and web 2.0 in the four local government areas. This resulted in an adaptation of the International Association for Public Participation (IAP2) Toolbox to integrate these new tools which is being presented to encourage further discussion and evaluation by planning professionals.

Evaluation of the quality of diverse teaching practice in higher education research methods

The purpose of this paper is to report on a methods research project investigating the evaluation of diverse teaching practice in Higher Education. The research method is a single site case study of an Australian university with data collected through published documents, surveys, interviews and focus groups. This project provides evidence of the wide variety of evaluation practice and diverse teaching practice across the university. This breadth identifies the need for greater flexibility of evaluation processes, tools and support to assist teaching staff to evaluate their diverse teaching practice. The employment opportunities for academics benchmark the university nationally and position the case study in the field. Finally this reaffirms the institutional responsibility for services to support teaching staff in an ongoing manner.

Reframing evaluation of learning and teaching: An approach to change

Evaluation practices in the Higher Education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology (QUT) began a project which aims to reframe the organisation’s approach to the evaluation of learning and teaching. This paper describes the existing evaluation system; the emergence and early development of the project; and formulation of a conceptual framework identifying key dimensions of evaluation. It then compares the draft framework with other conceptualisations and models of evaluation identified in the literature, to determine its validity and suitability for supporting QUT’s plans for the future. Overall, the paper represents a structured evaluation of the REFRAME project at a particular point in its lifecycle. Given that the project follows an evidence based, practice-led process and applies an ongoing action research cycle, the findings are presented in the belief that QUT’s experience is broadly applicable to other institutions which may be contemplating change in relation to evaluation of learning and teaching.

Evaluation of screening tests for predicting older driver performance and safety assessed by an on-road test

A number of tests and test batteries are available for the prediction of older driver safety, but many of these have not been validated against standardized driving outcome measures. The aim of this study was to evaluate a series of previously described screening tests in terms of their ability to predict the potential for safe and unsafe driving. Participants included 79 community-dwelling older drivers (M=72.16 years, SD=5.46; range 65-88 years; 57 males and 22 females) who completed a previously validated multi-disciplinary driving assessment, a hazard perception test, a hazard change detection test and a battery of vision and cognitive tests. Participants also completed a standardized on-road driving assessment. The multi-disciplinary test battery had the highest predictive ability with a sensitivity of 80% and a specificity of 73%, followed by the hazard perception test which demonstrated a sensitivity of 75% and a specificity of 61%. These findings suggest that a relatively simple and practical battery of tests from a range of domains has the capacity to predict safe and unsafe driving in older adults.

Evaluation of the cost-effectiveness of strategies claiming to reduce the risk of surgical site infections following primary total hip arthroplasty

Background Total hip arthroplasty (THA) is a commonly performed procedure and numbers are increasing with ageing populations. One of the most serious complications in THA are surgical site infections (SSIs), caused by pathogens entering the wound during the procedure. SSIs are associated with a substantial burden for health services, increased mortality and reduced functional outcomes in patients. Numerous approaches to preventing these infections exist but there is no gold standard in practice and the cost-effectiveness of alternate strategies is largely unknown. Objectives The aim of this project was to evaluate the cost-effectiveness of strategies claiming to reduce deep surgical site infections following total hip arthroplasty in Australia. The objectives were: 1. Identification of competing strategies or combinations of strategies that are clinically relevant to the control of SSI related to hip arthroplasty 2. Evidence synthesis and pooling of results to assess the volume and quality of evidence claiming to reduce the risk of SSI following total hip arthroplasty 3. Construction of an economic decision model incorporating cost and health outcomes for each of the identified strategies 4. Quantification of the effect of uncertainty in the model 5. Assessment of the value of perfect information among model parameters to inform future data collection Methods The literature relating to SSI in THA was reviewed, in particular to establish definitions of these concepts, understand mechanisms of aetiology and microbiology, risk factors, diagnosis and consequences as well as to give an overview of existing infection prevention measures. Published economic evaluations on this topic were also reviewed and limitations for Australian decision-makers identified. A Markov state-transition model was developed for the Australian context and subsequently validated by clinicians. The model was designed to capture key events related to deep SSI occurring within the first 12 months following primary THA. Relevant infection prevention measures were selected by reviewing clinical guideline recommendations combined with expert elicitation. Strategies selected for evaluation were the routine use of pre-operative antibiotic prophylaxis (AP) versus no use of antibiotic prophylaxis (No AP) or in combination with antibiotic-impregnated cement (AP & ABC) or laminar air operating rooms (AP & LOR). The best available evidence for clinical effect size and utility parameters was harvested from the medical literature using reproducible methods. Queensland hospital data were extracted to inform patients’ transitions between model health states and related costs captured in assigned treatment codes. Costs related to infection prevention were derived from reliable hospital records and expert opinion. Uncertainty of model input parameters was explored in probabilistic sensitivity analyses and scenario analyses and the value of perfect information was estimated. Results The cost-effectiveness analysis was performed from a health services perspective using a hypothetical cohort of 30,000 THA patients aged 65 years. The baseline rate of deep SSI was 0.96% within one year of a primary THA. The routine use of antibiotic prophylaxis (AP) was highly cost-effective and resulted in cost savings of over $1.6m whilst generating an extra 163 QALYs (without consideration of uncertainty). Deterministic and probabilistic analysis (considering uncertainty) identified antibiotic prophylaxis combined with antibiotic-impregnated cement (AP & ABC) to be the most cost-effective strategy. Using AP & ABC generated the highest net monetary benefit (NMB) and an incremental $3.1m NMB compared to only using antibiotic prophylaxis. There was a very low error probability that this strategy might not have the largest NMB (<5%). Not using antibiotic prophylaxis (No AP) or using both antibiotic prophylaxis combined with laminar air operating rooms (AP & LOR) resulted in worse health outcomes and higher costs. Sensitivity analyses showed that the model was sensitive to the initial cohort starting age and the additional costs of ABC but the best strategy did not change, even for extreme values. The cost-effectiveness improved for a higher proportion of cemented primary THAs and higher baseline rates of deep SSI. The value of perfect information indicated that no additional research is required to support the model conclusions. Conclusions Preventing deep SSI with antibiotic prophylaxis and antibiotic-impregnated cement has shown to improve health outcomes among hospitalised patients, save lives and enhance resource allocation. By implementing a more beneficial infection control strategy, scarce health care resources can be used more efficiently to the benefit of all members of society. The results of this project provide Australian policy makers with key information about how to efficiently manage risks of infection in THA.