BreastScreen Australia evaluation : a review of methodological options for evaluating the effect of BreastScreen Australia on breast cancer mortality

This report provides evidence-based recommendations for appropriate and cost-effective methods that could be used to evaluate the impact of the national BreastScreen Australia population-based mammographic screening program on mortality from female breast cancer. The report represents a significant collaboration between the Australian Government, the National Breast Cancer Centre as well as Australian and international experts in mammography research and evaluation, epidemiology and health services research.

The recommendations are based on a review of national and international evidence on approaches used to assess the impact of mammography screening programs on breast cancer mortality in other settings. The review has used a systematic approach to assessing the strategic and methodological approaches taken in each of the studies identified and their potential limitations.

The national evaluation of the BreastScreen Australia Program aims to assess the appropriateness, efficiency and effectiveness of the BreastScreen Program. The completion of this report marks an important first step in that process. In addition, the review and recommendations in this report may have broader application at an international level.

Markers assistant – a software solution for the management of the assessment process

Technology-mediated instruction is changing the educational environment by adding another dimension to teaching and learning. Despite the advances in technology and the way we use technology, little attention has been given to providing technology solutions that help create, conduct, and manage the central task of assessment. Software to manage and conduct assessment presents many challenges. This article examines a stand-alone, flexible software environment designed to provide all the tools required to view, mark, store, and deliver results efficiently while improving the feedback to the students. A description of the software and its functions, the techniques and methods developed to overcome the limitations that software presents when used to conduct assessment is examined. Case studies are presented that describe: (a) the types of assessment the software has been used to conduct and manage; (b) the types of problems that were encountered; and (c) the solutions and techniques that were discovered and used to overcome the problems.

A multi-objective sensitivity approach to training providers' evaluation and quota allocation planning

The practice of solely relying on the human resources department in the selection process of external training providers has cast doubts and mistrust across other departments as to how trainers are sourced. There are no measurable criteria used by human resource personnel, since most decisions are based on intuitive experience and subjective market knowledge. The present problem focuses on outsourcing of private training programs that are partly government funded, which has been facing accountability challenges. Due to the unavailability of a scientific decision-making approach in this context, a 12-step algorithm is proposed and tested in a Japanese multinational company. The model allows the decision makers to revise their criteria expectations, in turn witnessing the change of the training providers' quota distribution. Finally, this multi-objective sensitivity analysis provides a forward-looking approach to training needs planning and aids decision makers in their sourcing strategy.

Towards a semantic quality based approach for business process models improvement

Business process (BP) modeling aims at a better understanding of processes, allowing deciders to improve them. We propose to support this modeling with an approach encompassing methods and tools for BP models quality measurement and improvement. In this paper we focus on semantic quality. The latter is evaluated by aligning BP model concepts with domain knowledge. The alignment is conducted thanks to meta-models. We also define validation rules for checking the completeness of BP models. A medical case study illustrates the main steps of our approach.

Performance evaluation of multi-frame super-resolution algorithms

Multi-frame super-resolution algorithms aim to increase spatial resolution by fusing information from several low-resolution perspectives of a scene. While a wide array of super-resolution algorithms now exist, the comparative capability of these techniques in practical scenarios has not been adequately explored. In addition, a standard quantitative method for assessing the relative merit of super-resolution algorithms is required. This paper presents a comprehensive practical comparison of existing super-resolution techniques using a shared platform and 4 common greyscale reference images. In total, 13 different super-resolution algorithms are evaluated, and as accurate alignment is critical to the super-resolution process, 6 registration algorithms are also included in the analysis. Pixel-based visual information fidelity (VIFP) is selected from the 12 image quality metrics reviewed as the measure most suited to the appraisal of super-resolved images. Experimental results show that Bayesian super-resolution methods utilizing the simultaneous autoregressive (SAR) prior produce the highest quality images when combined with generalized stochastic Lucas-Kanade optical flow registration.

The factors that affect the cost estimation activities in the tender preparation process in the Malaysian construction industry

The possibility of winning the tender is subject to the cost estimation proposed by the contractors compared to the cost estimation prepared by the client’s representative. Studies indicated that one of the construction company failures in the tendering process is due to the uncertain, incorrect, and unrealistic cost estimation. Failure to provide a competitive cost estimation on time is the main reason the contractor is not successful in winning the tender, and will not be considered for the tender evaluation stage. The aim of this paper is to validate the key factors that affect the cost estimation activities in the tender preparation process. This paper describes the results of a pilot study, from a questionnaire survey on the factors that affect the cost estimation activities in the tender preparation process. The study shows the importance of all the factors in the cost estimation activities in the tender preparation process in terms of human factors, working culture, and information technology.

Evaluation of the intercultural understanding field trial

In 2011, the Innovation and Next Practice Division (INP) of the Department of Education and Early Childhood Development (DEECD) conducted a field trial on intercultural understanding in partnership with a research and evaluation team from the University of Melbourne and La Trobe University. The field trial was sponsored by the Languages, English as another Language (EAL) and Multicultural Education Division of DEECD.

Performance evaluation of e-government services using balance scorecard : an empirical study in Jordan

Purpose - the purpose of this paper is to emphasise on a balance between quantitative and qualitative measures, and examine the use of Balanced Scorecard to evaluate and estimate the performance of information and communication technologies (ICT) in delivering valuable e-government services through the internet. Design/methodology/approach - This study tests the hypotheses of e-government effectiveness using Balanced Scorecard technique by incorporating qualitative measures within a quantitative research methodology with data collected by means of a survey questionnaire. The survey sample of 383 stakeholders includes common customers, employees of e-government, and employees from the IT sector. The survey data were analysed to test the hypothesis in measuring e-government effectiveness from Balanced Scorecard's four dimensions: customer perspective, financial perspective, internal business process perspective, and innovation and learning perspective. Findings - The results show that the Balanced Scorecard factors fit very well with monitoring and measuring the performance of e-government in Jordan, and also in evaluating their success in IT project investments. Originality/value - This study attempts to address this gap in the literature and would benefit future studies in applying Balanced Scorecard for performance evaluation of various IT projects that are gaining huge investments from governments and organisations .

Form versus function : a study into interactive learning process affecting the implementation of sustainability in commercial buildings

Owners and tenants of sustainable buildings are now realising the sustainable building that they own or occupy and also how they use the building have a significant impact on their work practices. These stakeholders are demanding sustainability outcomes such as improved occupant health and performance, lower energy and material consumption use as well as encouraging healthy ecosystem in their sustainable building. Clearly the level of user knowledge about a sustainable building and its technologies makes a difference about the actual behaviour towards sustainable buildings (Knott 2007, Stenberg 2007) There remains two major challenge faced by sustainable building occupants: (i) addressing the gap between an occupant's expectations of sustainable building outcomes and what the building actually provides and (ii) overcoming the lack of user knowledge about sustainability design and operation for a particular with regards to performance (Jailani et. al, 2011). This is an innovative study designed to address these challenges. It uses a focus group approach to investigate the gap between (a) user expectations and (b) sustainable building performance, with reference to the relationship between interactive learning process and the level of implementation of sustainability in commercial buildings. The outcome from the study will provide a post-occupancy evaluation of the perception of occupants in sustainable buildings. Most importantly, this information can then assist architects and designers in private and government organisations to successfully develop future sustainable design and policy which can fully capitalise on the original intention when delivering sustainable buildings, as well as providing an innovative feedback mechanism between occupiers and architects.

A hazardous substance exposure prevention rating method for intervention needs assessment and effectiveness evaluation: the small business exposure index

Aims This paper describes the refinement and adaptation to small business of a previously developed method for systematically prioritizing needs for intervention on hazardous substance exposures in manufacturing worksites, and evaluating intervention effectiveness. Methods We developed a checklist containing six unique sets of yes/no variables organized in a 2 × 3 matrix of exposure potential versus exposure protection at three levels corresponding to a simplified hierarchy of controls: materials, processes, and human interface. Each of the six sets of indicator variables was reduced to a high/moderate/low rating. Ratings from the matrix were then combined to generate an exposure prevention 'Small Business Exposure Index' (SBEI) Summary score for each area. Reflecting the hierarchy of controls, material factors were weighted highest, followed by process, and then human interface. The checklist administered by an industrial hygienist during walk-through inspection (N = 149 manufacturing processes/areas in 25 small to medium-sized manufacturing worksites). One area or process per manufacturing department was assessed and rated. A second hygienist independently assessed 36 areas to evaluate inter-rater reliability. Results The SBEI Summary scores indicated that exposures were well controlled in the majority of areas assessed (58% with rating of 1 or 2 on a 6-point scale), that there was some room for improvement in roughly one-third of areas (31% of areas rated 3 or 4), and that roughly 10% of the areas assessed were urgently in need of intervention (rated as 5 or 6). Inter-rater reliability of EP ratings was good to excellent (e.g., for SBEI Summary scores, weighted kappa = 0.73, 95% CI 0.52–0.93). Conclusion The SBEI exposure prevention rating method is suitable for use in small/medium enterprises, has good discriminatory power and reliability, offers an inexpensive method for intervention needs assessment and effectiveness evaluation, and complements quantitative exposure assessment with an upstream prevention focus.

The clinical effectiveness and cost-effectiveness of bariatric (weight loss) surgery for obesity: a systematic review and economic evaluation

To assess the clinical effectiveness and cost-effectiveness of bariatric surgery for obesity. Seventeen electronic databases were searched [MEDLINE; EMBASE; PreMedline In-Process & Other Non-Indexed Citations; The Cochrane Library including the Cochrane Systematic Reviews Database, Cochrane Controlled Trials Register, DARE, NHS EED and HTA databases; Web of Knowledge Science Citation Index (SCI); Web of Knowledge ISI Proceedings; PsycInfo; CRD databases; BIOSIS; and databases listing ongoing clinical trials] from inception to August 2008. Bibliographies of related papers were assessed and experts were contacted to identify additional published and unpublished references. Two reviewers independently screened titles and abstracts for eligibility. Inclusion criteria were applied to the full text using a standard form. Interventions investigated were open and laparoscopic bariatric surgical procedures in widespread current use compared with one another and with non-surgical interventions. Population comprised adult patients with body mass index (BMI) > or = 30 and young obese people. Main outcomes were at least one of the following after at least 12 months follow-up: measures of weight change; quality of life (QoL); perioperative and postoperative mortality and morbidity; change in obesity-related comorbidities; cost-effectiveness. Studies eligible for inclusion in the systematic review for comparisons of Surgery versus Surgery were RCTs. For comparisons of Surgery versus Non-surgical procedures eligible studies were RCTs, controlled clinical trials and prospective cohort studies (with a control cohort). Studies eligible for inclusion in the systematic review of cost-effectiveness were full cost-effectiveness analyses, cost-utility analyses, cost-benefit analyses and cost-consequence analyses. One reviewer performed data extraction, which was checked by two reviewers independently. Two reviewers independently applied quality assessment criteria and differences in opinion were resolved at each stage. Studies were synthesised through a narrative review with full tabulation of the results of all included studies. In the economic model the analysis was developed for three patient populations, those with BMI > or = 40; BMI > or = 30 and < 40 with Type 2 diabetes at baseline; and BMI > or = 30 and < 35. Models were applied with assumptions on costs and comorbidity.

An exposure prevention rating method for intervention needs assessment and effectiveness evaluation

This article describes a new method for (1) systematically prioritizing needs for intervention on hazardous substance exposures in manufacturing work sites, and (2) evaluating intervention effectiveness. We developed a checklist containing six unique sets of yes/no variables organized in a 2 × 3 matrix of exposure potential versus protection (two columns) at the levels of materials, processes, and human interface (three rows). The three levels correspond to a simplified hierarchy of controls. Each of the six sets of indicator variables was reduced to a high/moderate/low rating. Ratings from the matrix were then combined to generate a single overall exposure prevention rating for each area. Reflecting the hierarchy of controls, material factors were weighted highest, followed by process, and then human interface. The checklist was filled out by an industrial hygienist while conducting a walk-through inspection (N = 131 manufacturing processes/areas in 17 large work sites). One area or process per manufacturing department was assessed and rated. Based on the resulting Exposure Prevention ratings, we concluded that exposures were well controlled in the majority of areas assessed (64% with rating of 1 or 2 on a 6-point scale), that there is some room for improvement in 26 percent of areas (rating of 3 or 4), and that roughly 10 percent of the areas assessed are urgently in need of intervention (rated as 5 or 6). A second hygienist independently assessed a subset of areas to evaluate inter-rater reliability. The reliability of the overall exposure prevention ratings was excellent (weighted kappa = 0.84). The rating scheme has good discriminatory power and reliability and shows promise as a broadly applicable and inexpensive tool for intervention needs assessment and effectiveness evaluation. Validation studies are needed as a next step. This assessment method complements quantitative exposure assessment with an upstream prevention focus.

Knowledge-based automatic performance evaluation for medical training debriefing

 Manikin-based medical simulation has been shown to benefit the knowledge, skills and attitudes of the learner, and to impart favourable patient effects. A vital component of any training simulation is the after-session discussion with trainees to debrief their performance. In this study we develop a rule-based debriefing tool for improving the efficacy of medical training sessions. Unlike most existing de-briefing tools, the tool presented here has been designed to reduce medical trainer assessment time and to improve evaluation accuracy through a largely automated evaluation of trainee performance. The developed tool is acknowledged by the School of Medicine of Deakin University as an important advancement in assisting medical trainers carry out the debriefing process effectively and efficiently.

Evaluation of nurses' perceptions of the impact of targeted depression education and a screening and referral tool in an acute cardiac setting.

AIMS AND OBJECTIVES: The aim of this study was to evaluate nurses' perceptions of an education programme and screening and referral tool designed for cardiac nurses to facilitate depression screening and referral procedures for patients with coronary heart disease. BACKGROUND: There is a high prevalence of depression in patients with coronary heart disease that is often undetected. It is important therefore that nurses working with cardiac patients are equipped with the knowledge and skills to recognise the signs and symptoms of depression and refer appropriately. DESIGN: A qualitative approach with purposive sampling and semi-structural interviews was implemented within the Donabedian 'Structure-Process-Outcome' evaluation framework. METHODS: Semi-structured interviews were conducted with 14 cardiac nurses working in a major metropolitan hospital six weeks post-attending an education programme on depression and coronary heart disease. Thematic data analysis was implemented, specifically adhering to Halcomb and Davidson's (2006) pragmatic data analysis, to examine nurse knowledge and experience of depression assessment and referral in an acute cardiac ward. RESULTS: The key findings of this study were that the education programme: (1) increased the knowledge base of nurses working with cardiac patients on comorbid depression and coronary heart disease, and (2) assisted in the identification of depression and the referral of 'at risk' patients. CONCLUSIONS: Emphasis was placed on the translational significance of educating cardiac nurses about depression via the introduction of a depression screening and referral instrument designed specifically for use in the cardiac ward. As a result, participants found they were better equipped to identify depressive symptoms and, guided by the screening instrument, to confidently instigate referral procedures. RELEVANCE TO CLINICAL PRACTICE: Much complexity lies in caring for cardiac patients with depression, including issues such as misdiagnosis. Targeted education, including use of appropriate instruments, has the potential to facilitate early recognition of the signs and symptoms of depression in the acute cardiac setting.

Evaluation of lumbar disc and spine morphology: long-term repeatability and comparison of methods

Establishing the long-term repeatability of quantitative measures of lumbar intervertebral disc and spinal morphology is important for planning interventional studies. We aimed to examine this issue and to determine to what extent a smaller number of measurements per disc or vertebral level could be used to save operator time without compromising measurement precision. Twenty-one healthy male subjects were scanned at baseline and 1.5 years later. On sagittal MR-scans intervertebral disc cross-sectional area, anterior disc height, posterior disc height, intervertebral angle and intervertebral length were measured. The repeatability of the average value from all sagittal images or from 1, 3, 5 or 7 images centred at the spinous process was evaluated. Bland-Altman analysis showed all measurements to be repeatable between testing days. Intervertebral length was the most precise measurement (coefficients of variation [CVs] between 1.2% and 1.5%), followed by disc cross-sectional area (CVs between 2.9% and 3.6%). Variance component analysis showed that using 7 images, but not 1, 3 or 5 images, resulted in a similar level of measurement error as when measurements from all images were included.