Improving the agent selection, release and evaluation process: the role of bioclimatic modelling

The value of CLIMEX models to inform biocontrol programs was assessed, including predicting the potential distribution of biocontrol agents and their subsequent population dynamics, using bioclimatic models for the weed Parkinsonia aculeata, two Lantana camara biocontrol agents, and five Mimosa pigra biocontrol agents. The results showed the contribution of data types to CLIMEX models and the capacity of these models to inform and improve the selection, release and post release evaluation of biocontrol agents. Foremost among these was the quality of spatial and temporal information as well as the extent to which overseas range data samples the species’ climatic envelope. Post hoc evaluation and refinement of these models requires improved long-term monitoring of introduced agents and their dynamics at well selected study sites. The authors described the findings of these case studies, highlighted their implications, and considered how to incorporate models effectively into biocontrol programs.

Enhancing quality in online learning : scaffolding planning and design through proactive evaluation

A major issue confronting educators is the extent to which they wish to conform to so-called paradigm shifts in teaching and learning. In the contemporary world of tertiary education these shifts embrace both pedagogy (from instructivist to constructivist) and technology (from classroom to online). As teachers and learners are faced with the potential of these new learning environments, the extent to which learning outcomes are achieved remains a high priority and subject to a wide range of evaluation strategies. Conventionally, evaluation has been positioned at the end of the instructional development cycle, to assess first whether or not the creative effort achieved the original product goals and second whether or not the desired learning outcomes were realized. In the context of online teaching and learning environments, however, the level of understanding teachers, learners and developers have of the medium can impact the ultimate effectiveness of the product. This paper articulates an additional dimension to post-development evaluation processes in proposing proactive evaluation, a framework that identifies critical online learning factors and influences that will better inform the planning, design and development of learning resources. This notion of proactive evaluation advocates resource development being undertaken where all planning activities are assessed against the evaluation criteria that would normally be applied during formative assessment. By performing these evaluation checks proactively, online learning resources will, in principle, work first time as all relevant factors and issues will have been considered and resolved. More importantly, for those participants who are new to online environments, proactive evaluation will perform a scaffolding and professional development role by enhancing online teaching or learning competencies.

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service

BACKGROUND: Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education.

METHODS/DESIGN: The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up.

DISCUSSION: It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Evaluation of Satisfaction of Patients Rehabilitated With Zygomatic Fixtures

Purpose: The aim of this study was to evaluate the satisfaction of patients rehabilitated with zygomatic fixtures and prosthesis with immediate loading.Materials and Methods: The study selected patients who were rehabilitated with zygomatic implants at the clinic of the Latin American Institute for Dental Research and Education (ILAPEO. Curitiba-PR. Brasil) between 2005 and 2009. The patients were asked to answer a control-questionnaire during their follow-up visits. Data were collected regarding the level of patient satisfaction, reason for dissatisfaction, number of post-operative clinical sessions, and the type of complication. Sixteen patients were selected: 10 females and 6 males.Results: Half of the patients were completely satisfied while the other half were satisfied with some complaints. The complaints were related to hygiene, esthetics, phonetics, and discomfort during chewing. Regarding the post-operative evaluation, 50% of the patients were attended due to the prosthesis (62.5%) and the implant (37.5%).Conclusions: The treatment with zygomatic fixtures is predictable and reliable. The patients were satisfied both with implants and prosthesis. (C) 2012 American Association of Oral and Maxillofacial Surgeons J Oral Maxillofac Surg 70: 314-319, 2012

Evaluation of treatment response after chemoembolisation (TACE) in hepatocellular carcinoma using real time image fusion of contrast-enhanced ultrasound (CEUS) and computed tomography (CT)--preliminary results.

OBJECTIVE To evaluate treatment response of hepatocellular carcinoma (HCC) after transarterial chemoembolization (TACE) with a new real-time imaging fusion technique of contrast-enhanced ultrasound (CEUS) with multi-slice detection computed tomography (CT) in comparison to conventional post-interventional follow-up. MATERIAL AND METHODS 40 patients with HCC (26 male, ages 46-81 years) were evaluated 24 hours after TACE using CEUS with ultrasound volume navigation and image fusion with CT compared to non-enhanced CT and follow-up contrast-enhanced CT after 6-8 weeks. Reduction of tumor vascularization to less than 25% was regarded as "successful" treatment, whereas reduction to levels >25% was considered as "partial" treatment response. Homogenous lipiodol retention was regarded as successful treatment in non-enhanced CT. RESULTS Post-interventional image fusion of CEUS with CT was feasible in all 40 patients. In 24 patients (24/40), post-interventional image fusion with CEUS revealed residual tumor vascularity, that was confirmed by contrast-enhanced CT 6-8 weeks later in 24/24 patients. In 16 patients (16/40), post-interventional image fusion with CEUS demonstrated successful treatment, but follow-up CT detected residual viable tumor (6/16). Non-enhanced CT did not identify any case of treatment failure. Image fusion with CEUS assessed treatment efficacy with a specificity of 100%, sensitivity of 80% and a positive predictive value of 1 (negative predictive value 0.63). CONCLUSIONS Image fusion of CEUS with CT allows a reliable, highly specific post-interventional evaluation of embolization response with good sensitivity without any further radiation exposure. It can detect residual viable tumor at early state, resulting in a close patient monitoring or re-therapy.

Use of empowerment evaluation to determine a sustainability plan for a community-based preconception care program

Women With IMPACT (WWI) is a community-based preconception care educational intervention. WWI is being implemented by the Impacting Maternal and Prenatal Care Together (IMPACT) Collaborative and targets zip codes in Harris County, Texas at high risk for infant mortality, low birthweight, and preterm birth. WWI started March 2012 and continues through August 2013. Three workshop series are planned. This study was conducted with participants and facilitators from the first workshop series. This study aimed to 1) evaluate the WWI program using empowerment evaluation, 2) engage all WWI stakeholders in an empowerment evaluation so the method could be adopted as a participatory evaluation process for future IMPACT activities, and 3) develop recommendations for sustainability of the WWI intervention, based on empowerment evaluation findings and results from the pre/post program evaluation completed by WWI participants. Study participants included WWI participants and facilitators and IMPACT Collaborative Steering Committee members. WWI participants were female, 18-35 year-old, non-pregnant residents of zip codes at high risk of adverse birth outcomes. All other study participants were 18 years or older. A two-phased empowerment evaluation (EE) was utilized in this study. Sessions 1-4 were conducted independently of one another – 3 with participants at different sites and one with the facilitators. The fifth session included WWI participant and facilitator representatives, and IMPACT Steering Committee members. Session 5 built upon the work of the other sessions. Observation notes were recorded during each session. Thematic content analysis was conducted on all EE tables and observation notes. Mission statements drafted by each group focused on improvement of physical and mental health through behavior change and empowerment of all participants. The top 5 overall program components were: physical activity, nutrition, self-worth, in-class communication, and stress. Goals for program improvement were set by EE participants for each of these components. Through thematic content analysis of the tables and observation notes, social support emerged as an important theme of the program among all participant groups. Change to a healthy lifestyle emerged as an important theme in terms of program improvement. Two-phased EE provided an opportunity for all program stakeholders to provide feedback regarding important program components and provide suggestions for program improvement. EE, thematic content analysis, pre/post evaluation results, and inherent program knowledge were triangulated to make recommendations to sustain the program once the initial funding ends. ^

The evaluation of information systems in the organisational context of the National Health Service. Available in 2 volumes.

This thesis describes a project which has investigated the evaluation of information systems. The work took place in, and is related to, a specific organisational context, that of the National Health Service (NHS). It aims to increase understanding of the evaluation which takes place in the service and the way in which this is affected by the NHS environment. It also investigates the issues which surround some important types of evaluation and their use in this context. The first stage of the project was a postal survey in which respondents were asked to describe the evaluation which took place in their authorities and to give their opinions about it. This was used to give an overview of the practice of IS evaluation in the NHS and to identify its uses and the problems experienced. Three important types of evaluation were then examined in more detail by means of action research studies. One of these dealt with the selection and purchase of a large hospital information system. The study took the form of an evaluation of the procurement process, and examined the methods used and the influence of organisational factors. The other studies are concerned with post-implementation evaluation, and examine the choice of an evaluation approach as well as its application. One was an evaluation of a community health system which had been operational for some time but was of doubtful value, and suffered from a number of problems. The situation was explored by means of a study of the costs and benefits of the system. The remaining study was the initial review of a system which was used in the administration of a Breast Screening Service. The service itself was also newly operational and the relationship between the service and the system was of interest.

Two Thai teachers' perceptions of cooperative learning

Over the past decade, the need for educational reform in Thailand has become increasingly apparent. The strong tradition of teacher-directed instruction has been the major teaching and learning style in Thai education. Recent policy changes have focused on expanding education opportunities, the implementation of compulsory education and also on more student-centered pedagogies (Carter, 2006). A suggested way of bringing about the changes necessary to improve the standard of education in primary schools and retention rates is to incorporate cooperative learning into Thai primary school classrooms. The action research in this study proceeded in four stages. There were pre-implementation interviews of teachers, teacher preparation, implementation of program, and post-implementation evaluation. This study focused on the two Thai teachers' perceptions about the benefits of cooperative learning and the roles of the teachers in cooperative learning classroom. The study found that the two teachers had constructed different levels of perceptions about the benefits of cooperative learning and the roles of the teacher. These findings indicated that Thai teachers who are relatively inexperienced, lacking in confidence and with little or no experience with group work strategies such as peer tutoring need alternative, less intense professional development programs conducted over a period of a semester than the professional development program implemented in this study. In addition to being conducted over a longer period of time, the findings also indicate that alternative teacher professional programs need to provide additional workshops to improve their understanding of cooperative learning and the teachers' roles.

Evaluating information systems

The book within which this chapter appears is published as a research reference book (not a coursework textbook) on Management Information Systems (MIS) for seniors or graduate students in Chinese universities. It is hoped that this chapter, along with the others, will be helpful to MIS scholars and PhD/Masters research students in China who seek understanding of several central Information Systems (IS) research topics and related issues. The subject of this chapter - ‘Evaluating Information Systems’ - is broad, and cannot be addressed in its entirety in any depth within a single book chapter. The chapter proceeds from the truism that organizations have limited resources and those resources need to be invested in a way that provides greatest benefit to the organization. IT expenditure represents a substantial portion of any organization’s investment budget and IT related innovations have broad organizational impacts. Evaluation of the impact of this major investment is essential to justify this expenditure both pre- and post-investment. Evaluation is also important to prioritize possible improvements. The chapter (and most of the literature reviewed herein) admittedly assumes a blackbox view of IS/IT1, emphasizing measures of its consequences (e.g. for organizational performance or the economy) or perceptions of its quality from a user perspective. This reflects the MIS emphasis – a ‘management’ emphasis rather than a software engineering emphasis2, where a software engineering emphasis might be on the technical characteristics and technical performance. Though a black-box approach limits diagnostic specificity of findings from a technical perspective, it offers many benefits. In addition to superior management information, these benefits may include economy of measurement and comparability of findings (e.g. see Part 4 on Benchmarking IS). The chapter does not purport to be a comprehensive treatment of the relevant literature. It does, however, reflect many of the more influential works, and a representative range of important writings in the area. The author has been somewhat opportunistic in Part 2, employing a single journal – The Journal of Strategic Information Systems – to derive a classification of literature in the broader domain. Nonetheless, the arguments for this approach are believed to be sound, and the value from this exercise real. The chapter drills down from the general to the specific. It commences with a highlevel overview of the general topic area. This is achieved in 2 parts: - Part 1 addressing existing research in the more comprehensive IS research outlets (e.g. MISQ, JAIS, ISR, JMIS, ICIS), and Part 2 addressing existing research in a key specialist outlet (i.e. Journal of Strategic Information Systems). Subsequently, in Part 3, the chapter narrows to focus on the sub-topic ‘Information Systems Success Measurement’; then drilling deeper to become even more focused in Part 4 on ‘Benchmarking Information Systems’. In other words, the chapter drills down from Parts 1&2 Value of IS, to Part 3 Measuring Information Systems Success, to Part 4 Benchmarking IS. While the commencing Parts (1&2) are by definition broadly relevant to the chapter topic, the subsequent, more focused Parts (3 and 4) admittedly reflect the author’s more specific interests. Thus, the three chapter foci – value of IS, measuring IS success, and benchmarking IS - are not mutually exclusive, but, rather, each subsequent focus is in most respects a sub-set of the former. Parts 1&2, ‘the Value of IS’, take a broad view, with much emphasis on ‘the business Value of IS’, or the relationship between information technology and organizational performance. Part 3, ‘Information System Success Measurement’, focuses more specifically on measures and constructs employed in empirical research into the drivers of IS success (ISS). (DeLone and McLean 1992) inventoried and rationalized disparate prior measures of ISS into 6 constructs – System Quality, Information Quality, Individual Impact, Organizational Impact, Satisfaction and Use (later suggesting a 7th construct – Service Quality (DeLone and McLean 2003)). These 6 constructs have been used extensively, individually or in some combination, as the dependent variable in research seeking to better understand the important antecedents or drivers of IS Success. Part 3 reviews this body of work. Part 4, ‘Benchmarking Information Systems’, drills deeper again, focusing more specifically on a measure of the IS that can be used as a ‘benchmark’3. This section consolidates and extends the work of the author and his colleagues4 to derive a robust, validated IS-Impact measurement model for benchmarking contemporary Information Systems (IS). Though IS-Impact, like ISS, has potential value in empirical, causal research, its design and validation has emphasized its role and value as a comparator; a measure that is simple, robust and generalizable and which yields results that are as far as possible comparable across time, across stakeholders, and across differing systems and systems contexts.

Effectiveness of constructability concept in the provision of infrastructure assets

The concept of constructability is to use construction knowledge and experience during all phases of a project, particularly in the earliest phases of planning and design. It facilitates project objectives before delivery stage, and decreases unnecessary costs during construction phase. Despite the extensive use, constructability concept fails to address many issues related to Operation and Maintenance (O&M) of construction projects. Extending constructability concept, to include the O&M issues, could lead to the projects that are not fitted for construction purposes only, but also fitted for use. This study reviews the literature of constructability implementation, its benefits and shortcomings during the infrastructure life cycle, as well as the delivery success factors of infrastructure projects. This contributes to the propose need of a model to improve the effectiveness and efficiency of infrastructure project by extending the concept of constructability to include O&M. Development of such a model can facilitate post-occupancy stakeholders’ participation in a constructability program. It will help infrastructure owners eliminate project reworks, and improve O&M effectiveness and efficiency.

Extending constructability concept to include operation and maintenance issues

The concept of constructability uses integration art of individual functions through a valuable and timely construction inputs into planning and design development stages. It results in significant savings in cost and time needed to finalize infrastructure projects. However, available constructability principles, developed by CII Australia (1993), do not cover Operation and Maintenance (O&M) phases of projects, whilst major cost and time in multifaceted infrastructure projects are spent in post-occupancy stages. This paper discusses the need to extend the constructability concept by examining current O&M issues in the provision of multifaceted building projects. It highlights available O&M problems and shortcomings of building projects, as well as their causes and reasons in different categories. This initial categorization is an efficient start point for testing probable present O&M issues in various cases of complex infrastructure building projects. This preliminary categorization serve as a benchmark to develop an extended constructability model that considers the whole project life cycle phases rather than a specific phase. It anticipates that the development of an extended constructability model can reduce significant number of reworks, mistakes, extra costs and time wasted during delivery stages of multifaceted building projects.

A survey to evaluate the implementation of a national clinical assessment form

Purpose: The Australian Universities Radiation Therapy Student Clinical Assessment Form (AURTSCAF) was designed to assess the clinical skills of radiation therapy (RT) students from the six universities that offer entry level RT programs. Given the AURTSCAF has now been in use for over two years, the Radiation Therapy Program Coordinators (RTPC) group initiated a post implementation evaluation survey. This formed the final phase of the AURTSCAF project and was funded by the Radiation Oncology Division of the Department of Health and Ageing. Methods: A cross-sectional designed survey using purposive sampling was distributed via email to all RT clinical sites. The survey asked questions about the requirements of a pass grade for students at different stages of their program, and the addition of a new category of assessment related to fitness to practise. Response types included both forced choice closed ended responses and open ended responses. There was also a section for open comments about the AURTSCAF. Results: There were 100 responses (55%) from clinicians who had utilised the assessment form over the previous 12 month period. Responses highlighted several positives with regard to the utility and implementation of the form. Comments regarding areas for improvement with the standardisation of the grading of students and consensus for the addition of a new domain in fitness for practise have informed the recommended changes proposed for 2012. Conclusion: This evaluation has provided a representative sample of the views of clinicians involved in assessing students on clinical placement. Recommendations include the addition of the sixth domain of assessment: Fitness for practise, the addition of descriptors and prompts for this domain in the user guide, the addition of a consensus statement about the use of the rating scale and dissemination of the proposed changes nationally.

A multidimensional model of client success when engaging external consultants

Too often the relationship between client and external consultants is perceived as one of protagonist versus antogonist. Stories on dramatic, failed consultancies abound, as do related anecdotal quips. A contributing factor to many "apparently" failed consultancies is a poor appreciation by both the client and consultant of the client's true goals for the project and how to assess progress toward these goals. This paper presents and analyses a measurement model for assessing client success when engaging an external consultant. Three main areas of assessment are identified: (1) the consultant;s recommendations, (2) client learning, and (3) consultant performance. Engagement success is emperically measured along these dimensions through a series of case studies and a subsequent survey of clients and consultants involved in 85 computer-based information system selection projects. Validation fo the model constructs suggests the existence of six distinct and individually important dimensions of engagement success. both clients and consultants are encouraged to attend to these dimensions in pre-engagement proposal and selection processes, and post-engagement evaluation of outcomes.

Extension of constructability to include operation and maintenance for infrastructure projects

This project was a step forward in developing an extension of the concept of constructability to include the post-occupancy stages of operation and maintenance. This was through an in-depth study of Australian health projects and interviews with professionals in the field. The thesis investigated how the operation and maintenance stakeholders can enter the initial planning, design and construction phases resulting in more efficient and effective delivery of infrastructure projects.

Review of approaches to evaluate the effectiveness of weed biological control agents

We review key issues, available approaches and analyses to encourage and assist practitioners to develop sound plans to evaluate the effectiveness of weed biological control agents at various phases throughout a program. Assessing the effectiveness of prospective agents before release assists the selection process, while post-release evaluation aims to determine the extent that agents are alleviating the ecological, social and economic impacts of the weeds. Information gathered on weed impacts prior to the initiation of a biological control program is necessary to provide baseline data and devise performance targets against which the program can subsequently be evaluated. Detailed data on weed populations, associated plant communities and, in some instances ecosystem processes collected at representative sites in the introduced range several years before the release of agents can be compared with similar data collected later to assess agent effectiveness. Laboratory, glasshouse and field studies are typically used to assess agent effectiveness. While some approaches used for field studies may be influenced by confounding factors, manipulative experiments where agents are excluded (or included) using chemicals or cages are more robust but time-consuming and expensive to implement. Demographic modeling and benefit–cost analyses are increasingly being used to complement other studies. There is an obvious need for more investment in long-term post-release evaluation of agent effectiveness to rigorously document outcomes of biological control programs.