Planning and evaluation

- identify the importance of planning and evaluation in public health practice - recognise the links between planning and evaluation through the presentation of relevant models - identify the core concepts of needs assessment in public health - describe the evaluation cycle and the importance of an evaluation plan - understand evaluation designs and their application in practice.

Evaluation of modal analysis techniques using physical models to detect osseointegration of implants in transfemoral amputees

Non-invasive vibration analysis has been used extensively to monitor the progression of dental implant healing and stabilization. It is now being considered as a method to monitor femoral implants in transfemoral amputees. This paper evaluates two modal analysis excitation methods and investigates their capabilities in detecting changes at the interface between the implant and the bone that occur during osseointegration. Excitation of bone-implant physical models with the electromagnetic shaker provided higher coherence values and a greater number of modes over the same frequency range when compared to the impact hammer. Differences were detected in the natural frequencies and fundamental mode shape of the model when the fit of the implant was altered in the bone. The ability to detect changes in the model dynamic properties demonstrates the potential of modal analysis in this application and warrants further investigation.

Evaluation of silk sericin as a biomaterial: In vitro growth of human corneal limbal epithelial cells on Bombyx mori sericin membranes

Sericin and fibroin are the two major proteins in the silk fibre produced by the domesticated silkworm, Bombyx mori. Fibroin has been extensively investigated as a biomaterial. We have previously shown that fibroin can function successfully as a substratum for growing cells of the eye. Sericin has been so far neglected as a biomaterial because of suspected allergenic activity. However, this misconception has now been dispelled, and sericin’s biocompatibility is currently indisputable. Aiming at promoting sericin as a possible substratum for the growth of corneal cells in order to make tissue-engineered constructs for the restoration of the ocular surface, in this study we investigated the attachment and growth in vitro of human corneal limbal epithelial cells (HLECs) on sericin-based membranes. Sericin was isolated and regenerated from the silkworm cocoons by an aqueous procedure, manufactured into membranes, and characterized (mechanical properties, structural analysis, contact angles). Primary cell cultures from two donors were established in serum-supplemented media in the presence of murine feeder cells. Membranes made of sericin and fibroin-sericin blends were assessed in vitro as substrata for HLECs in a serum-free medium, in a cell attachment assay and in a 3-day cell growth experiment. While the mechanical characteristics of sericin were found to be inferior to those of fibroin, its ability to enhance the attachment of HLECs was significantly superior to fibroin, as revealed by the PicoGreen® assay. Evidence was also obtained that cells can grow and differentiate on these substrata.

Evaluation of novel Streptococcus pyogenes vaccine candidates incorporating multiple conserved sequences from the C-repeat region of the M-protein

A major challenge for Streptococcus pyogenes vaccine development is the identification of epitopes that confer protection from infection by multiple S. pyogenes M-types. Here we have identified and characterised the distribution of common variant sequences from individual repeat units of the C-repeat region (CRR) of M-proteins representing 77 different M-types. Three polyvalent fusion vaccine candidates (SV1, SV2 and SV3) incorporating the most common variants were subsequently expressed and purified, and demonstrated to be alpha-helical by Circular Dichroism (CD), a secondary conformational characteristic of the CRR in the M-protein. Antibodies raised against each of these constructs recognise M-proteins that vary in their CRR, and bind to the surface of multiple S. pyogenes isolates. Antibodies raised against SV1, containing five variant sequences, also kill heterologous S. pyogenes isolates in in vitro bactericidal assays. Further structural characterisation of this construct demonstrated the conformation of SV1 was stable at different pHs, and thermal unfolding of SV1 a reversible process. Our findings demonstrate that linkage of multiple variant sequences into a single recombinant construct overcomes the need to embed the variant sequences in foreign helix promoting flanking sequences for conformational stability, and demonstrates the viability of the polyvalent candidates as global S. pyogenes vaccine candidates.

Pre-clinical evaluation of amphiphilic silicone oligomers for scar remediation

The formation of hypertrophic scars is a frequent outcome of wound repair and often requires further therapy with treatments such as silicone gel sheets (SGS; Perkins et al., 1983). Although widely used, knowledge regarding SGS and their mechanism of action on hypertrophic scars is limited. Furthermore, SGS require consistent application for at least twelve hours a day for up to twelve consecutive months, beginning as soon as wound reepithelialisation has occurred. Preliminary research at QUT has shown that some species of silicone present in SGS have the ability to permeate into collagen gel skin mimetics upon exposure. An analogue of these species, GP226, was found to decrease both collagen synthesis and the total amount of collagen present following exposure to cultures of cells derived from hypertrophic scars. This silicone of interest was a crude mixture of silicone species, which resolved into five fractions of different molecular weight. These five fractions were found to have differing effects on collagen synthesis and cell viability following exposure to fibroblasts derived from hypertrophic scars (HSF), keloid scars (KF) and normal skin (nHSF and nKF). The research performed herein continues to further assess the potential of GP226 and its fractions for scar remediation by determining in more detail its effects on HSF, KF, nHSF, nKF and human keratinocytes (HK) in terms of cell viability and proliferation at various time points. Through these studies it was revealed that Fraction IV was the most active fraction as it induced a reduction in cell viability and proliferation most similar to that observed with GP226. Cells undergoing apoptosis were also detected in HSF cultures exposed to GP226 and Fraction IV using the Tunel assay (Roche). These investigations were difficult to pursue further as the fractionation process used for GP226 was labour-intensive and time inefficient. Therefore a number of silicones with similar structure to Fraction IV were synthesised and screened for their effect following application to HSF and nHSF. PDMS7-g-PEG7, a silicone-PEG copolymer of low molecular weight and low hydrophilic-lipophilic balance factor, was found to be the most effective at reducing cell proliferation and inducing apoptosis in cultures of HSF, nHSF and HK. Further studies investigated gene expression through microarray and superarray techniques and demonstrated that many genes are differentially expressed in HSF following treatment with GP226, Fraction IV and PDMS7-g-PEG7. In brief, it was demonstrated that genes for TGFβ1 and TNF are not differentially regulated while genes for AIFM2, IL8, NSMAF, SMAD7, TRAF3 and IGF2R show increased expression (>1.8 fold change) following treatment with PDMS7-g-PEG7. In addition, genes for αSMA, TRAF2, COL1A1 and COL3A1 have decreased expression (>-1.8 fold change) following treatment with GP226, Fraction IV and PDMS7-g-PEG7. The data obtained suggest that many different pathways related to apoptosis and collagen synthesis are affected in HSF following exposure to PDMS7-g-PEG7. The significance is that silicone-PEG copolymers, such as GP226, Fraction IV and PDMS7-g-PEG7, could potentially be a non-invasive substitute to apoptosis-inducing chemical agents that are currently used as scar treatments. It is anticipated that these findings will ultimately contribute to the development of a novel scar therapy with faster action and improved outcomes for patients suffering from hypertrophic scars.

Evaluation cortical bone elasticity in response to pulse power excitation using ultrasonic technique

This paper presents the ultrasonic velocity measurement method which investigates the possible effects of high voltage high frequency pulsed power on cortical bone material elasticity. Before applying a pulsed power signal on a live bone, it is essential to determine the safe parameters of pulsed power applied on bone non-destructively. Therefore, the possible changes in cortical bone material elasticity due to a specified pulsed power excitation have been investigated. A controllable positive buck-boost converter with adjustable output voltage and frequency has been used to generate high voltage pulses (500V magnitude at 10 KHz frequency). To determine bone elasticity, an ultrasonic velocity measurement has been conducted on two groups of control (unexposed to pulse power but in the same environmental condition) and cortical bone samples exposed to pulsed power. Young’s modulus of cortical bone samples have been determined and compared before and after applying the pulsed power signal. After applying the high voltage pulses, no significant variation in elastic property of cortical bone specimens was found compared to the control. The result shows that pulsed power with nominated parameters can be applied on cortical bone tissue without any considerable negative effect on elasticity of bone material.

Strategic project evaluation for open pit mining ventures using real options and allied econometric techniques

Open pit mine operations are complex businesses that demand a constant assessment of risk. This is because the value of a mine project is typically influenced by many underlying economic and physical uncertainties, such as metal prices, metal grades, costs, schedules, quantities, and environmental issues, among others, which are not known with much certainty at the beginning of the project. Hence, mining projects present a considerable challenge to those involved in associated investment decisions, such as the owners of the mine and other stakeholders. In general terms, when an option exists to acquire a new or operating mining project, , the owners and stock holders of the mine project need to know the value of the mining project, which is the fundamental criterion for making final decisions about going ahead with the venture capital. However, obtaining the mine project’s value is not an easy task. The reason for this is that sophisticated valuation and mine optimisation techniques, which combine advanced theories in geostatistics, statistics, engineering, economics and finance, among others, need to be used by the mine analyst or mine planner in order to assess and quantify the existing uncertainty and, consequently, the risk involved in the project investment. Furthermore, current valuation and mine optimisation techniques do not complement each other. That is valuation techniques based on real options (RO) analysis assume an expected (constant) metal grade and ore tonnage during a specified period, while mine optimisation (MO) techniques assume expected (constant) metal prices and mining costs. These assumptions are not totally correct since both sources of uncertainty—that of the orebody (metal grade and reserves of mineral), and that about the future behaviour of metal prices and mining costs—are the ones that have great impact on the value of any mining project. Consequently, the key objective of this thesis is twofold. The first objective consists of analysing and understanding the main sources of uncertainty in an open pit mining project, such as the orebody (in situ metal grade), mining costs and metal price uncertainties, and their effect on the final project value. The second objective consists of breaking down the wall of isolation between economic valuation and mine optimisation techniques in order to generate a novel open pit mine evaluation framework called the ―Integrated Valuation / Optimisation Framework (IVOF)‖. One important characteristic of this new framework is that it incorporates the RO and MO valuation techniques into a single integrated process that quantifies and describes uncertainty and risk in a mine project evaluation process, giving a more realistic estimate of the project’s value. To achieve this, novel and advanced engineering and econometric methods are used to integrate financial and geological uncertainty into dynamic risk forecasting measures. The proposed mine valuation/optimisation technique is then applied to a real gold disseminated open pit mine deposit to estimate its value in the face of orebody, mining costs and metal price uncertainties.

Personalised search – a hybrid approach for web information retrieval and its evaluation

Nowadays, everyone can effortlessly access a range of information on the World Wide Web (WWW). As information resources on the web continue to grow tremendously, it becomes progressively more difficult to meet high expectations of users and find relevant information. Although existing search engine technologies can find valuable information, however, they suffer from the problems of information overload and information mismatch. This paper presents a hybrid Web Information Retrieval approach allowing personalised search using ontology, user profile and collaborative filtering. This approach finds the context of user query with least user’s involvement, using ontology. Simultaneously, this approach uses time-based automatic user profile updating with user’s changing behaviour. Subsequently, this approach uses recommendations from similar users using collaborative filtering technique. The proposed method is evaluated with the FIRE 2010 dataset and manually generated dataset. Empirical analysis reveals that Precision, Recall and F-Score of most of the queries for many users are improved with proposed method.

Understanding evaluation of learning support in mathematics and statistics

With rapid and continuing growth of learning support initiatives in mathematics and statistics found in many parts of the world, and with the likelihood that this trend will continue, there is a need to ensure that robust and coherent measures are in place to evaluate the effectiveness of these initiatives. The nature of learning support brings challenges for measurement and analysis of its effects. After briefly reviewing the purpose, rationale for, and extent of current provision, this article provides a framework for those working in learning support to think about how their efforts can be evaluated. It provides references and specific examples of how workers in this field are collecting, analysing and reporting their findings. The framework is used to structure evaluation in terms of usage of facilities, resources and services provided, and also in terms of improvements in performance of the students and staff who engage with them. Very recent developments have started to address the effects of learning support on the development of deeper approaches to learning, the affective domain and the development of communities of practice of both learners and teachers. This article intends to be a stimulus to those who work in mathematics and statistics support to gather even richer, more valuable, forms of data. It provides a 'toolkit' for those interested in evaluation of learning support and closes by referring to an on-line resource being developed to archive the growing body of evidence. © 2011 Taylor & Francis.

Practical decision support system evaluation for consultant selection

The widespread development of Decision Support System (DSS) in construction indicate that the evaluation of software become more important than before. However, it is identified that most research in construction discipline did not attempt to assess its usability. Therefore, little is known about the approach on how to properly evaluate a DSS for specific problem. In this paper, we present a practical framework that can be guidance for DSS evaluation. It focuses on how to evaluate software that is dedicatedly designed for consultant selection problem. The framework features two main components i.e. Sub-system Validation and Face Validation. Two case studies of consultant selection at Malaysian Department of Irrigation and Drainage were integrated in this framework. Some inter-disciplinary area such as Software Engineering, Human Computer Interaction (HCI) and Construction Project Management underpinned the discussion of the paper. It is anticipated that this work can foster better DSS development and quality decision making that accurately meet the client’s expectation and needs

Technology transfer evaluation in the high technology industry : an interdisciplinary perspective

The underlying objective of this study was to develop a novel approach to evaluate the potential for commercialisation of a new technology. More specifically, this study examined the 'ex-ante'. evaluation of the technology transfer process. For this purpose, a technology originating from the high technology sector was used. The technology relates to the application of software for the detection of weak signals from space, which is an established method of signal processing in the field of radio astronomy. This technology has the potential to be used in commercial and industrial areas other than astronomy, such as detecting water leakages in pipes. Its applicability to detecting water leakage was chosen owing to several problems with detection in the industry as well as the impact it can have on saving water in the environment. This study, therefore, will demonstrate the importance of interdisciplinary technology transfer. The study employed both technical and business evaluation methods including laboratory experiments and the Delphi technique to address the research questions. There are several findings from this study. Firstly, scientific experiments were conducted and these resulted in a proof of concept stage of the chosen technology. Secondly, validation as well as refinement of criteria from literature that can be used for „ex-ante. evaluation of technology transfer has been undertaken. Additionally, after testing the chosen technology.s overall transfer potential using the modified set of criteria, it was found that the technology is still in its early stages and will require further development for it to be commercialised. Furthermore, a final evaluation framework was developed encompassing all the criteria found to be important. This framework can help in assessing the overall readiness of the technology for transfer as well as in recommending a viable mechanism for commercialisation. On the whole, the commercial potential of the chosen technology was tested through expert opinion, thereby focusing on the impact of a new technology and the feasibility of alternate applications and potential future applications.

Patterns-based evaluation of open source BPM systems: The cases of jBPM, OpenWFE, and Enhydra Shark

In keeping with the proliferation of free software development initiatives and the increased interest in the business process management domain, many open source workflow and business process management systems have appeared during the last few years and are now under active development. This upsurge gives rise to two important questions: What are the capabilities of these systems? and How do they compare to each other and to their closed source counterparts? In other words: What is the state-of-the-art in the area?. To gain an insight into these questions, we have conducted an in-depth analysis of three of the major open source workflow management systems – jBPM, OpenWFE, and Enhydra Shark, the results of which are reported here. This analysis is based on the workflow patterns framework and provides a continuation of the series of evaluations performed using the same framework on closed source systems, business process modelling languages, and web-service composition standards. The results from evaluations of the three open source systems are compared with each other and also with the results from evaluations of three representative closed source systems: Staffware, WebSphere MQ, and Oracle BPEL PM. The overall conclusion is that open source systems are targeted more toward developers rather than business analysts. They generally provide less support for the patterns than closed source systems, particularly with respect to the resource perspective, i.e. the various ways in which work is distributed amongst business users and managed through to completion.

Understanding IT business value creation and evaluation in least developed economies

Information Technology (IT) is an important resource that can facilitate growth and development in both the developed and developing economies. The forces of globalisation increase the digital divide between the developed and developing economies is increasing. The least developed economies (LDEs) are the most vulnerable within this environment. Intense competition for IT resources means that LDEs need a deeper understanding of how to source and evaluate their IT-related efforts. This effort puts LDEs in a better position to source funding from various stakeholders and promote localized investment in IT. This study presents a complementary approach to securing better IT-related business value in organizations in the LDEs. It further evaluates how IT and the complementaries need to managed within the LDEs. Analysis of data collected from five LDEs show that organizations that invest in IT and related complementaries are able to better their business processes. The data also suggest that improved business processes lead to overall business processes improvements. The above is only possible if organizations adopt IT and make related changes in the complementary resources within the established culture and localizing the required changes.

Evaluation of design-builder qualifications through the analysis of Requests for Qualifications (RFQs)

The two-phrase best-value process has been widely used by public agencies for Design and Build (DB) procurement, with a key issue in the first phase of pre-qualification being the determination of evaluation criteria. This study identified a set of general qualification criteria for design-builders and compares their relative importance by a thorough content analysis of 97 Requests for Qualification (RFQ) for public DB projects advertised between 2000 and 2011 in various regions of the USA. The thirty-nine qualification criteria found are summarized and classified into eight categories comprising: experience; project understanding and approach; organizational structure and capacity; past performance record; professional qualifications; responsiveness to RFQs, office location and familiarity with local environment; and legal status in descending order of their relative importance. A comparative analysis of different types of projects shows that the relative weightings of the qualification criteria vary according to different characteristics of the DB projects involved.

Developing a fuzzy multi-criteria decision-making model for selecting design-build operational variations

Many academic researchers have conducted studies on the selection of design-build (DB) delivery method; however, there are few studies on the selection of DB operational variations, which poses challenges to many clients. The selection of DB operational variation is a multi-criteria decision making process that requires clients to objectively evaluate the performance of each DB operational variation with reference to the selection criteria. This evaluation process is often characterized by subjectivity and uncertainty. In order to resolve this deficiency, the current investigation aimed to establish a fuzzy multicriteria decision-making (FMCDM) model for selecting the most suitable DB operational variation. A three-round Delphi questionnaire survey was conducted to identify the selection criteria and their relative importance. A fuzzy set theory approach, namely the modified horizontal approach with the bisector error method, was applied to establish the fuzzy membership functions, which enables clients to perform quantitative calculations on the performance of each DB operational variation. The FMCDM was developed using the weighted mean method to aggregate the overall performance of DB operational variations with regard to the selection criteria. The proposed FMCDM model enables clients to perform quantitative calculations in a fuzzy decision-making environment and provides a useful tool to cope with different project attributes.