Evaluation in health outcomes research : linking theories, methodologies and practice in health promotion.

Health outcomes research has developed as a means of evaluating the effectiveness of health care interventions and as an approach to informing resource allocation. The use of a health outcomes approach in health promotion has made increasing demands on evaluation methodologies to demonstrate program effectiveness. However, criticism of the contribution of health promotion to outcomes research has made several assumptions about the use of qualitative methodologies and the content of program objectives largely derived from a biomedical approach. In contrast to the measurement of biomedical interventions in clinical health care, health promotion practice involves social phenomena, wide-reaching cultural, psychological, political and ideological problems and issues. The integration of methodologies of health promotion evaluation will inform further conceptualisation of the health outcomes approach with the differentiation of three types of outcomes: health development outcomes; social health outcomes; and biomedical health outcomes. It is concluded that this differentiation moves away from dualist concepts that advocate the replacement of goals and targets with regional and locally based approaches. Rather, the future direction for health promotion evaluation needs to employ a framework that elaborates multiple methodologies and approaches necessary for establishing what relationships exist between morbidity, mortality, health advancement and equity.

Multi-criteria ranking and source apportionment of airborne particulate matter

Particulate matter research is essential because of the well known significant adverse effects of aerosol particles on human health and the environment. In particular, identification of the origin or sources of particulate matter emissions is of paramount importance in assisting efforts to control and reduce air pollution in the atmosphere. This thesis aims to: identify the sources of particulate matter; compare pollution conditions at urban, rural and roadside receptor sites; combine information about the sources with meteorological conditions at the sites to locate the emission sources; compare sources based on particle size or mass; and ultimately, provide the basis for control and reduction in particulate matter concentrations in the atmosphere. To achieve these objectives, data was obtained from assorted local and international receptor sites over long sampling periods. The samples were analysed using Ion Beam Analysis and Scanning Mobility Particle Sizer methods to measure the particle mass with chemical composition and the particle size distribution, respectively. Advanced data analysis techniques were employed to derive information from large, complex data sets. Multi-Criteria Decision Making (MCDM), a ranking method, drew on data variability to examine the overall trends, and provided the rank ordering of the sites and years that sampling was conducted. Coupled with the receptor model Positive Matrix Factorisation (PMF), the pollution emission sources were identified and meaningful information pertinent to the prioritisation of control and reduction strategies was obtained. This thesis is presented in the thesis by publication format. It includes four refereed papers which together demonstrate a novel combination of data analysis techniques that enabled particulate matter sources to be identified and sampling site/year ranked. The strength of this source identification process was corroborated when the analysis procedure was expanded to encompass multiple receptor sites. Initially applied to identify the contributing sources at roadside and suburban sites in Brisbane, the technique was subsequently applied to three receptor sites (roadside, urban and rural) located in Hong Kong. The comparable results from these international and national sites over several sampling periods indicated similarities in source contributions between receptor site-types, irrespective of global location and suggested the need to apply these methods to air pollution investigations worldwide. Furthermore, an investigation into particle size distribution data was conducted to deduce the sources of aerosol emissions based on particle size and elemental composition. Considering the adverse effects on human health caused by small-sized particles, knowledge of particle size distribution and their elemental composition provides a different perspective on the pollution problem. This thesis clearly illustrates that the application of an innovative combination of advanced data interpretation methods to identify particulate matter sources and rank sampling sites/years provides the basis for the prioritisation of future air pollution control measures. Moreover, this study contributes significantly to knowledge based on chemical composition of airborne particulate matter in Brisbane, Australia and on the identity and plausible locations of the contributing sources. Such novel source apportionment and ranking procedures are ultimately applicable to environmental investigations worldwide.

Water Sensitive Urban Design (WSUD) application auditing

Background WSUD implementation in the Gold Coast City Council area commenced more than a decade ago. As a result, Council is expected to be in possession of WSUD assets valued at over tens of million dollars. The Gold Coast City Council is responsible for the maintenance and long-term management of these WSUD assets. Any shortcoming in implementation of best WSUD practices can potentially result in substantial liabilities and ineffective expenditure for the Council in addition to reduced efficiencies and outcomes. This highlights the importance of periodic auditing of WSUD implementation. Project scope The overall study entailed the following tasks: * A state-of-the-art literature review of the conceptual hydraulic and water quality treatment principles, current state of knowledge in relation to industry standards, best practice and identification of knowledge gaps in relation to maintenance and management practices and potential barriers to the implementation of WSUD. * Council stakeholder interviews to understand current practical issues in relation to the implementation of WSUD and the process of WSUD application from development application approval to asset management. * Field auditing of selected WSUD systems for condition assessment and identification of possible strengths and weaknesses in implementation. * Review of the Land Development Guidelines in order to identify any gaps and to propose recommendations for improvement. Conclusions Given below is a consolidated summary of the findings of the study undertaken. State-of-the-art literature review Though the conceptual framework for WSUD implementation is well established, the underlying theoretical knowledge underpinning the treatment processes and maintenance regimes and life cycle costing are still not well understood. Essentially, these are the recurring themes in the literature, namely, the inadequate understanding of treatment processes and lack of guidance to ensure specificity of maintenance regimes and life cycle costing of WSUDs. The fundamental barriers to successful WSUD implementation are: * Lack of knowledge transfer – This essentially relates to the lack of appropriate dissemination of research outcomes and the common absence of protocols for knowledge transfer within the same organisation. * Cultural barriers – These relate to social and institutional factors, including institutional inertia and the lack of clear understanding of the benefits. * Fragmented responsibilities – This results from poor administrative integration within local councils in relation to WSUDs. * Technical barriers – These relate to lack of knowledge on operational and maintenance practices which is compounded by model limitations and the lack of long-term quantitative performance evaluation data. * Lack of engineering standards – Despite the availability of numerous guidelines which are non-enforceable and can sometimes be confusing, there is a need for stringent engineering standards. The knowledge gaps in relation to WSUDs are only closing very slowly. Some of the common knowledge gaps identified in recent publications have been recognised almost a decade ago. The key knowledge gaps identified in the published literature are: * lack of knowledge on operational and maintenance practices; * lack of reliable methodology for identifying life cycle issues including costs; * lack of technical knowledge on system performance; * lack of guidance on retrofitting in existing developments. Based on the review of barriers to WSUD implementation and current knowledge gaps, the following were identified as core areas for further investigation: * performance evaluation of WSUD devices to enhance model development and to assess their viability in the context of environmental, economic and social drivers; establishing realistic life cycle costs to strengthen maintenance and asset management practices; * development of guidelines specific to retrofitting in view of the unique challenges posed by existing urban precincts together with guidance to ensure site specificity; establishment of a process for knowledge translation for enhancing currently available best practice guidelines; * identification of drivers and overcoming of barriers in the areas of institutional fragmentation, knowledge gaps and awareness of WSUD practices. GCCC stakeholder interviews Fourteen staff members involved in WSUD systems management in the Gold Coast City Council, representing four Directorates were interviewed using a standard questionnaire. The primary issues identified by the stakeholders were: * standardisation of WSUD terminology; * clear protocols for safeguarding devices during the construction phase; * engagement of all council stakeholders in the WSUD process from the initial phase; * limitations in the Land Development Guidelines; * ensuring public safety through design; * system siting to avoid conflicts with environmental and public use of open space; * provision of adequate access for maintenance; * integration of social and ecosystem issues to ensure long-term viability of systems in relation to both, vandalism and visual recreation; * lack of performance monitoring and inadequacy of the maintenance budget; * lack of technical training for staff involved in WSUD design approvals and maintenance; incentives for developers for acting responsibly in stormwater management. Field auditing of WSUD systems A representative cross section of WSUD systems in the Gold Coast were audited in the field. The following strengths and weaknesses in WSUD implementation were noted: * The implementation of WSUD systems in the field is not consistent. * The concerns raised by the stakeholders during the interviews in relation to WSUD implementation was validated from the observations from the field auditing, particularly in relation to the following: * safeguarding of devices during the construction phase * public safety * accessibility for maintenance * lack of performance monitoring by Council to assess system performance * inadequate maintenance of existing systems to suit site specific requirements. * A treatment train approach is not being consistently adopted. * Most of the systems audited have satisfactorily catered for public safety. Accessibility for maintenance has been satisfactorily catered for in most of the systems that were audited. * Systems are being commissioned prior to construction activities being substantially completed. * The hydraulic design of most systems appears to be satisfactory. * The design intent of the systems is not always clear. Review of Land Development Guidelines The Land Development Guidelines (TDG) was extensively reviewed and the following primary issues were noted in relation to WSUD implementation: * the LDG appears to have been prepared primarily to provide guidance to developers. It is not clear to what extent the guidelines are applicable to Council staff involved in WSUD maintenance and management; * Section 13 is very voluminous and appears to be a compilation of a series of individual documents resulting in difficulties in locating specific information, a lack of integration and duplication of information; * the LDG has been developed with a primary focus on new urban precinct development and the retrofitting of systems in existing developments has not been specifically discussed; * WSUDs are discussed in two different sections in the LDG and it is not clear which section takes precedence as there are inconsistencies between the two sections; there is inconsistent terminology being used; * there is a need for consolidation of information provided in different sections in the LDG; * there are inconsistencies in the design criteria provided; * there is a need for regular updating of the LDG to ensure that the information provided encompasses the state-of-the-art; * there is limited guidance provided for the preparation of maintenance plans and life cycle costing to assist developers in asset handover and to assist Council staff in assessment. * Based on these observations, eleven recommendations have been provided which are discussed below. Additionally, the stakeholder provided the following specific comments during the interviews in relation to the LDG: * lack of flexibility to cover the different stages of the life cycle of the systems; * no differentiation in projects undertaken by developers and Council; * inadequate information with regards to safety issues such as maximum standing water depth, fencing and safety barriers and public access; * lack of detailed design criteria in relation to Crime Prevention through Environmental Design, safety, amenity, environment, surrounding uses and impacts on surroundings; * inadequate information regarding maintenance requirements specific to the assessment and compliance phases; * recommendations for plantings are based primarily on landscape requirements rather than pollutant uptake capability. Recommendations With regards to the Land Development Guidelines, the following specific recommendations are provided: 1. the relevant sections and their extent of applicability to Council should be clearly identified; 2. integration of the different subsections within Section 13 and re-formatting the document for easy reference; 3. the maintenance guidelines provided in Section 13 should be translated to a maintenance manual for guidance of Council staff; 4. should consider extending the Guidelines to specifically encompass retrofitting of WSUD systems to existing urban precincts; 5. Section 3 needs to be revised to be made consistent with Section 13, to ensure priority for WSUD practices in urban precincts and to move away from conventional stormwater drainage design such as kerb and channelling; 6. it would also be good to specify as to which Section takes predominance in relation to stormwater drainage. It is expected that Section 13 would take predominance over the other sections in the LDG; 7. terminology needs to be made consistent to avoid confusion among developers and Council staff. Water Sensitive Urban Design is the term commonly used in Australia for stormwater quality treatment, rather than Stormwater Quality Improvement Devices. This once again underlines the need for ensuring consistency between Section 3 and Section 13; 8. it would also be good if there is a glossary of commonly used terms in relation to WSUD for use by all stakeholders and which should also be reflected in the LDG; 9. consolidation of all WSUD information into one section should be considered together with appropriate indicators in other LDG Sections regarding the availability of WSUD information. Ensuring consistency in the information provided is implied; 10. Section 13 should be updated at regular intervals to ensure the incorporation of the latest in research outcomes and incorporating criteria and guidance based on the state-of-the-art knowledge. The updating could be undertaken, say, in five year cycles. This would help to overcome the current lack of knowledge transfer; 11. the Council should consider commissioning specialised studies to extend the current knowledge base in relation to WSUD maintenance and life cycle costing. Additionally, Recommendation 10 is also applicable in this instance. The following additional recommendations are made based on the state-of-the-art literature review, stakeholder interviews and field auditing of WSUD systems: 1. Performance monitoring of existing systems to assess improvements to water quality, identify modifications and enhancements to improve performance; 2. Appropriate and monitored maintenance during different phases of development of built assets over time is needed to investigate the most appropriate time/phase of development to commission the final WSUD asset. 3. Undertake focussed investigations in the areas of WSUD maintenance and asset management in order to establish more realistic life cycle costs of systems and maintenance schedules; 4. the engagement of all relevant Council stakeholders from the initial stage of concept planning through to asset handover, and ongoing monitoring. This close engagement of internal stakeholders will assist in building a greater understanding of responsibilities and contribute to overcoming constraints imposed by fragmented responsibilities; 5. the undertaking of a public education program to inform the community of the benefits and ecosystem functions of WSUD systems; 6. technical training to impart state-of-the-art knowledge to staff involved in the approval of designs and maintenance and management of WSUD projects; 7. during the construction phase, it is important to ensure that appropriate measures to safeguard WSUD devices are implemented; 8. risks associated with potential public access to open water zones should be minimised with the application of appropriate safety measures; 9. system siting should ensure that potential conflicts are avoided with respect to public and ecosystem needs; 10. integration of social and ecosystem issues to ensure long-term viability of systems; provide incentives to developers who are proactive and responsible in the area of stormwater management.

REFRAME : a new approach to evaluation in higher education

Evaluation practices in the higher education sector have been criticised for having unclear purpose and principles; ignoring the complexity and changing nature of learning and teaching and the environments in which they occur; relying almost exclusively on student ratings of teachers working in classroom settings; lacking reliability and validity; using data for inappropriate purposes; and focusing on accountability and marketing rather than the improvement of learning and teaching. In response to similar criticism from stakeholders, in 2011 Queensland University of Technology began a project, entitled REFRAME, to review its approach to evaluation, particularly the student survey system it had been using for the past five years. This presentation will outline the scholarly, evidence based methodology used to undertake institution-wide change, meet the needs of stakeholders suitable to the cultural needs of the institution. It is believed that this approach is broadly applicable to other institutions contemplating change with regard to evaluation of learning and teaching.

ClusterEval 1.0 : Cluster quality Evaluation software

This report describes the available functionality and use of the ClusterEval evaluation software. It implements novel and standard measures for the evaluation of cluster quality. This software has been used at the INEX XML Mining track and in the MediaEval Social Event Detection task.

Establishment and characterisation of an open mini-thoracotomy surgical approach to an ovine thoracic spine fusion model

Background A large animal model is required for assessment of minimally invasive, tissue engineering based approaches to thoracic spine fusion, with relevance to deformity correction surgery for human adolescent idiopathic scoliosis. Here we develop a novel open mini–thoracotomy approach in an ovine model of thoracic interbody fusion which allows assessment of various fusion constructs, with a focus on novel, tissue engineering based interventions. Methods The open mini-thoracotomy surgical approach was developed through a series of mock surgeries, and then applied in a live sheep study. Customized scaffolds were manufactured to conform with intervertebral disc space clearances required of the study. Twelve male Merino sheep aged 4 to 6 years and weighing 35 – 45 kg underwent the abovementioned procedure and were divided into two groups of six sheep at survival timelines of 6 and 12 months. Each sheep underwent a 3-level discectomy (T6/7, T8/9 and T10/11) with randomly allocated implantation of a different graft substitute at each of the three levels; (i) polycaprolactone (PCL) based scaffold plus 0.54μg rhBMP-2, (ii) PCL-based scaffold alone or (iii) autograft. The sheep were closely monitored post- operatively for signs of pain (i.e. gait abnormalities/ teeth gnawing/ social isolation). Fusion assessments were conducted post-sacrifice using Computed Tomography and hard-tissue histology. All scientific work was undertaken in accordance with the study protocol has been approved by the Institute's committee on animal research. Results. All twelve sheep were successfully operated on and reached the allotted survival timelines, thereby demonstrating the feasibility of the surgical procedure and post-operative care. There were no significant complications and during the post-operative period the animals did not exhibit marked signs of distress according to the described assessment criteria. Computed Tomographic scanning demonstrated higher fusion grades in the rhBMP-2 plus PCL-based scaffold group in comparison to either PCL-based scaffold alone or autograft. These results were supported by histological evaluation of the respective groups. Conclusion. This novel open mini-thoracotomy surgical approach to the ovine thoracic spine represents a safe surgical method which can reproducibly form the platform for research into various spine tissue engineered constructs (TEC) and their fusion promoting properties.

Defining sustainability requirements for design-build (DB) contractor selection in public sector projects

The design-build (DB) delivery system is an effective means of delivering a green construction project and selecting an appropriate contractor is critical to project success. Moreover, the delivery of green buildings requires specific design, construction and operation and maintenance considerations not generally encountered in the procurement of conventional buildings. Specifying clear sustainability requirements to potential contractors is particularly important in achieving sustainable project goals. However, many client/owners either do not explicitly specify sustainability requirements or do so in a prescriptive manner during the project procurement process. This paper investigates the current state-of-the-art procurement process used in specifying the sustainability requirements of the public sector in the USA construction market by means of a robust content analysis of 40 design-build requests for proposals (RFPs). The results of the content analysis indicate that the sustainability requirement is one of the most important dimensions in the best-value evaluation of DB contractors. Client/owners predominantly specify the LEED certification levels (e.g. LEED Certified, Silver, Gold, and Platinum) for a particular facility, and include the sustainability requirements as selection criteria (with specific importance weightings) for contractor evolution. Additionally, larger size projects tend to allocate higher importance weightings to sustainability requirements.This study provides public DB client/owners with a number of practical implications for selecting appropriate design-builders for sustainable DB projects.

Identification and evaluation of service bundles for governmental one-stop portals

Recent advances in the area of ‘Transformational Government’ position the citizen at the centre of focus. This paradigm shift from a department-centric to a citizen-centric focus requires governments to re-think their approach to service delivery, thereby decreasing costs and increasing citizen satisfaction. The introduction of franchises as a virtual business layer between the departments and their citizens is intended to provide a solution. Franchises are structured to address the needs of citizens independent of internal departmental structures. For delivering services online, governments pursue the development of a One-Stop Portal, which structures information and services through those franchises. Thus, each franchise can be mapped to a specific service bundle, which groups together services that are deemed to be of relevance to a specific citizen need. This study focuses on the development and evaluation of these service bundles. In particular, two research questions guide the line of investigation of this study: Research Question 1): What methods can be used by governments to identify service bundles as part of governmental One-Stop Portals? Research Question 2): How can the quality of service bundles in governmental One-Stop Portals be evaluated? The first research question asks about the identification of suitable service bundle identification methods. A literature review was conducted, to, initially, conceptualise the service bundling task, in general. As a consequence, a 4-layer model of service bundling and a morphological box were created, detailing characteristics that are of relevance when identifying service bundles. Furthermore, a literature review of Decision-Support Systems was conducted to identify approaches of relevance in different bundling scenarios. These initial findings were complemented by targeted studies of multiple leading governments in the e-government domain, as well as with a local expert in the field. Here, the aim was to identify the current status of online service delivery and service bundling in practice. These findings led to the conceptualising of two service bundle identification methods, applicable in the context of Queensland Government: On the one hand, a provider-driven approach, based on service description languages, attributes, and relationships between services was conceptualised. As well, a citizen-driven approach, based on analysing the outcomes from content identification and grouping workshops with citizens, was also conceptualised. Both methods were then applied and evaluated in practice. The conceptualisation of the provider-driven method for service bundling required the initial specification of relevant attributes that could be used to identify similarities between services called relationships; these relationships then formed the basis for the identification of service bundles. This study conceptualised and defined seven relationships, namely ‘Co-location’, ‘Resource’, ‘Co-occurrence’, ‘Event’, ‘Consumer’, ‘Provider’, and ‘Type’. The relationships, and the bundling method itself, were applied and refined as part of six Action Research cycles in collaboration with the Queensland Government. The findings show that attributes and relationships can be used effectively as a means for bundle identification, if distinct decision rules are in place to prescribe how services are to be identified. For the conceptualisation of the citizen-driven method, insights from the case studies led to the decision to involve citizens, through card sorting activities. Based on an initial list of services, relevant for a certain franchise, participating citizens grouped services according to their liking. The card sorting activity, as well as the required analysis and aggregation of the individual card sorting results, was analysed in depth as part of this study. A framework was developed that can be used as a decision-support tool to assist with the decision of what card sorting analysis method should be utilised in a given scenario. The characteristic features associated with card sorting in a government context led to the decision to utilise statistical analysis approaches, such as cluster analysis and factor analysis, to aggregate card sorting results. The second research question asks how the quality of service bundles can be assessed. An extensive literature review was conducted focussing on bundle, portal, and e-service quality. It was found that different studies use different constructs, terminology, and units of analysis, which makes comparing these models a difficult task. As a direct result, a framework was conceptualised, that can be used to position past and future studies in this research domain. Complementing the literature review, interviews conducted as part of the case studies with leaders in e-government, indicated that, typically, satisfaction is evaluated for the overall portal once the portal is online, but quality tests are not conducted during the development phase. Consequently, a research model which appropriately defines perceived service bundle quality would need to be developed from scratch. Based on existing theory, such as Theory of Reasoned Action, Expectation Confirmation Theory, and Theory of Affordances, perceived service bundle quality was defined as an inferential belief. Perceived service bundle quality was positioned within the nomological net of services. Based on the literature analysis on quality, and on the subsequent work of a focus group, the hypothesised antecedents (descriptive beliefs) of the construct and the associated question items were defined and the research model conceptualised. The model was then tested, refined, and finally validated during six Action Research cycles. Results show no significant difference in higher quality or higher satisfaction among users for either the provider-driven method or for the citizen-driven method. The decision on which method to choose, it was found, should be based on contextual factors, such as objectives, resources, and the need for visibility. The constructs of the bundle quality model were examined. While the quality of bundles identified through the citizen-centric approach could be explained through the constructs ‘Navigation’, ‘Ease of Understanding’, and ‘Organisation’, bundles identified through the provider-driven approach could be explained solely through the constructs ‘Navigation’ and ‘Ease of Understanding’. An active labelling style for bundles, as part of the provider-driven Information Architecture, had a larger impact on ‘Quality’ than the topical labelling style used in the citizen-centric Information Architecture. However, ‘Organisation’, reflecting the internal, logical structure of the Information Architecture, was a significant factor impacting on ‘Quality’ only in the citizen-driven Information Architecture. Hence, it was concluded that active labelling can compensate for a lack of logical structure. Further studies are needed to further test this conjecture. Such studies may involve building alternative models and conducting additional empirical research (e.g. use of an active labelling style for the citizen-driven Information Architecture). This thesis contributes to the body of knowledge in several ways. Firstly, it presents an empirically validated model of the factors explaining and predicting a citizen’s perception of service bundle quality. Secondly, it provides two alternative methods that can be used by governments to identify service bundles in structuring the content of a One-Stop Portal. Thirdly, this thesis provides a detailed narrative to suggest how the recent paradigm shift in the public domain, towards a citizen-centric focus, can be pursued by governments; the research methodology followed by this study can serve as an exemplar for governments seeking to achieve a citizen-centric approach to service delivery.

Quantitative evaluation of polymer gel dosimeters by broadband ultrasound attenuation

Ultrasound has been examined previously as an alternative readout method for irradiated polymer gel dosimeters, with authors reporting varying dose response to ultrasound transmission measurements. In this current work we extend previous work to measure the broadband ultrasound attenuation (BUA) response of irradiated PAGAT gel dosimeters, using a novel ultrasound computed tomography system.

Establishing design thinking : accident, program frameworks and personal practices

Distribution through electronic media provides an avenue for promotion, recognition and an outlet of display for graphic designers. The emergence of available media technologies have enabled graphic designers to extend these boundaries of their practice. In this context the designer is constantly striving for aesthetic success and is strongly influenced by the fashion and trends of contemporary design work. The designer is always in a state of inquiry, finding pathways of discovery that lead to innovation and originality that are highly valued criteria for self-evaluation. This research is based on an analysis of the designer perspective and the processes used within an active graphic design practice specializing entirely within a digital collage domain. Contemporary design methodologies were critically examined, compared and refined to reflect the self-practice of the researcher. The refined methodology may assist designers in maintaining systematic work practices, as well as promote the importance of exploration and experimentation processes. Research findings indicate some differences in the identified methodologies and the design practice of the researcher in the sense that many contemporary designers are not confined to a client-base but are self-generating design images influenced by contemporary practitioners. As well as confirming some aspects of more conventional design processes, the researcher found that accidental discoveries and the designer’s interaction with technology plays a significant part in the design process.

Quality Assessment Matrix : A Collaborative Evaluation Using Multiple Lines of Evidence

Welcome to the Quality assessment matrix. This matrix is designed for highly qualified discipline experts to evaluate their course, major or unit in a systematic manner. The primary purpose of the Quality assessment matrix is to provide a tool that a group of academic staff at universities can collaboratively review the assessment within a course, major or unit annually. The annual review will result in you being read for an external curricula review at any point in time. This tool is designed for use in a workshop format with one, two or more academic staff, and will lead to an action plan for implementation.