OSCE online : making assessment of clinical competencies transparent, accountable & authentic

Creating an authentic assessment which at once assesses competencies, scene management, communication and overall patient care is challenging in the competitive tertiary education market. Increasing student numbers and the cost of evaluating scenario based competencies serve to ensure the need for consistent objectivity and need for timely feedback to students on their performance. Objective structured clinical examination (OSCE) is currently the most flexible approach to competency based formative and summative assessment and widely used within paramedic degree programs. Students are understandably compelled to perform well and can be frustrated by not receiving timely and appropriate feedback. Increasingly a number of products aimed at providing a more efficient and paperless approach have begun to enter the market. These products, it is suggested are aimed at medicine programs and not at allied health professions and limited to one operating system and therefore ignore issues surrounding equity and accessibility. OSCE Online aims to address this gap in the market and is tailored to these disciplines. The application will provide a service that can be both tailored and standardised from a pre-written bank, depending upon requirement to fit around the needs of clinical competency assessment. Delivering authentic assessments to address student milestones in their training to become paramedics is the cornerstone of OSCE Online. By not being restricted to a specific device it will address issues of functionality, adaptability, accessibility, authenticity and importantly: transparency and accountability by producing contemporaneous data allowing issues to be easily identified and rectified.

The Implications of Activity Based Funding for Emergency Departments : A Comprehensive Literature Review

Executive Summary Emergency Departments (EDs) locally, nationally and internationally are becoming increasingly busy. Within this context, it can be challenging to deliver a health service that is safe, of high quality and cost-effective. Whilst various models are described within the literature that aim to measure ED ‘work’ or ‘activity’, they are often not linked to a measure of costs to provide such activity. It is important for hospital and ED managers to understand and apply this link so that optimal staffing and financial resourcing can be justifiably sought. This research is timely given that Australia has moved towards a national Activity Based Funding (ABF) model for ED activity. ABF is believed to increase transparency of care and fairness (i.e. equal work receives equal pay). ABF involves a person-, performance- or activity-based payment system, and thus a move away from historical “block payment” models that do not incentivise efficiency and quality. The aim of the Statewide Workforce and Activity-Based Funding Modelling Project in Queensland Emergency Departments (SWAMPED) is to identify and describe best practice Emergency Department (ED) workforce models within the current context of ED funding that operates under an ABF model. The study is comprised of five distinct phases. This monograph (Phase 1) comprises a systematic review of the literature that was completed in June 2013. The remaining phases include a detailed survey of Queensland hospital EDs’ resource levels, activity and operational models of care, development of new resource models, development of a user-friendly modelling interface for ED mangers, and production of a final report that identifies policy implications. The anticipated deliverable outcome of this research is the development of an ABF based Emergency Workforce Modelling Tool that will enable ED managers to profile both their workforce and operational models of care. Additionally, the tool will assist with the ability to more accurately inform adequate staffing numbers required in the future, inform planning of expected expenditures and be used for standardisation and benchmarking across similar EDs. Summary of the Findings Within the remit of this review of the literature, the main findings include: 1. EDs are becoming busier and more congested Rising demand, barriers to ED throughput and transitions of care all contribute to ED congestion. In addition requests by organisational managers and the community require continued broadening of the scope of services required of the ED and further increases in demand. As the population live longer with more lifestyle diseases their propensity to require ED care continues to grow. 2. Various models of care within EDs exist Models often vary to account for site specific characteritics to suit staffing profile, ED geographical location (e.g. metropolitan or rural site), and patient demographic profile (e.g. paediatrics, older persons, ethnicity). Existing and new models implemented within EDs often depend on the target outcome requiring change. Generally this is focussed on addressing issues at the input, throughput or output areas of the ED. Even with models targeting similar demographic or illness, the structure and process elements underpinning the model can vary, which can impact on outcomes and variance to the patient and carer experience between and within EDs. Major models of care to manage throughput inefficiencies include: A. Workforce Models of Care focus on the appropriate level of staffing for a given workload to provide prompt, timely and clinically effective patient care within an emergency care setting. The studies reviewed suggest that the early involvement of senior medical decision maker and/or specialised nursing roles such as Emergency Nurse Practitioners and Clinical Initiatives Nurse, primary contact or extended scope Allied Health Practitioners can facilitate patient flow and improve key indicators such as length of stay and reducing the number of those who did not wait to be seen amongst others. B. Operational Models of Care within EDs focus on mechanisms for streaming (e.g. fast-tracking) or otherwise grouping patient care based on acuity and complexity to assist with minimising any throughput inefficiencies. While studies support the positive impact of these models in general, it appears that they are most effective when they are adequately resourced. 3. Various methods of measuring ED activity exist Measuring ED activity requires careful consideration of models of care and staffing profile. Measuring activity requires the ability to account for factors including: patient census, acuity, LOS, intensity of intervention, department skill-mix plus an adjustment for non-patient care time. 4. Gaps in the literature Continued ED growth calls for new and innovative care delivery models that are safe, clinically effective and cost effective. New roles and stand-alone service delivery models are often evaluated in isolation without considering the global and economic impact on staffing profiles. Whilst various models of accounting for and measuring health care activity exist, costing studies and cost effectiveness studies are lacking for EDs making accurate and reliable assessments of care models difficult. There is a necessity to further understand, refine and account for measures of ED complexity that define a workload upon which resources and appropriate staffing determinations can be made into the future. There is also a need for continued monitoring and comprehensive evaluation of newly implemented workforce modelling tools. This research acknowledges those gaps and aims to: • Undertake a comprehensive and integrated whole of department workforce profiling exercise relative to resources in the context of ABF. • Inform workforce requirements based on traditional quantitative markers (e.g. volume and acuity) combined with qualitative elements of ED models of care; • Develop a comprehensive and validated workforce calculation tool that can be used to better inform or at least guide workforce requirements in a more transparent manner.

Predicting the likelihood of QA failure using treatment plan accuracy metrics

This study used automated data processing techniques to calculate a set of novel treatment plan accuracy metrics, and investigate their usefulness as predictors of quality assurance (QA) success and failure. 151 beams from 23 prostate and cranial IMRT treatment plans were used in this study. These plans had been evaluated before treatment using measurements with a diode array system. The TADA software suite was adapted to allow automatic batch calculation of several proposed plan accuracy metrics, including mean field area, small-aperture, off-axis and closed-leaf factors. All of these results were compared the gamma pass rates from the QA measurements and correlations were investigated. The mean field area factor provided a threshold field size (5 cm2, equivalent to a 2.2 x 2.2 cm2 square field), below which all beams failed the QA tests. The small aperture score provided a useful predictor of plan failure, when averaged over all beams, despite being weakly correlated with gamma pass rates for individual beams. By contrast, the closed leaf and off-axis factors provided information about the geometric arrangement of the beam segments but were not useful for distinguishing between plans that passed and failed QA. This study has provided some simple tests for plan accuracy, which may help minimise time spent on QA assessments of treatments that are unlikely to pass.

Revisiting sub-topic retrieval in the ImageCLEF 2009 photo retrieval task

Ranking documents according to the Probability Ranking Principle has been theoretically shown to guarantee optimal retrieval effectiveness in tasks such as ad hoc document retrieval. This ranking strategy assumes independence among document relevance assessments. This assumption, however, often does not hold, for example in the scenarios where redundancy in retrieved documents is of major concern, as it is the case in the sub–topic retrieval task. In this chapter, we propose a new ranking strategy for sub–topic retrieval that builds upon the interdependent document relevance and topic–oriented models. With respect to the topic– oriented model, we investigate both static and dynamic clustering techniques, aiming to group topically similar documents. Evidence from clusters is then combined with information about document dependencies to form a new document ranking. We compare and contrast the proposed method against state–of–the–art approaches, such as Maximal Marginal Relevance, Portfolio Theory for Information Retrieval, and standard cluster–based diversification strategies. The empirical investigation is performed on the ImageCLEF 2009 Photo Retrieval collection, where images are assessed with respect to sub–topics of a more general query topic. The experimental results show that our approaches outperform the state–of–the–art strategies with respect to a number of diversity measures.

Analysis of distance learner value assessment of distance education in engineering

Numerous research studies have evaluated whether distance learning is a viable alternative to traditional learning methods. These studies have generally made use of cross-sectional surveys for collecting data, comparing distance to traditional learners with intent to validate the former as a viable educational tool. Inherent fundamental differences between traditional and distance learning pedagogies, however, reduce the reliability of these comparative studies and constrain the validity of analyses resulting from this analytical approach. This article presents the results of a research project undertaken to analyze expectations and experiences of distance learners with their degree programs. Students were given surveys designed to examine factors expected to affect their overall value assessment of their distance learning program. Multivariate statistical analyses were used to analyze the correlations among variables of interest to support hypothesized relationships among them. Focusing on distance learners overcomes some of the limitations with assessments that compare off- and on-campus student experiences. Evaluation and modeling of distance learner responses on perceived value for money of the distance education they received indicate that the two most important influences are course communication requirements, which had a negative effect, and course logistical simplicity, which revealed a positive effect. Combined, these two factors accounted for approximately 47% of the variability in perceived value for money of the educational program of sampled students. A detailed focus on comparing expectations with outcomes of distance learners complements the existing literature dominated by comparative studies of distance and nondistance learners.

Managing cost implications for highway infrastructure sustainability

Highway construction works have significant bearings on all aspects of sustainability. With the increasing level of public awareness and government regulatory measures, the construction industry is experiencing a cultural shift to recognise, embrace and pursue sustainability. Stakeholders are now keen to identify sustainable alternatives and the financial implications of including them on a lifecycle basis. They need tools that can aid the evaluation of investment options. To date, however, there have not been many financial assessments on the sustainability aspects of highway projects. This is because the existing life-cycle costing analysis (LCCA) models tend to focus on economic issues alone and are not able to deal with sustainability factors. This paper provides insights into the current practice of life-cycle cost analysis, and the identification and quantification of sustainability-related cost components in highway projects through literature review, questionnaire surveys and semi-structured interviews. The results can serve as a platform for highway project stakeholders to develop practical tools to evaluate highway investment decisions and reach an optimum balance between financial viability and sustainability deliverables.

Collaborative resource development for energy efficiency education

BACKGROUND There is a growing volume of open source ‘education material’ on energy efficiency now available however the Australian government has identified a need to increase the use of such materials in undergraduate engineering education. Furthermore, there is a reported need to rapidly equip engineering graduates with the capabilities in conducting energy efficiency assessments, to improve energy performance across major sectors of the economy. In January 2013, building on several years of preparatory action-research initiatives, the former Department of Industry, Innovation, Climate Change, Science, Research and Tertiary Education (DIICCSRTE) offered $600,000 to develop resources for energy efficiency related graduate attributes, targeting Engineers Australia college disciplines, accreditation requirements and opportunities to address such requirements. PURPOSE This paper discusses a $430,000 successful bid by a university consortium led by QUT and including RMIT, UA, UOW, and VU, to design and pilot several innovative, targeted open-source resources for curriculum renewal related to energy efficiency assessments, in Australian engineering programs (2013-2014), including ‘flat-pack’, ‘media-bites’, ‘virtual reality’ and ‘deep dive’ case study initiatives. DESIGN/ METHOD The paper draws on literature review and lessons learned by the consortium partners in resource development over the last several years to discuss methods for selecting key graduate attributes and providing targeted resources, supporting materials, and innovative delivery options to assist universities deliver knowledge and skills to develop such attributes. This includes strategic industry and key stakeholders engagement. The paper also discusses processes for piloting, validating, peer reviewing, and refining these resources using a rigorous and repeatable approach to engaging with academic and industry colleagues. RESULTS The paper provides an example of innovation in resource development through an engagement strategy that takes advantage of existing networks, initiatives, and funding arrangements, while informing program accreditation requirements, to produce a cost-effective plan for rapid integration of energy efficiency within education. By the conference, stakeholder workshops will be complete. Resources will be in the process of being drafted, building on findings from the stakeholder engagement workshops. Reporting on this project “in progress” provides a significant opportunity to share lessons learned and take on board feedback and input. CONCLUSIONS This paper provides a useful reference document for others considering significant resource development in a consortium approach, summarising benefits and challenges. The paper also provides a basis for documenting the second half of the project, which comprises piloting resources and producing a ‘good practice guide’ for energy efficiency related curriculum renewal.

Analysis of damage to buildings following the 2010–11 Eastern Australia floods

This research analyses the extent of damage to buildings in Brisbane, Ipswich and Grantham during the recent Eastern Australia flooding and explore the role planning and design/construction regulations played in these failures. It highlights weaknesses in the current systems and propose effective solutions to mitigate future damage and financial loss under current or future climates. 2010 and early 2011 saw major flooding throughout much of Eastern Australia. Queensland and Victoria were particularly hard hit, with insured losses in these states reaching $2.5 billion and many thousands of homes inundated. The Queensland cities of Brisbane and Ipswich were the worst affected; around two-thirds of all inundated property/buildings were in these two areas. Other local government areas to record high levels of inundation were Central Highlands and Rockhampton Regional Councils in Queensland, and Buloke, Campaspe, Central Gold Fields and Loddon in Victoria. Flash flooding was a problem in a number of Victorian councils, but the Lockyer Valley west of Ipswich suffered the most extensive damage with 19 lives lost and more than 100 homes completely destroyed. In all more than 28,000 properties were inundated in Queensland and around 2,500 buildings affected in Victoria. Of the residential properties affected in Brisbane, around 90% were in areas developed prior to the introduction of floodplain development controls, with many also suffering inundation during the 1974 floods. The project developed a predictive model for estimating flood loss and occupant displacement. This model can now be used for flood risk assessments or rapid assessment of impacts following a flood event.

Conflicting notions of risk : the chasm of conflict between institutions and the public

The trust and credibility gap between institutional regulators and the public is based on fundamental social and cultural differences related to power and authority. It is also associated with the 'distance' of a bureaucracies from those whom they serve. The nature of public concern about risk may be investigated by considering specific cognitive decision making 'rules' such as 'familiarity' of a hazard or 'voluntariness' of exposure. A more complete appreciation of the 'how' and 'why' of public response to danger from industrial hazards can be gained by appreciating these 'rules' within the broader context of mis-communication between 'elite' regulators and a highly diverse public. If the results of risk assessments are expressed in technical terms alone, it is unlikely that any real communication will occur. Further, if issues related to the 'remote' nature of much institutional decision making are not addressed, closure of the 'gap' may be difficult to bring about.

Linking ecological condition and the soundscape in fragmented Australian forests

Natural landscapes are increasingly subjected to anthropogenic pressure and fragmentation resulting in reduced ecological condition. In this study we examined the relationship between ecological condition and the soundscape in fragmented forest remnants of south-east Queensland, Australia. The region is noted for its high biodiversity value and increased pressure associated with habitat fragmentation and urbanisation. Ten sites defined by a distinct open eucalypt forest community dominated by spotted gum (Corymbia citriodora ssp. variegata) were stratified based on patch size and patch connectivity. Each site underwent a series of detailed vegetation condition and landscape assessments, together with bird surveys and acoustic analysis using relative soundscape power. Univariate and multivariate analyses indicated that the measurement of relative soundscape power reflects ecological condition and bird species richness, and is dependent on the extent of landscape fragmentation. We conclude that acoustic monitoring technologies provide a cost effective tool for measuring ecological condition, especially in conjunction with established field observations and recordings.

Life cycle analysis for sustainability assessment of road projects

Road infrastructure has been considered as one of the most expensive and extensive infrastructure assets of the built environment globally. This asset also impacts the natural environment significantly during different phases of life e.g. construction, use, maintenance and end-of-life. The growing emphasis for sustainable development to meet the needs of future generations requires mitigation of the environmental impacts of road infrastructure during all phases of life e.g. construction, operation and end-of-life disposal (as required). Life-cycle analysis (LCA), a method of quantification of all stages of life, has recently been studied to explore all the environmental components of road projects due to limitations of generic environmental assessments. The LCA ensures collection and assessment of the inputs and outputs relating to any potential environmental factor of any system throughout its life. However, absence of a defined system boundary covering all potential environmental components restricts the findings of the current LCA studies. A review of the relevant published LCA studies has identified that environmental components such as rolling resistance of pavement, effect of solar radiation on pavement(albedo), traffic congestion during construction, and roadway lighting & signals are not considered by most of the studies. These components have potentially higher weightings for environment damage than several commonly considered components such as materials, transportation and equipment. This paper presents the findings of literature review, and suggests a system boundary model for LCA study of road infrastructure projects covering potential environmental components.

Physical activity, self-regulation, and early academic achievement in preschool children

Research Findings The present study investigated whether active play during recess was associated with self-regulation and academic achievement in a prekindergarten sample. A total of 51 children in classes containing approximately half Head Start children were assessed on self-regulation, active play, and early academic achievement. Path analyses indicated that higher active play was associated with better self-regulation, which in turn was associated with higher scores on early reading and math assessments. Practice or Policy Results point to the benefits of active play for promoting self-regulation and offer insight into possible interventions designed to promote self-regulation and academic achievement.

Functional independence following subacute inpatient rehabilitation was not affected by age among older patients recovering from cardiac-related hospital admissions

Introduction Older people recovering from cardiac events requiring an acute hospital admission may experience a decline in physical function limiting their ability to return home to their previous accommodation. Subacute inpatient rehabilitation therapies have potential to assist recovery of physical functioning. However, it is unknown whether age influences the length of stay or physical functioning at discharge from subacute inpatient rehabilitation for this population. Objectives This study examined the outcomes of a cohort of older patients recovering from a cardiac event requiring hospitalisation to investigate the association between age and physical function at discharge, as well as age and length of rehabilitation stay. Methods Participants included 145 consecutive inpatient admissions to a subacute geriatric assessment and rehabilitation unit with a cardiac condition as their primary reason for hospital admission. Participants were required to complete a multi-disciplinary physical functioning assessment within 72 hours of admission to the unit, and again within 72 hours prior to discharge from the unit. The primary outcome measure was the Functional Independence Measure motor score. Demographic and clinical information, including length of stay and discharge destination, were also recorded. Results A total n=126 (87%) participants, with a mean (standard deviation) age of 79 (10) years, had both assessments completed and were included in analyses. Participants who had passed away (n=4, 3%), or did not have both assessments completed per protocol were excluded from analyses. Discharge destinations included home (n=101, 80%), residential aged care (n=17, 13%) and another hospital (n=8, 6%). The (median, interquartile range) Functional Independence Measure motor score was higher at discharge (79, 71 to 84) than admission (61, 48 to 71); z=7.75 p<0.001. Age was not associated with Functional Independence Measure motor score at discharge (t= -0.18, p=0.86), or length of stay in the rehabilitation unit (t= -0.52, 0.60). Conclusion Any perception that age may be associated with longer lengths of stay and reduced physical function outcomes among patients with cardiac conditions admitted for subacute inpatient rehabilitation for older adults is not supported data from this investigation. Older age should not be considered a disincentive when considering the suitability of patients with cardiac diagnoses for this type of inpatient rehabilitation or their potential physical functioning outcome.

Paracrine interactions between LNCaP prostate cancer cells and bioengineered bone in 3D in vitro culture reflect molecular changes during bone metastasis

As microenvironmental factors such as three-dimensionality and cell–matrix interactions are increasingly being acknowledged by cancer biologists, more complex 3D in vitro models are being developed to study tumorigenesis and cancer progression. To better understand the pathophysiology of bone metastasis, we have established and validated a 3D indirect co-culture model to investigate the paracrine interactions between prostate cancer (PCa) cells and human osteoblasts. Co-culture of the human PCa, LNCaP cells embedded within polyethylene glycol hydrogels with human osteoblasts in the form of a tissue engineered bone construct (TEB), resulted in reduced proliferation of LNCaP cells. LNCaP cells in both monoculture and co-culture were responsive to the androgen analog, R1881, as indicated by an increase in the expression (mRNA and/or protein induction) of androgen-regulated genes including prostate specific antigen and fatty acid synthase. Microarray gene expression analysis further revealed an up-regulation of bone markers and other genes associated with skeletal and vasculature development and a significant activation of transforming growth factor β1 downstream genes in LNCaP cells after co-culture with TEB. LNCaP cells co-cultured with TEB also unexpectedly showed similar changes in classical androgen-responsive genes under androgen-deprived conditions not seen in LNCaP monocultures. The molecular changes of LNCaP cells after co-culturing with TEBs suggest that osteoblasts exert a paracrine effect that may promote osteomimicry and modulate the expression of androgen-responsive genes in LNCaP cells. Taken together, we have presented a novel 3D in vitro model that allows the study of cellular and molecular changes occurring in PCa cells and osteoblasts that are relevant to metastatic colonization of bone. This unique in vitro model could also facilitate cancer biologists to dissect specific biological hypotheses via extensive genomic or proteomic assessments to further our understanding of the PCa-bone crosstalk.

Relevation! : an open source system for information retrieval relevance assessment

Relevation! is a system for performing relevance judgements for information retrieval evaluation. Relevation! is web-based, fully configurable and expandable; it allows researchers to effectively collect assessments and additional qualitative data. The system is easily deployed allowing assessors to smoothly perform their relevance judging tasks, even remotely. Relevation! is available as an open source project at: http://ielab.github.io/relevation.