Future directions in course quality assurance

The Course Quality Assurance System at Queensland University of Technology (QUT) has as its centrepiece an exemplar of data visualisation known as the Individual Course Report (ICR). This report provides every course coordinator with an annual snapshot of their performance data evaluated against QUT and national benchmarks. In this article, the impact of the ICR is explored through the case study of one undergraduate course identified as underperforming. The case study features an innovative, ethnographic approach to working with course teams and highlights the importance of context, collaboration and appropriate support in creating evidence-based action plans for course improvement.

Performance characterisation of a constructed wetland

Performance of a constructed wetland is commonly reported as variable due to the site specific nature of influential factors. This paper discusses outcomes from an in-depth study which characterised treatment performance of a wetland based on the variation in runoff regime. The study included a comprehensive field monitoring of a well established constructed wetland in Gold Coast, Australia. Samples collected at the inlet and outlet was tested for Total Suspended Solids (TSS), Total Nitrogen (TN) and Total Phosphorus (TP). Pollutant concentrations in the outflow were found to be consistent irrespective of the variation in inflow water quality. The analysis revealed two different treatment characteristics for events with different rainfall depths. TSS and TN load reduction is strongly influenced by hydraulic retention time where performance is higher for rainfall events below the design event. For small events, treatment performance is higher at the beginning of the event and gradually decreased during the course of the event. For large events, the treatment performance is comparatively poor at the beginning and improved during the course of the event. The analysis also confirmed the variable treatment trends for different pollutant types.

A conceptual model for reflecting on expected learning vs. demonstrated student performance

Educators are faced with many challenging questions in designing an effective curriculum. What prerequisite knowledge do students have before commencing a new subject? At what level of mastery? What is the spread of capabilities between bare-passing students vs. the top performing group? How does the intended learning specification compare to student performance at the end of a subject? In this paper we present a conceptual model that helps in answering some of these questions. It has the following main capabilities: capturing the learning specification in terms of syllabus topics and outcomes; capturing mastery levels to model progression; capturing the minimal vs. aspirational learning design; capturing confidence and reliability metrics for each of these mappings; and finally, comparing and reflecting on the learning specification against actual student performance. We present a web-based implementation of the model, and validate it by mapping the final exams from four programming subjects against the ACM/IEEE CS2013 topics and outcomes, using Bloom's Taxonomy as the mastery scale. We then import the itemised exam grades from 632 students across the four subjects and compare the demonstrated student performance against the expected learning for each of these. Key contributions of this work are the validated conceptual model for capturing and comparing expected learning vs. demonstrated performance, and a web-based implementation of this model, which is made freely available online as a community resource.

Student self-assessment of performance : a useful learning tool for students and instructors?

Assurance of Learning is a focus for many Business Schools to meet AACSB requirements. Prior research has examined student self-assessment as a measure of learning in this context, but we propose instead that this is a useful ‘learning tool’ for students and instructors that can help improve student performance and curricula. We examined self-assessment in a third year undergraduate e-marketing course and found a positive, though weak relationship between student self-assessment and instructor ratings on intended learning goals and criteria for a written assignment. Students who self-assessed tended to perform better in the assessment item and course than those who did not self-assess. But less competent students were more inaccurate in their self-assessment, suggesting a need to enhance understanding of marking criteria and performance standards within this group. Implications for educators are discussed.

Single-agent versus combination chemotherapy in patients with advanced non-small cell lung cancer and a performance status of 2 : prognostic factors and treatment selection based on two large randomized clinical trials

Purpose: Data from two randomized phase III trials were analyzed to evaluate prognostic factors and treatment selection in the first-line management of advanced non-small cell lung cancer patients with performance status (PS) 2. Patients and Methods: Patients randomized to combination chemotherapy (carboplatin and paclitaxel) in one trial and single-agent therapy (gemcitabine or vinorelbine) in the second were included in these analyses. Both studies had identical eligibility criteria and were conducted simultaneously. Comparison of efficacy and safety was performed between the two cohorts. A regression analysis identified prognostic factors and subgroups of patients that may benefit from combination or single-agent therapy. Results: Two hundred one patients were treated with combination and 190 with single-agent therapy. Objective responses were 37 and 15%, respectively. Median time to progression was 4.6 months in the combination arm and 3.5 months in the single-agent arm (p < 0.001). Median survival imes were 8.0 and 6.6 months, and 1-year survival rates were 31 and 26%, respectively. Albumin <3.5 g, extrathoracic metastases, lactate dehydrogenase ≥200 IU, and 2 comorbid conditions predicted outcome. Patients with 0-2 risk factors had similar outcomes independent of treatment, whereas patients with 3-4 factors had a nonsignificant improvement in median survival with combination chemotherapy. Conclusion: Our results show that PS2 non-small cell lung cancer patients are a heterogeneous group who have significantly different outcomes. Patients treated with first-line combination chemotherapy had a higher response and longer time to progression, whereas overall survival did not appear significantly different. A prognostic model may be helpful in selecting PS 2 patients for either treatment strategy. © 2009 by the International Association for the Study of Lung Cancer.

Strategies and solutions for housing sustainability : building information files and performance certificates

The overall aim of this research project was to provide a broader range of value propositions (beyond upfront traditional construction costs) that could transform both the demand side and supply side of the housing industry. The project involved gathering information about how building information is created, used and communicated and classifying building information, leading to the formation of an Information Flow Chart and Stakeholder Relationship Map. These were then tested via broad housing industry focus groups and surveys. The project revealed four key relationships that appear to operate in isolation to the whole housing sector and may have significant impact on the sustainability outcomes and life cycle costs of dwellings over their life cycle. It also found that although a lot of information about individual dwellings does already exist, this information is not coordinated or inventoried in any systematic manner and that national building information files of building passports would present value to a wide range of stakeholders.

Capturing complex, non-linear team behaviours during competitive football performance

This study investigated changes in the complexity (magnitude and structure of variability) of the collective behaviours of association football teams during competitive performance. Raw positional data from an entire competitive match between two professional teams were obtained with the ProZone® tracking system. Five compound positional variables were used to investigate the collective patterns of performance of each team including: surface area, stretch index, team length, team width, and geometrical centre. Analyses involve the coefficient of variation (%CV) and approximate entropy (ApEn), as well as the linear association between both parameters. Collective measures successfully captured the idiosyncratic behaviours of each team and their variations across the six time periods of the match. Key events such as goals scored and game breaks (such as half time and full time) seemed to influence the collective patterns of performance. While ApEn values significantly decreased during each half, the %CV increased. Teams seem to become more regular and predictable, but with increased magnitudes of variation in their organisational shape over the natural course of a match.

The impact on clinical practice of a postgraduate clinical pharmacy programme, incorporating competency-based performance evaluation

Background A goal of the postgraduate clinical pharmacy programme (PGCPP) at the University of Queensland is to enhance clinical practice. Aims To evaluate student perceptions of the impact of the PGCPP on practice and the inclusion of a competency-based performance evaluation as a formative component of the curriculum. Method In 2010, students completed a questionnaire to evaluate the impact of the PGCPP. In 2011, formative competency-based performance evaluations were conducted as a component of the course and the questionnaire was repeated. Responses, competency ratings and evaluation feedback were collated. Data were analysed using descriptive statistics. Results 51/57 (89%) of students completed the questionnaire in 2010 and 2011. Over 90% of students agreed or strongly agreed that the PGCPP enhanced practice, knowledge, confidence and contribution to patient care. Responses were similarly positive after the inclusion of the performance evaluation. Conclusion This study demonstrated that the PGCPP is achieving the goal of enhancing the practice of pharmacists.

Development of an integrated GIS and land use planning course : impacts of hybrid instructional methods

This study reports an action research undertaken at Queensland University of Technology. It evaluates the effectiveness of the integration of GIS within the substantive domains of an existing land use planning course in 2011. Using student performance, learning experience survey, and questionnaire survey data, it also evaluates the impacts of incorporating hybrid instructional methods (e.g., in-class and online instructional videos) in 2012 and 2013. Results show that: students (re)iterated the importance of GIS in the course justifying the integration; the hybrid methods significantly increased student performance; and unlike replacement, the videos are more suitable as a complement to in-class activity.

Ship Motion Control : Course Keeping and Roll Stabilisation Using Rudder and Fins

Motion control systems have a significant impact on the performance of ships and marine structures allowing them to perform tasks in severe sea states and during long periods of time. Ships are designed to operate with adequate reliability and economy, and in order to achieve this, it is essential to control the motion. For each type of ship and operation performed (transit, landing a helicopter, fishing, deploying and recovering loads, etc.), there are not only desired motion settings, but also limits on the acceptable (undesired) motion induced by the environment. The task of a ship motion control system is therefore to act on the ship so it follows the desired motion as closely as possible. This book provides an introduction to the field of ship motion control by studying the control system designs for course-keeping autopilots with rudder roll stabilisation and integrated rudder-fin roll stabilisation. These particular designs provide a good overview of the difficulties encountered by designers of ship motion control systems and, therefore, serve well as an example driven introduction to the field. The idea of combining the control design of autopilots with that of fin roll stabilisers, and the idea of using rudder induced roll motion as a sole source of roll stabilisation seems to have emerged in the late 1960s. Since that time, these control designs have been the subject of continuous and ongoing research. This ongoing interest is a consequence of the significant bearing that the control strategy has on the performance and the issues associated with control system design. The challenges of these designs lie in devising a control strategy to address the following issues: underactuation, disturbance rejection with a non minimum phase system, input and output constraints, model uncertainty, and large unmeasured stochastic disturbances. To date, the majority of the work reported in the literature has focused strongly on some of the design issues whereas the remaining issues have been addressed using ad hoc approaches. This has provided an additional motivation for revisiting these control designs and looking at the benefits of applying a contemporary design framework, which can potentially address the majority of the design issues.

Course quality assurance at a glance

From 2014, QUT will be adopting a life-cycle approach to Course Quality Assurance informed by a wider and richer range of historic, ‘live’ and ‘predictive’ course data. Key data elements continue to be grouped according to the three broad categories – Viability, Quality of Learning Environment and Outcomes – and are further supported with analytic data presented within tables and charts. Course Quality Assurance and this Consolidated Courses Performance Report illuminate aspects of courses from a data evidence base highlighting the strengths and weaknesses of our courses. It provides the framework and tools to achieve QUT's commitment to excellent graduate outcomes by drawing attention and focus to the quality of our courses and providing a structured approach for bringing about change. Our portfolio of courses forms a vital part of QUT, generating almost $600 million in 2013 alone. Real world courses are fundamental to the strength of the Institution; they are what our many thousands of current and future students are drawn to and invest their time and aspirations in. As we move through a period of some regulatory and deregulatory uncertainty, there is a greater need for QUT to monitor and respond to the needs and expectations of our students. The life-cycle approach, with its rich and predicative data, provides the best source of evidence we have had, to date, to assure the quality of our courses and their relevance in a rapidly changing higher education context.

Differential effects of refractive blur on day and night-time driving performance

Purpose To investigate the effect of different levels of refractive blur on real-world driving performance measured under day and nighttime conditions. Methods Participants included 12 visually normal, young adults (mean age = 25.8 ± 5.2 years) who drove an instrumented research vehicle around a 4 km closed road circuit with three different levels of binocular spherical refractive blur (+0.50 diopter sphere [DS], +1.00 DS, +2.00 DS) compared with a baseline condition. The subjects wore optimal spherocylinder correction and the additional blur lenses were mounted in modified full-field goggles; the order of testing of the blur conditions was randomized. Driving performance was assessed in two different sessions under day and nighttime conditions and included measures of road signs recognized, hazard detection and avoidance, gap detection, lane-keeping, sign recognition distance, speed, and time to complete the course. Results Refractive blur and time of day had significant effects on driving performance (P < 0.05), where increasing blur and nighttime driving reduced performance on all driving tasks except gap judgment and lane keeping. There was also a significant interaction between blur and time of day (P < 0.05), such that the effects of blur were exacerbated under nighttime driving conditions; performance differences were evident even for +0.50 DS blur relative to baseline for some measures. Conclusions The effects of blur were greatest under nighttime conditions, even for levels of binocular refractive blur as low as +0.50 DS. These results emphasize the importance of accurate and up-to-date refractive correction of even low levels of refractive error when driving at night.

Performance dispersion for evidence-based classification of stationary throwers

Background There is a need for better understanding of the dispersion of classification-related variable to develop an evidence-based classification of athletes with a disability participating in stationary throwing events. Objectives The purposes of this study are (A) to describe tools designed to comprehend and represent the dispersion of the performance between successive classes, and (B) to present this dispersion for the elite male and female stationary shot-putters who participated in Beijing 2008 Paralympic Games. Study design Retrospective study Methods This study analysed a total of 479 attempts performed by 114 male and female stationary shot-putters in three F30s (F32-F34) and six F50s (F52-F58) classes during the course of eight events during Beijing 2008 Paralympic Games. Results The average differences of best performance were 1.46±0.46 m for males between F54 and F58 classes as well as 1.06±1.18 m for females between F55 and F58 classes. The results demonstrated a linear relationship between best performance and classification while revealing two male Gold Medallists in F33 and F52 classes were outliers. Conclusions This study confirms the benefits of the comparative matrices, performance continuum and dispersion plots to comprehend classification-related variables. The work presented here represents a stepping stone into biomechanical analyses of stationary throwers, particularly on the eve of the London 2012 Paralympic Games where new evidences could be gathered.

Social media, audiences, and audience co-creativity in contemporary performance: Restoring balance?

Producers, technicians, performers, audiences and critics are all critical components of the performing arts ecology – critical components of an ecosystem that have to come together into some sort of productive relationship if the performing arts are to be vital, viable and successful. Different performance practices developed in different times, spaces and places do, of course, connect these players in different ways as part of their attempt to achieve their own definition of success, be it based on entertainment, educational, expression, empowerment, or something else. In some contemporary performance practices, social media platforms, applications and processes are seen to have significant potential to restore balance to the relationship between performer and audience, providing audiences with more power to participate in a performance event. In this paper, I investigate prevailing assumptions about social media’s power to democratise performance practice, or, at least, develop more co-creative performance practices in which producers, performers and audiences participate actively before, during and after the event. I focus, in particular, on the use of social media as a means of developing a participatory aesthetic in which an audience member is asked to contribute to the cast of characters, plot or progression of a performance. Although diverse – from performances streamed online, to performances that offer transmedia components the audience can use to learn more about character, context and plot online, to performances that incorporate online voting, liking or linking, to performances that unfold fully online on websites, blogs, microblogs or other social media platforms – what a lot of uses of social media in contemporary performance today share is a desire to encourage audiences to reflect on their role in making, and making meaning, of the event. In this paper I interrogate if, and if so how, this democratises or develops deeper levels of co-creativity in the relationship between producers, performers and audiences.

Performance enhancement: A whole of person approach to first year dance students’ transition into tertiary training

The transition into university presents very particular challenges for students. The First Year Experience (FYE) is a transitional liminal phase, fraught with uncertainty, ripe with potential. The complexity inherent in this initial phase of tertiary education is well documented and continues to be interrogated. Providing timely and effective support and interventions for potentially at-risk first year students as they transition into tertiary study is a key priority for universities across the globe (Gale et al., 2015). This article outlines the evolution of an established and highly successful Transitional Training Program (TTP) for first year tertiary dance students, with particular reference to the 2015 iteration of the program. TTP design embraces three dimensions: physical training in transition, learning in transition, and teaching for transition, with an emphasis on developing and encouraging a mindset that enables information to be transferred into alternative settings for practice and learning throughout life. The aim of the 2015 TTP was to drive substantial change in first year Dance students’ satisfaction, connectedness, and overall performance within the Bachelor of Fine Arts (BFA) Dance course, through the development and delivery of innovative curriculum and pedagogical practices that promote the successful transition of dance students into their first year of university. The program targeted first year BFA Dance students through the integration of specific career guidance; performance psychology; academic skills support; practical dance skills support; and specialized curricula and pedagogy.