Quality assurance in higher education : for whom and of what?

Over the past two decades the quality assurance of higher education institutions has captured a growing interest as evidenced by the increasing number of national and transnational bodies engaged in this area. Yet as the first decade of the 21st century draws to a close, higher education systems and thus the regimes designed to ensure their quality are faced with significant complexity. Issues of accountability, authority and responsibility are paramount when responding to industry bodies, to globalisation and the transnational provision of higher education and to the use of market mechanisms. In this paper we raise some of the challenges for quality assurance for higher education presented by this growing complexity through the question, quality assurance in higher education, for whom and of what, highlighting our concern for a need to expand the centrality of accountability to include authority and responsibility as part of the quality assurance regimes for higher education

A risk-based approach to course quality assurance

A decade ago, Queensland University of Technology (QUT) developed an innovative annual Courses Performance Report, but through incremental change, this report became quite labour-intensive. A new risk-based approach to course quality assurance, that consolidates voluminous data in a simple dashboard, responds to the changing context of the higher education sector. This paper will briefly describe QUT’s context and outline the second phase of implementation of this new approach to course quality assurance. The main components are: Individual Course Reports (ICRs), the Consolidated Courses Performance Report (CCPR), Underperforming Courses Status Update and the Strategic Faculty Courses Update (SFCU). These components together form a parsimonious and strategic annual cycle of reporting and place QUT in a positive position to respond to future sector change

Building organizational capability through a quality assurance program within a business school and encouraging organizational culture change

This study explores organizational capability and culture change through a project developing an assurance of learning program in a business school. In order to compete internationally for high quality faculty, students, strategic partnerships and research collaborations it is essential for Universities to develop and maintain an international focus and a quality produce that predicts excellence in the student experience and graduate outcomes that meet industry needs. Developing, marketing and delivering that quality product requires an organizational strategy to which all members of the organization contribute and adhere. Now, the ability to acquire, share and utilize knowledge has become a critical organizational capability in academia as well as other industries. Traditionally the functional approach to business school structures and disparate nature of the social networks and work contact limit the sharing of knowledge between academics working in different disciplines. In this project a community of practice program was established to include academics in the development of an embedded assurance of learning program affecting more than 5000 undergraduate students and 250 academics from nine different disciplines across four schools. The primary outcome from the fully developed and implemented assurance of learning program was the five year accreditation of the business schools programs by two international accrediting bodies, EQUIS and AACSB. However this study explores a different outcome, namely the change in organizational culture and individual capabilities as academics worked together in teaching and learning teams. This study uses a survey and interviews with academics involved, through a retrospective panel design which contained an experimental group and a control group. Results offer insights into communities of practice as a means of addressing organizational capability and changes in organizational culture. Knowledge management and shared learning can achieve strategic and operational benefits equally within academia as within other industrial enterprises but it comes at a cost. Traditional structures, academics that act like individual contractors and deep divides across research, teaching and service interest served a different master and required fewer resources. Collaborative structures; fewer master categories of discrete knowledge areas; specific strategic goals; greater links between academics and industry; and the means to share learned insights will require a different approach to resourcing both the individual and the team.

Future directions in course quality assurance

The Course Quality Assurance System at Queensland University of Technology (QUT) has as its centrepiece an exemplar of data visualisation known as the Individual Course Report (ICR). This report provides every course coordinator with an annual snapshot of their performance data evaluated against QUT and national benchmarks. In this article, the impact of the ICR is explored through the case study of one undergraduate course identified as underperforming. The case study features an innovative, ethnographic approach to working with course teams and highlights the importance of context, collaboration and appropriate support in creating evidence-based action plans for course improvement.

A higher education quality assurance model for small states : the Maldives case study

Increasing globalisation and local expansion of Higher Education presents challenges to manage quality of the education services. This study investigated key stakeholders' perspectives on what constitutes key elements and attributes of an effective Quality Assurance (QA) system in Higher Education. The findings highlighted the need for: i) legislation to support a strong QA regulatory framework, ii) independence of the QA agency, iii) development of minimum quality standards through broad stakeholder involvement, and iv) a cyclical approach. The findings of this study proposed a QA model which has implications for strengthening of HE QA systems of Small State.

Treatment plan complexity metrics for predicting IMRT pre-treatment quality assurance results

The planning of IMRT treatments requires a compromise between dose conformity (complexity) and deliverability. This study investigates established and novel treatment complexity metrics for 122 IMRT beams from prostate treatment plans. The Treatment and Dose Assessor software was used to extract the necessary data from exported treatment plan files and calculate the metrics. For most of the metrics, there was strong overlap between the calculated values for plans that passed and failed their quality assurance (QA) tests. However, statistically significant variation between plans that passed and failed QA measurements was found for the established modulation index and for a novel metric describing the proportion of small apertures in each beam. The ‘small aperture score’ provided threshold values which successfully distinguished deliverable treatment plans from plans that did not pass QA, with a low false negative rate.

Can the use of quality assurance tools reduce the impact of surgical complications on the well-being of obstetricians and gynaecologists in Australia and New Zealand?

Background While adverse events primarily affect the patient, surgeons involved can also experience considerable distress. Aims The aim of the survey was to assess the impact of complications on the day-to-day life, work and health of Australian and New Zealand obstetricians and gynaecologists and to evaluate existing support systems and coping strategies. Methods A 43-question survey on self-assessment, quality assurance (QA) tools, impact of complications on individuals’ health and relationships, and support available was emailed to fellows, trainees, subspecialists and subspecialty trainees of the Royal Australian and New Zealand College of Obstetrics and Gynaecology (RANZCOG). We collected 606 responses from a target population of 2296 (response rate 26.3%). Results When complications occur, sleep was affected of 80%, family and social relationships of 55% and physical health of 48% of respondents. The major sources of support were from colleagues (83%), family (82%) and medical defence organisations (73%), with professional bodies perceived as providing least support. Nearly 80% of respondents felt the need to talk to someone they trust during times of complications. Overall, 100% of respondents used at least one QA tool (62% used two, 26% three and 9% four QA strategies). There were significant differences between respondent groups in use of the QA tools. Conclusions Surgical complications have a significant impact on the well-being of Australian and New Zealand obstetricians and gynaecologists. Existing support comes from colleagues and family, but structured, unbiased support for surgeons from a professional source is urgently warranted.

Course quality assurance at a glance

From 2014, QUT will be adopting a life-cycle approach to Course Quality Assurance informed by a wider and richer range of historic, ‘live’ and ‘predictive’ course data. Key data elements continue to be grouped according to the three broad categories – Viability, Quality of Learning Environment and Outcomes – and are further supported with analytic data presented within tables and charts. Course Quality Assurance and this Consolidated Courses Performance Report illuminate aspects of courses from a data evidence base highlighting the strengths and weaknesses of our courses. It provides the framework and tools to achieve QUT's commitment to excellent graduate outcomes by drawing attention and focus to the quality of our courses and providing a structured approach for bringing about change. Our portfolio of courses forms a vital part of QUT, generating almost $600 million in 2013 alone. Real world courses are fundamental to the strength of the Institution; they are what our many thousands of current and future students are drawn to and invest their time and aspirations in. As we move through a period of some regulatory and deregulatory uncertainty, there is a greater need for QUT to monitor and respond to the needs and expectations of our students. The life-cycle approach, with its rich and predicative data, provides the best source of evidence we have had, to date, to assure the quality of our courses and their relevance in a rapidly changing higher education context.

Quality assurance of aerial applications of larvicides for mosquito control : effects of granule and catch tray size on field monitoring programs

Aerial applications of granular insecticides are preferable because they can effectively penetrate vegetation, there is less drift, and no loss of product due to evaporation. We aimed to 1) assess the field efficacy ofVectoBac G to control Aedes vigilax (Skuse) in saltmarsh pools, 2) develop a stochastic-modeling procedure to monitor application quality, and 3) assess the distribution of VectoBac G after an aerial application. Because ground-based studies with Ae. vigilax immatures found that VectoBac G provided effective control below the recommended label rate of 7 kg/ha, we trialed a nominated aerial rate of 5 kg/ha as a case study. Our distribution pattern modeling method indicated that the variability in the number of VectoBac G particles captured in catch-trays was greater than expected for 5 kg/ha and that the widely accepted contour mapping approach to visualize the deposition pattern provided spurious results and therefore was not statistically appropriate. Based on the results of distribution pattern modeling, we calculated the catch tray size required to analyze the distribution of aerially applied granular formulations. The minimum catch tray size for products with large granules was 4 m2 for Altosid pellets and 2 m2 for VectoBac G. In contrast, the minimum catch-tray size for Altosid XRG, Aquabac G, and Altosand, with smaller granule sizes, was 1 m2. Little gain in precision would be made by increasing the catch-tray size further, when the increased workload and infrastructure is considered. Our improved methods for monitoring the distribution pattern of aerially applied granular insecticides can be adapted for use by both public health and agricultural contractors.

Experienced-based management of IMRT quality assurance

This study uses the detailed, bulk analyses of a set of treatment planning and quality assurance data from one radiotherapy centre to provide an illuminating example of the provision evidence-based advice on the management, and potential reduction, of an IMRT quality assurance workload.

Examination of the properties of IMRT and VMAT beams and evaluation against pre-treatment quality assurance results

This study aimed to provide a detailed evaluation and comparison of a range of modulated beam evaluation metrics, in terms of their correlation with QA testing results and their variation between treatment sites, for a large number of treatments. Ten metrics including the modulation index (MI), fluence map complexity (FMC), modulation complexity score (MCS), mean aperture displacement (MAD) and small aperture score (SAS) were evaluated for 546 beams from 122 IMRT and VMAT treatment plans targeting the anus, rectum, endometrium, brain, head and neck and prostate. The calculated sets of metrics were evaluated in terms of their relationships to each other and their correlation with the results of electronic portal imaging based quality assurance (QA) evaluations of the treatment beams. Evaluation of the MI, MAD and SAS suggested that beams used in treatments of the anus, rectum, head and neck were more complex than the prostate and brain treatment beams. Seven of the ten beam complexity metrics were found to be strongly correlated with the results from QA testing of the IMRT beams (p < 0.00008). For example, Values of SAS (with MLC apertures narrower than 10 mm defined as “small”) less than 0.2 also identified QA passing IMRT beams with 100% specificity. However, few of the metrics are correlated with the results from QA testing of the VMAT beams, whether they were evaluated as whole 360◦ arcs or as 60◦ sub-arcs. Select evaluation of beam complexity metrics (at least MI, MCS and SAS) is therefore recommended, as an intermediate step in the IMRT QA chain. Such evaluation may also be useful as a means of periodically reviewing VMAT planning or optimiser performance.

Quality assurance of assessment and moderation discourses involving sessional staff

Quality assurance is a major agenda in tertiary education. The casualisation of academic work, especially in teaching, is also a quality assurance issue. Casual or sessional staff members teach and assess more than 50% of all university courses in Australia, and yet the research in relation to the role sessional staff play in quality assurance of student assessment outcomes is scarce. Moderation processes are a pivotal part of robust quality assurance measures. Drawing upon previous work surrounding four discourses of moderation, this pilot project reports the results of research into the role and impact of sessional staff in moderation processes at tertiary level. Qualitative data were gathered through focus interviews. Results, in the form of various moderation discourses, indicate that sessional staff impact the formal quality assurance processes in numerous ways.