Experienced-based management of IMRT quality assurance

This study uses the detailed, bulk analyses of a set of treatment planning and quality assurance data from one radiotherapy centre to provide an illuminating example of the provision evidence-based advice on the management, and potential reduction, of an IMRT quality assurance workload.

Treatment plan complexity metrics for predicting IMRT pre-treatment quality assurance results

The planning of IMRT treatments requires a compromise between dose conformity (complexity) and deliverability. This study investigates established and novel treatment complexity metrics for 122 IMRT beams from prostate treatment plans. The Treatment and Dose Assessor software was used to extract the necessary data from exported treatment plan files and calculate the metrics. For most of the metrics, there was strong overlap between the calculated values for plans that passed and failed their quality assurance (QA) tests. However, statistically significant variation between plans that passed and failed QA measurements was found for the established modulation index and for a novel metric describing the proportion of small apertures in each beam. The ‘small aperture score’ provided threshold values which successfully distinguished deliverable treatment plans from plans that did not pass QA, with a low false negative rate.

Examination of the properties of IMRT and VMAT beams and evaluation against pre-treatment quality assurance results

This study aimed to provide a detailed evaluation and comparison of a range of modulated beam evaluation metrics, in terms of their correlation with QA testing results and their variation between treatment sites, for a large number of treatments. Ten metrics including the modulation index (MI), fluence map complexity (FMC), modulation complexity score (MCS), mean aperture displacement (MAD) and small aperture score (SAS) were evaluated for 546 beams from 122 IMRT and VMAT treatment plans targeting the anus, rectum, endometrium, brain, head and neck and prostate. The calculated sets of metrics were evaluated in terms of their relationships to each other and their correlation with the results of electronic portal imaging based quality assurance (QA) evaluations of the treatment beams. Evaluation of the MI, MAD and SAS suggested that beams used in treatments of the anus, rectum, head and neck were more complex than the prostate and brain treatment beams. Seven of the ten beam complexity metrics were found to be strongly correlated with the results from QA testing of the IMRT beams (p < 0.00008). For example, Values of SAS (with MLC apertures narrower than 10 mm defined as “small”) less than 0.2 also identified QA passing IMRT beams with 100% specificity. However, few of the metrics are correlated with the results from QA testing of the VMAT beams, whether they were evaluated as whole 360◦ arcs or as 60◦ sub-arcs. Select evaluation of beam complexity metrics (at least MI, MCS and SAS) is therefore recommended, as an intermediate step in the IMRT QA chain. Such evaluation may also be useful as a means of periodically reviewing VMAT planning or optimiser performance.

A tool to include gamma analysis software into a quality assurance program

PURPOSE: To provide a tool to enable gamma analysis software algorithms to be included in a quality assurance (QA) program.

METHODS: Four image sets were created comprising two geometric images to independently test the distance to agreement (DTA) and dose difference (DD) elements of the gamma algorithm, a clinical step and shoot IMRT field and a clinical VMAT arc. The images were analysed using global and local gamma analysis with 2 in-house and 8 commercially available software encompassing 15 software versions. The effect of image resolution on gamma pass rates was also investigated.

RESULTS: All but one software accurately calculated the gamma passing rate for the geometric images. Variation in global gamma passing rates of 1% at 3%/3mm and over 2% at 1%/1mm was measured between software and software versions with analysis of appropriately sampled images.

CONCLUSION: This study provides a suite of test images and the gamma pass rates achieved for a selection of commercially available software. This image suite will enable validation of gamma analysis software within a QA program and provide a frame of reference by which to compare results reported in the literature from various manufacturers and software versions.

Quality assurance in the 22991 EORTC ROG trial in localized prostate cancer: dummy run and individual case review.

INTRODUCTION: EORTC trial 22991 was designed to evaluate the addition of concomitant and adjuvant short-term hormonal treatments to curative radiotherapy in terms of disease-free survival for patients with intermediate risk localized prostate cancer. In order to assess the compliance to the 3D conformal radiotherapy protocol guidelines, all participating centres were requested to participate in a dummy run procedure. An individual case review was performed for the largest recruiting centres as well. MATERIALS AND METHODS: CT-data of an eligible prostate cancer patient were sent to 30 centres including a description of the clinical case. The investigator was requested to delineate the volumes of interest and to perform treatment planning according to the protocol. Thereafter, the investigators of the 12 most actively recruiting centres were requested to provide data on five randomly selected patients for an individual case review. RESULTS: Volume delineation varied significantly between investigators. Dose constraints for organs at risk (rectum, bladder, hips) were difficult to meet. In the individual case review, no major protocol deviations were observed, but a number of dose reporting problems were documented for centres using IMRT. CONCLUSIONS: Overall, results of this quality assurance program were satisfactory. The efficacy of the combination of a dummy run procedure with an individual case review is confirmed in this study, as none of the evaluated patient files harboured a major protocol deviation. Quality assurance remains a very important tool in radiotherapy to increase the reliability of the trial results. Special attention should be given when designing quality assurance programs for more complex irradiation techniques.

Use of EORTC Target Definition Guidelines for Dose-Intensified Salvage Radiation Therapy for Recurrent Prostate Cancer: Results of the Quality Assurance Program of the Randomized Trial SAKK 09/10

PURPOSE Different international target volume delineation guidelines exist and different treatment techniques are available for salvage radiation therapy (RT) for recurrent prostate cancer, but less is known regarding their respective applicability in clinical practice. METHODS AND MATERIALS A randomized phase III trial testing 64 Gy vs 70 Gy salvage RT was accompanied by an intense quality assurance program including a site-specific and study-specific questionnaire and a dummy run (DR). Target volume delineation was performed according to the European Organisation for the Research and Treatment of Cancer guidelines, and a DR-based treatment plan was established for 70 Gy. Major and minor protocol deviations were noted, interobserver agreement of delineated target contours was assessed, and dose-volume histogram (DVH) parameters of different treatment techniques were compared. RESULTS Thirty European centers participated, 43% of which were using 3-dimensional conformal RT (3D-CRT), with the remaining centers using intensity modulated RT (IMRT) or volumetric modulated arc technique (VMAT). The first submitted version of the DR contained major deviations in 21 of 30 (70%) centers, mostly caused by inappropriately defined or lack of prostate bed (PB). All but 5 centers completed the DR successfully with their second submitted version. The interobserver agreement of the PB was moderate and was improved by the DR review, as indicated by an increased κ value (0.59 vs 0.55), mean sensitivity (0.64 vs 0.58), volume of total agreement (3.9 vs 3.3 cm(3)), and decrease in the union volume (79.3 vs 84.2 cm(3)). Rectal and bladder wall DVH parameters of IMRT and VMAT vs 3D-CRT plans were not significantly different. CONCLUSIONS The interobserver agreement of PB delineation was moderate but was improved by the DR. Major deviations could be identified for the majority of centers. The DR has improved the acquaintance of the participating centers with the trial protocol.

Development and Implementation of the Use of Optically Stimulated Luminescent Detectors in the Radiological Physics Center Anthropomorphic Quality Assurance Phantoms

The Radiological Physics Center (RPC) uses both on-site and remote reviews to credential institutions for participation in clinical trials. Anthropomorphic quality assurance (QA) phantoms are one tool the RPC uses to remotely audit institutions, which include thermoluminescent dosimeters (TLDs) and radiochromic film. The RPC desires to switch from TLD as the absolute dosimeter in the phantoms, to optically stimulated luminescent dosimeters (OSLDs), but a problem lies in the angular dependence exhibited by the OSLD. The purpose of this study was to characterize the angular dependence of OSLD and establish a correction factor if necessary, to provide accurate dosimetric measurements as a replacement for TLD in the QA phantoms. A 10 cm diameter high-impact polystyrene spherical phantom was designed and constructed to hold an OSLD to study the angular response of the dosimeter under the simplest of circumstances for both coplanar and non-coplanar treatment deliveries. OSLD were irradiated in the spherical phantom, and the responses of the dosimeter from edge-on angles were normalized to the response when irradiated with the beam incident normally on the surface of the dosimeter. The average normalized response was used to establish an angular correction factor for 6 MV and 18 coplanar treatments, and for 6 MV non-coplanar treatments specific to CyberKnife. The RPC pelvic phantom dosimetry insert was modified to hold OSLD, in addition to the TLD, adjacent to the planes of film. Treatment plans of increasing angular beam delivery were developed, three in Pinnacle v9.0 (4-field box, IMRT, and VMAT) and one in Accuray’s MultiPlan v3.5.3 (CyberKnife). The plans were delivered to the pelvic phantom containing both TLD and OSLD in the target volume. The pelvic phantom was also sent to two institutions to be irradiated as trials, one delivering IMRT, and the other a CyberKnife treatment. For the IMRT deliveries and the two institution trials, the phantom also included film in the sagittal and coronal planes. The doses measured from the TLD and OSLD were calculated for each irradiation, and the angular correction factors established from the spherical phantom irradiations were applied to the OSLD dose. The ratio of the TLD dose to the angular corrected OSLD dose was calculated for each irradiation. The corrected OSLD dose was found to be within 1% of the TLD measured dose for all irradiations, with the exception of the in-house CyberKnife deliveries. The films were normalized to both TLD measured dose and the corrected OSLD dose. Dose profiles were obtained and gamma analysis was performed using a 7%/4 mm criteria, to compare the ability of the OSLD, when corrected for the angular dependence, to provide equivalent results to TLD. The results of this study indicate that the OSLD can effectively be used as a replacement for TLD in the RPC’s anthropomorphic QA phantoms for coplanar treatment deliveries when a correction is applied for the dosimeter’s angular dependence.

Quality assurance in higher education : for whom and of what?

Over the past two decades the quality assurance of higher education institutions has captured a growing interest as evidenced by the increasing number of national and transnational bodies engaged in this area. Yet as the first decade of the 21st century draws to a close, higher education systems and thus the regimes designed to ensure their quality are faced with significant complexity. Issues of accountability, authority and responsibility are paramount when responding to industry bodies, to globalisation and the transnational provision of higher education and to the use of market mechanisms. In this paper we raise some of the challenges for quality assurance for higher education presented by this growing complexity through the question, quality assurance in higher education, for whom and of what, highlighting our concern for a need to expand the centrality of accountability to include authority and responsibility as part of the quality assurance regimes for higher education

A risk-based approach to course quality assurance

A decade ago, Queensland University of Technology (QUT) developed an innovative annual Courses Performance Report, but through incremental change, this report became quite labour-intensive. A new risk-based approach to course quality assurance, that consolidates voluminous data in a simple dashboard, responds to the changing context of the higher education sector. This paper will briefly describe QUT’s context and outline the second phase of implementation of this new approach to course quality assurance. The main components are: Individual Course Reports (ICRs), the Consolidated Courses Performance Report (CCPR), Underperforming Courses Status Update and the Strategic Faculty Courses Update (SFCU). These components together form a parsimonious and strategic annual cycle of reporting and place QUT in a positive position to respond to future sector change

Building organizational capability through a quality assurance program within a business school and encouraging organizational culture change

This study explores organizational capability and culture change through a project developing an assurance of learning program in a business school. In order to compete internationally for high quality faculty, students, strategic partnerships and research collaborations it is essential for Universities to develop and maintain an international focus and a quality produce that predicts excellence in the student experience and graduate outcomes that meet industry needs. Developing, marketing and delivering that quality product requires an organizational strategy to which all members of the organization contribute and adhere. Now, the ability to acquire, share and utilize knowledge has become a critical organizational capability in academia as well as other industries. Traditionally the functional approach to business school structures and disparate nature of the social networks and work contact limit the sharing of knowledge between academics working in different disciplines. In this project a community of practice program was established to include academics in the development of an embedded assurance of learning program affecting more than 5000 undergraduate students and 250 academics from nine different disciplines across four schools. The primary outcome from the fully developed and implemented assurance of learning program was the five year accreditation of the business schools programs by two international accrediting bodies, EQUIS and AACSB. However this study explores a different outcome, namely the change in organizational culture and individual capabilities as academics worked together in teaching and learning teams. This study uses a survey and interviews with academics involved, through a retrospective panel design which contained an experimental group and a control group. Results offer insights into communities of practice as a means of addressing organizational capability and changes in organizational culture. Knowledge management and shared learning can achieve strategic and operational benefits equally within academia as within other industrial enterprises but it comes at a cost. Traditional structures, academics that act like individual contractors and deep divides across research, teaching and service interest served a different master and required fewer resources. Collaborative structures; fewer master categories of discrete knowledge areas; specific strategic goals; greater links between academics and industry; and the means to share learned insights will require a different approach to resourcing both the individual and the team.