Can prospective usability evaluation predict data errors?

Increasing amounts of clinical research data are collected by manual data entry into electronic source systems and directly from research subjects. For this manual entered source data, common methods of data cleaning such as post-entry identification and resolution of discrepancies and double data entry are not feasible. However data accuracy rates achieved without these mechanisms may be higher than desired for a particular research use. We evaluated a heuristic usability method for utility as a tool to independently and prospectively identify data collection form questions associated with data errors. The method evaluated had a promising sensitivity of 64% and a specificity of 67%. The method was used as described in the literature for usability with no further adaptations or specialization for predicting data errors. We conclude that usability evaluation methodology should be further investigated for use in data quality assurance.

Improving follow-up of abnormal cancer screens using electronic health records: trust but verify test result communication.

BACKGROUND: Early detection of colorectal cancer through timely follow-up of positive Fecal Occult Blood Tests (FOBTs) remains a challenge. In our previous work, we found 40% of positive FOBT results eligible for colonoscopy had no documented response by a treating clinician at two weeks despite procedures for electronic result notification. We determined if technical and/or workflow-related aspects of automated communication in the electronic health record could lead to the lack of response. METHODS: Using both qualitative and quantitative methods, we evaluated positive FOBT communication in the electronic health record of a large, urban facility between May 2008 and March 2009. We identified the source of test result communication breakdown, and developed an intervention to fix the problem. Explicit medical record reviews measured timely follow-up (defined as response within 30 days of positive FOBT) pre- and post-intervention. RESULTS: Data from 11 interviews and tracking information from 490 FOBT alerts revealed that the software intended to alert primary care practitioners (PCPs) of positive FOBT results was not configured correctly and over a third of positive FOBTs were not transmitted to PCPs. Upon correction of the technical problem, lack of timely follow-up decreased immediately from 29.9% to 5.4% (p<0.01) and was sustained at month 4 following the intervention. CONCLUSION: Electronic communication of positive FOBT results should be monitored to avoid limiting colorectal cancer screening benefits. Robust quality assurance and oversight systems are needed to achieve this. Our methods may be useful for others seeking to improve follow-up of FOBTs in their systems.

EVALUATION OF INTENSITY MODULATED RADIATION THERAPY (IMRT) DELIVERY ERROR DUE TO IMRT TREATMENT PLAN COMPLEXITY AND IMPROPERLY MATCHED DOSIMETRY DATA

Intensity modulated radiation therapy (IMRT) is a technique that delivers a highly conformal dose distribution to a target volume while attempting to maximally spare the surrounding normal tissues. IMRT is a common treatment modality used for treating head and neck (H&N) cancers, and the presence of many critical structures in this region requires accurate treatment delivery. The Radiological Physics Center (RPC) acts as both a remote and on-site quality assurance agency that credentials institutions participating in clinical trials. To date, about 30% of all IMRT participants have failed the RPC’s remote audit using the IMRT H&N phantom. The purpose of this project is to evaluate possible causes of H&N IMRT delivery errors observed by the RPC, specifically IMRT treatment plan complexity and the use of improper dosimetry data from machines that were thought to be matched but in reality were not. Eight H&N IMRT plans with a range of complexity defined by total MU (1460-3466), number of segments (54-225), and modulation complexity scores (MCS) (0.181-0.609) were created in Pinnacle v.8m. These plans were delivered to the RPC’s H&N phantom on a single Varian Clinac. One of the IMRT plans (1851 MU, 88 segments, and MCS=0.469) was equivalent to the median H&N plan from 130 previous RPC H&N phantom irradiations. This average IMRT plan was also delivered on four matched Varian Clinac machines and the dose distribution calculated using a different 6MV beam model. Radiochromic film and TLD within the phantom were used to analyze the dose profiles and absolute doses, respectively. The measured and calculated were compared to evaluate the dosimetric accuracy. All deliveries met the RPC acceptance criteria of ±7% absolute dose difference and 4 mm distance-to-agreement (DTA). Additionally, gamma index analysis was performed for all deliveries using a ±7%/4mm and ±5%/3mm criteria. Increasing the treatment plan complexity by varying the MU, number of segments, or varying the MCS resulted in no clear trend toward an increase in dosimetric error determined by the absolute dose difference, DTA, or gamma index. Varying the delivery machines as well as the beam model (use of a Clinac 6EX 6MV beam model vs. Clinac 21EX 6MV model), also did not show any clear trend towards an increased dosimetric error using the same criteria indicated above.

Evaluation of deformable image registration for improved 4D CT-derived ventilation for image guided radiotherapy

Recent treatment planning studies have demonstrated the use of physiologic images in radiation therapy treatment planning to identify regions for functional avoidance. This image-guided radiotherapy (IGRT) strategy may reduce the injury and/or functional loss following thoracic radiotherapy. 4D computed tomography (CT), developed for radiotherapy treatment planning, is a relatively new imaging technique that allows the acquisition of a time-varying sequence of 3D CT images of the patient's lungs through the respiratory cycle. Guerrero et al. developed a method to calculate ventilation imaging from 4D CT, which is potentially better suited and more broadly available for IGRT than the current standard imaging methods. The key to extracting function information from 4D CT is the construction of a volumetric deformation field that accurately tracks the motion of the patient's lungs during the respiratory cycle. The spatial accuracy of the displacement field directly impacts the ventilation images; higher spatial registration accuracy will result in less ventilation image artifacts and physiologic inaccuracies. Presently, a consistent methodology for spatial accuracy evaluation of the DIR transformation is lacking. Evaluation of the 4D CT-derived ventilation images will be performed to assess correlation with global measurements of lung ventilation, as well as regional correlation of the distribution of ventilation with the current clinical standard SPECT. This requires a novel framework for both the detailed assessment of an image registration algorithm's performance characteristics as well as quality assurance for spatial accuracy assessment in routine application. Finally, we hypothesize that hypo-ventilated regions, identified on 4D CT ventilation images, will correlate with hypo-perfused regions in lung cancer patients who have obstructive lesions. A prospective imaging trial of patients with locally advanced non-small-cell lung cancer will allow this hypothesis to be tested. These advances are intended to contribute to the validation and clinical implementation of CT-based ventilation imaging in prospective clinical trials, in which the impact of this imaging method on patient outcomes may be tested.

Reasons for the persistence of adverse events in the era of safer surgery - a qualitative approach

OBJECTIVE We sought to evaluate potential reasons given by board-certified doctors for the persistence of adverse events despite efforts to improve patient safety in Switzerland. SUMMARY BACKGROUND DATA In recent years, substantial efforts have been made to improve patient safety by introducing surgical safety checklists to standardise surgeries and team procedures. Still, a high number of adverse events remain. METHODS Clinic directors in operative medicine in Switzerland were asked to answer two questions concerning the reasons for persistence of adverse events, and the advantages and disadvantages of introducing and implementing surgical safety checklists. Of 799 clinic directors, the arguments of 237 (29.7%) were content-analysed using Mayring's content analysis method, resulting in 12 different categories. RESULTS Potential reasons for the persistence of adverse events were mainly seen as being related to the "individual" (126/237, 53.2%), but directors of high-volume clinics identified factors related to the "group and interactions" significantly more often as a reason (60.2% vs 40.2%; p = 0.003). Surgical safety checklists were thought to have positive effects on the "organisational level" (47/237, 19.8%), the "team level" (37/237, 15.6%) and the "patient level" (40/237, 16.9%), with a "lack of willingness to implement checklists" as the main disadvantage (34/237, 14.3%). CONCLUSION This qualitative study revealed the individual as the main player in the persistence of adverse events. Working conditions should be optimised to minimise interface problems in the case of cross-covering of patients, to assure support for students, residents and interns, and to reduce strain. Checklists are helpful on an "organisational level" (e.g., financial benefits, quality assurance) and to clarify responsibilities.

Identification of cryptic Anopheles mosquito species by molecular protein profiling.

Vector control is the mainstay of malaria control programmes. Successful vector control profoundly relies on accurate information on the target mosquito populations in order to choose the most appropriate intervention for a given mosquito species and to monitor its impact. An impediment to identify mosquito species is the existence of morphologically identical sibling species that play different roles in the transmission of pathogens and parasites. Currently PCR diagnostics are used to distinguish between sibling species. PCR based methods are, however, expensive, time-consuming and their development requires a priori DNA sequence information. Here, we evaluated an inexpensive molecular proteomics approach for Anopheles species: matrix assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS). MALDI-TOF MS is a well developed protein profiling tool for the identification of microorganisms but so far has received little attention as a diagnostic tool in entomology. We measured MS spectra from specimens of 32 laboratory colonies and 2 field populations representing 12 Anopheles species including the A. gambiae species complex. An important step in the study was the advancement and implementation of a bioinformatics approach improving the resolution over previously applied cluster analysis. Borrowing tools for linear discriminant analysis from genomics, MALDI-TOF MS accurately identified taxonomically closely related mosquito species, including the separation between the M and S molecular forms of A. gambiae sensu stricto. The approach also classifies specimens from different laboratory colonies; hence proving also very promising for its use in colony authentication as part of quality assurance in laboratory studies. While being exceptionally accurate and robust, MALDI-TOF MS has several advantages over other typing methods, including simple sample preparation and short processing time. As the method does not require DNA sequence information, data can also be reviewed at any later stage for diagnostic or functional patterns without the need for re-designing and re-processing biological material.

Determination of genetic transferrin variants in human serum by high-resolution capillary zone electrophoresis(†)

High-resolution capillary zone electrophoresis in the routine arena with stringent quality assurance is employed for the determination of carbohydrate-deficient transferrin in human serum. The assay comprises mixing of human serum with a Fe(III) -containing solution prior to analysis of the iron-saturated mixture in a dynamically double-coated capillary using a commercial buffer at alkaline pH. In contrast to other assays, it provides sufficient resolution for proper recognition of genetic transferrin variants. Analysis of 7290 patient sera revealed 166 isoform patterns that could be assigned to genetic variants, namely, 109 BC, 53 CD, one BD and three CC variants. Several subtypes of transferrin D can be distinguished as they have large enough differences in pI values. Subtypes of transferrin C and B cannot be resolved. However, analysis of the detection time ratios of tetrasialo isoforms of transferrin BC and transferrin CD variants revealed multimodal frequency histograms, indicating the presence of subtypes of transferrin C, B and D. The data gathered over 11 years demonstrate the robustness of the high-resolution capillary zone electrophoresis assay. This is the first account of a capillary zone electrophoresis based carbohydrate-deficient transferrin assay with a broad overview on transferrin isoform patterns associated with genetic transferrin variants.

The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar undertaking. Keywords: national final examination, licensing examination, summative assessment, OSCE, action research

THEODORE, a two-step heating system for the EC/OC determination of radiocarbon (14C) in the environment

Measurements of 14C in the organic carbon (OC) and elemental carbon (EC) fractions, respectively, of fine aerosol particles bear the potential to apportion anthropogenic and biogenic emission sources. For this purpose, the system THEODORE (two-step heating system for the EC/OC determination of radiocarbon in the environment) was developed. In this device, OC and EC are transformed into carbon dioxide in a stream of oxygen at 340 and 650 �C, respectively, and reduced to filamentous carbon. This is the target material for subsequent accelerator mass spectrometry (AMS) 14C measurements, which were performed on sub-milligram carbon samples at the PSI/ETH compact 500 kV AMS system. Quality assurance measurements of SRM 1649a, Urban Dust, yielded a fraction of modern fM in total carbon (TC) of 0.522 ±0.018 (n ¼ 5, 95% confidence level) in agreement with reported values. The results for OC and EC are 0.70± 0.05 (n ¼ 3) and 0.066 ± 0.020 (n ¼ 4), respectively.

Enhancing Authenticity in Simulation Using Appropriate Techniques of Moulage

Workshop Overview The use of special effects (moulage) is a way to augment the authenticity of a scenario in simulation. This workshop will introduce different techniques of moulage (oil based cream colors, watercolors, transfer tattoos and 3D Prosthetics). The participants will have the opportunity to explore these techniques by applying various moulages. They will compare the techniques and discuss their advantages and disadvantages. Moreover, strategies for standardization and quality assurance will be discussed. Workshop Rationale Moulage supports the sensory perception in an scenario (1). It can provide evaluation clues (2) and help learners (and SPs) to engage in the simulation. However, it is of crucial importance that the simulated physical pathologies are represented accurate and reliable. Accuracy is achieved by using the appropriate technique, which requires knowledge and practice . With information about different moulage techniques, we hope to increases the knowledge of moulage during the workshop. By applying moulages in various techniques we will practice together. As standardization is critical for simulation scenarios in assessment (3, 4) strategies for standardization of moulage will be introduced and discussed. Workshop Objectives During the workshop participants will: - gain knowledge about different techniques of moulages - practice moulages in various techniques - discuss the advantages and disadvantages of moulage techniques - describe strategies for standardization and quality assurance of moulage Planned Format 5 min Introduction 15 min Overview – Background & Theory (presentation) 15 min Application of moulage for ankle sprain in 4 different techniques (oil based cream color, water color, temporary tatoo, 3D prosthetic) in small groups 5 min Comparing the results by interactive viewing of prepared moulages 15 min Application of moulages for burn in different techniques in small groups 5 min Comparing results the results by interactive viewing of prepared moulages 5 min Sharing experiences with different techniques in small groups 20 min Discussion of the techniques including standardization and quality assurance strategies (plenary discussion) 5 min Summary / Take home points

The design and evaluation of a 2D dose verification system for intensity modulated radiotherapy

The usage of intensity modulated radiotherapy (IMRT) treatments necessitates a significant amount of patient-specific quality assurance (QA). This research has investigated the precision and accuracy of Kodak EDR2 film measurements for IMRT verifications, the use of comparisons between 2D dose calculations and measurements to improve treatment plan beam models, and the dosimetric impact of delivery errors. New measurement techniques and software were developed and used clinically at M. D. Anderson Cancer Center. The software implemented two new dose comparison parameters, the 2D normalized agreement test (NAT) and the scalar NAT index. A single-film calibration technique using multileaf collimator (MLC) delivery was developed. EDR2 film's optical density response was found to be sensitive to several factors: radiation time, length of time between exposure and processing, and phantom material. Precision of EDR2 film measurements was found to be better than 1%. For IMRT verification, EDR2 film measurements agreed with ion chamber results to 2%/2mm accuracy for single-beam fluence map verifications and to 5%/2mm for transverse plane measurements of complete plan dose distributions. The same system was used to quantitatively optimize the radiation field offset and MLC transmission beam modeling parameters for Varian MLCs. While scalar dose comparison metrics can work well for optimization purposes, the influence of external parameters on the dose discrepancies must be minimized. The ability of 2D verifications to detect delivery errors was tested with simulated data. The dosimetric characteristics of delivery errors were compared to patient-specific clinical IMRT verifications. For the clinical verifications, the NAT index and percent of pixels failing the gamma index were exponentially distributed and dependent upon the measurement phantom but not the treatment site. Delivery errors affecting all beams in the treatment plan were flagged by the NAT index, although delivery errors impacting only one beam could not be differentiated from routine clinical verification discrepancies. Clinical use of this system will flag outliers, allow physicists to examine their causes, and perhaps improve the level of agreement between radiation dose distribution measurements and calculations. The principles used to design and evaluate this system are extensible to future multidimensional dose measurements and comparisons. ^

Federally regulated institutional review boards: The aspects of a "model" IRB---Is the current system in need of a tune up or complete overhaul?

Institutional Review Boards (IRBs) are the primary gatekeepers for the protection of ethical standards of federally regulated research on human subjects in this country. This paper focuses on what general, broad measures that may be instituted or enhanced to exemplify a "model IRB". This is done by examining the current regulatory standards of federally regulated IRBs, not private or commercial boards, and how many of those standards have been found either inadequate or not generally understood or followed. The analysis includes suggestions on how to bring about changes in order to make the IRB process more efficient, less subject to litigation, and create standardized educational protocols for members. The paper also considers how to include better oversight for multi-center research, increased centralization of IRBs, utilization of Data Safety Monitoring Boards when necessary, payment for research protocol review, voluntary accreditation, and the institution of evaluation/quality assurance programs. ^ This is a policy study utilizing secondary analysis of publicly available data. Therefore, the research for this paper focuses on scholarly medical/legal journals, web information from the Department of Health and Human Services, Federal Drug Administration, and the Office of the Inspector General, Accreditation Programs, law review articles, and current regulations applicable to the relevant portions of the paper. ^ Two issues are found to be consistently cited by the literature as major concerns. One is a need for basic, standardized educational requirements across all IRBs and its members, and secondly, much stricter and more informed management of continuing research. There is no federally regulated formal education system currently in place for IRB members, except for certain NIH-based trials. Also, IRBs are not keeping up with research once a study has begun, and although regulated to do so, it does not appear to be a great priority. This is the area most in danger of increased litigation. Other issues such as voluntary accreditation and outcomes evaluation are slowing gaining steam as the processes are becoming more available and more sought after, such as JCAHO accrediting of hospitals. ^ Adopting the principles discussed in this paper should promote better use of a local IRBs time, money, and expertise for protecting the vulnerable population in their care. Without further improvements to the system, there is concern that private and commercial IRBs will attempt to create a monopoly on much of the clinical research in the future as they are not as heavily regulated and can therefore offer companies quicker and more convenient reviews. IRBs need to consider the advantages of charging for their unique and important services as a cost of doing business. More importantly, there must be a minimum standard of education for all IRB members in the area of the ethical standards of human research and a greater emphasis placed on the follow-up of ongoing research as this is the most critical time for study participants and may soon lead to the largest area for litigation. Additionally, there should be a centralized IRB for multi-site trials or a study website with important information affecting the trial in real time. There needs to be development of standards and metrics to assess the performance of the IRBs for quality assurance and outcome evaluations. The boards should not be content to run the business of human subjects' research without determining how well that function is actually being carried out. It is important that federally regulated IRBs provide excellence in human research and promote those values most important to the public at large.^

CHARACTERIZATION OF THE COUNT RATE PERFORMANCE AND EVALUATION OF THE EFFECTS OF HIGH COUNT RATES ON MODERN GAMMA CAMERAS

CHARACTERIZATION OF THE COUNT RATE PERFORMANCE AND EVALUATION OF THE EFFECTS OF HIGH COUNT RATES ON MODERN GAMMA CAMERAS Michael Stephen Silosky, B.S. Supervisory Professor: S. Cheenu Kappadath, Ph.D. Evaluation of count rate performance (CRP) is an integral component of gamma camera quality assurance and measurement of system dead time (τ) is important for quantitative SPECT. The CRP of three modern gamma cameras was characterized using established methods (Decay and Dual Source) under a variety of experimental conditions. For the Decay method, input count rate was plotted against observed count rate and fit to the paralyzable detector model (PDM) to estimate τ (Rates method). A novel expression for observed counts as a function of measurement time interval was derived and the observed counts were fit to this expression to estimate τ (Counts method). Correlation and Bland-Altman analysis were performed to assess agreement in estimates of τ between methods. The dependencies of τ on energy window definition and incident energy spectrum were characterized. The Dual Source method was also used to estimate τ and its agreement with the Decay method under identical conditions and the effects of total activity and the ratio of source activities were investigated. Additionally, the effects of count rate on several performance metrics were evaluated. The CRP curves for each system agreed with the PDM at low count rates but deviated substantially at high count rates. Estimates of τ for the paralyzable portion of the CRP curves using the Rates and Counts methods were highly correlated (r=0.999) but with a small (~6%) difference. No significant difference was observed between the highly correlated estimates of τ using the Decay or Dual Source methods under identical experimental conditions (r=0.996). Estimates of τ increased as a power-law function with decreasing ratio of counts in the photopeak to the total counts and linearly with decreasing spectral effective energy. Dual Source method estimates of τ varied as a quadratic with the ratio of the single source to combined source activities and linearly with total activity used across a large range. Image uniformity, spatial resolution, and energy resolution degraded linearly with count rate and image distorting effects were observed. Guidelines for CRP testing and a possible method for the correction of count rate losses for clinical images have been proposed.

Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy

DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY by James Leroy Neihart, B.S. APPROVED: ______________________________David Followill, Ph.D. ______________________________Peter Balter, Ph.D. ______________________________Narayan Sahoo, Ph.D. ______________________________Kenneth Hess, Ph.D. ______________________________Paige Summers, M.S. APPROVED: ____________________________ Dean, The University of Texas Graduate School of Biomedical Sciences at Houston DEVELOPMENT AND IMPLEMENTATION OF A DYNAMIC HETEROGENEOUS PROTON EQUIVALENT ANTHROPOMORPHIC THORAX PHANTOM FOR THE ASSESSMENT OF SCANNED PROTON BEAM THERAPY A THESIS Presented to the Faculty of The University of Texas Health Science Center at Houston andThe University of TexasMD Anderson Cancer CenterGraduate School of Biomedical Sciences in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE by James Leroy Neihart, B.S. Houston, Texas Date of Graduation August, 2013 Acknowledgments I would like to acknowledge my advisory committee members, chair David Followill, Ph.D., Peter Balter, Ph.D, Narayan Sahoo, Ph.D., Kenneth Hess, Ph.D., Paige Summers M.S. and, for their time and effort contributed to this project. I would additionally like to thank the faculty and staff at the PTC-H and the RPC who assisted in many aspects of this project. Falk Pӧnisch, Ph.D. for his breath hold proton therapy treatment expertise, Matt Palmer and Jaques Bluett for proton dosimetry assistance, Matt Kerr for verification plan assistance, Carrie Amador, Nadia Hernandez, Trang Nguyen, Andrea Molineu, Lynda McDonald for TLD and film dosimetry assistance. Finally, I would like to thank my wife and family for their support and encouragement during my research and studies. Development and implementation of a dynamic heterogeneous proton equivalent anthropomorphic thorax phantom for the assessment of scanned proton beam therapy By: James Leroy Neihart, B.S. Chair of Advisory Committee: David Followill, Ph.D Proton therapy has been gaining ground recently in radiation oncology. To date, the most successful utilization of proton therapy is in head and neck cases as well as prostate cases. These tumor locations do not suffer from the resulting difficulties of treatment delivery as a result of respiratory motion. Lung tumors require either breath hold or motion tracking, neither of which have been assessed with an end-to-end phantom for proton treatments. Currently, the RPC does not have a dynamic thoracic phantom for proton therapy procedure assessment. Additionally, such a phantom could be an excellent means of assessing quality assurance of the procedures of proton therapy centers wishing to participate in clinical trials. An eventual goal of this phantom is to have a means of evaluating and auditing institutions for the ability to start clinical trials utilizing proton therapy procedures for lung cancers. Therefore, the hypothesis of this study is that a dynamic anthropomorphic thoracic phantom can be created to evaluate end-to-end proton therapy treatment procedures for lung cancer to assure agreement between the measured and calculated dose within 5% / 5 mm with a reproducibility of 2%. Multiple materials were assessed for thoracic heterogeneity equivalency. The phantom was designed from the materials found to be in greatest agreement. The phantom was treated in an end-to-end treatment four times, which included simulation, treatment planning and treatment delivery. Each treatment plan was delivered three times to assess reproducibility. The dose measured within the phantom was compared to that of the treatment plan. The hypothesis was fully supported for three of the treatment plans, but failed the reproducibility requirement for the most aggressive treatment plan.

AN EVALUATION OF THE CONSISTENCY OF IMRT PATIENT-SPECIFIC QA TECHNIQUES

To ensure the integrity of an intensity modulated radiation therapy (IMRT) treatment, each plan must be validated through a measurement-based quality assurance (QA) procedure, known as patient specific IMRT QA. Many methods of measurement and analysis have evolved for this QA. There is not a standard among clinical institutions, and many devices and action levels are used. Since the acceptance criteria determines if the dosimetric tools’ output passes the patient plan, it is important to see how these parameters influence the performance of the QA device. While analyzing the results of IMRT QA, it is important to understand the variability in the measurements. Due to the different form factors of the many QA methods, this reproducibility can be device dependent. These questions of patient-specific IMRT QA reproducibility and performance were investigated across five dosimeter systems: a helical diode array, radiographic film, ion chamber, diode array (AP field-by-field, AP composite, and rotational composite), and an in-house designed multiple ion chamber phantom. The reproducibility was gauged for each device by comparing the coefficients of variation (CV) across six patient plans. The performance of each device was determined by comparing each one’s ability to accurately label a plan as acceptable or unacceptable compared to a gold standard. All methods demonstrated a CV of less than 4%. Film proved to have the highest variability in QA measurement, likely due to the high level of user involvement in the readout and analysis. This is further shown by how the setup contributed more variation than the readout and analysis for all of the methods, except film. When evaluated for ability to correctly label acceptable and unacceptable plans, two distinct performance groups emerged with the helical diode array, AP composite diode array, film, and ion chamber in the better group; and the rotational composite and AP field-by-field diode array in the poorer group. Additionally, optimal threshold cutoffs were determined for each of the dosimetry systems. These findings, combined with practical considerations for factors such as labor and cost, can aid a clinic in its choice of an effective and safe patient-specific IMRT QA implementation.