Controlled Software Evaluation Methodology: Case Simulation and Cognitive User Analysis

Software for use with patient records is challenging to design and difficult to evaluate because of the tremendous variability of patient circumstances. A method was devised by the authors to overcome a number of difficulties. The method evaluates and compares objectively various software products for use in emergency departments and compares software to conventional methods like dictation and templated chart forms. The technique utilizes oral case simulation and video recording for analysis. The methodology and experiences of executing a study using this case simulation are discussed in this presentation.

Commissioning an Anthropomorphic Spine and Lung Phantom for Remote Dose Verification of Institutions Participating in RTOG 0631

The RPC developed a new phantom to ensure comparable and consistent radiation administration in spinal radiosurgery clinical trials. This study assessed the phantom’s dosimetric and anatomic utility. The ‘spine phantom’ is a water filled thorax with anatomy encountered in spinal radiosurgery: target volume, vertebral column, spinal canal, esophagus, heart, and lungs. The dose to the target volume was measured with axial and sagittal planes of radiochromic film and thermoluminescent dosimeters (TLD). The dose distributions were measured with the radiochromic film calibrated to the absolute dose measured by the TLD. Four irradiations were administered: a four angle box plan, a seven angle conformal plan, a seven angle IMRT plan, and a nine angle IMRT plan (denoted as IMRT plan #1 and plan #2, respectively). In each plan, at least 95% of the defined tumor volume received 8 Gy. For each irradiation the planned and administered dose distributions were registered via pinpricks, and compared using point dose measurements, dose profiles, isodose distributions, and gamma analyses. Based on previous experience at the RPC, a gamma analysis was considering passing if greater than 95% of pixels passed the criteria of 5% dose difference and 3 mm distance-to-agreement. Each irradiation showed acceptable agreement in the qualitative assessments and exceeded the 95% passing rate at the 5% / 3 mm criteria, except IMRT plan #1, which was determined to have been poorly localized during treatment administration. The measured and planned dose distributions demonstrated acceptable agreement at the 5% / 3 mm criteria, and the spine phantom was determined to be a useful tool for the remote assessment of an institution’s treatment planning and dose delivery regimen.

MODIFICATION AND IMPLEMENTATION OF THE RPC HETEROGENEOUS THORAX PHANTOM FOR VERIFICATION OF PROTON THERAPY TREATMENT PROCEDURES

The Radiological Physics Center (RPC) provides heterogeneous phantoms that are used to evaluate radiation treatment procedures as part of a comprehensive quality assurance program for institutions participating in clinical trials. It was hypothesized that the existing RPC heterogeneous thorax phantom can be modified to assess lung tumor proton beam therapy procedures involving patient simulation, treatment planning, and treatment delivery, and could confirm agreement between the measured dose and calculated dose within 5%/3mm with a reproducibility of 5%. The Hounsfield Units (HU) for lung equivalent materials (balsa wood and cork) was measured using a CT scanner. The relative linear stopping power (RLSP) of these materials was measured. The linear energy transfer (LET) of Gafchromic EBT2 film was analyzed utilizing parallel and perpendicular orientations in a water tank and compared to ion chamber readings. Both parallel and perpendicular orientations displayed a quenching effect underperforming the ion chamber, with the parallel orientation showing an average 31 % difference and the perpendicular showing an average of 15% difference. Two treatment plans were created that delivered the prescribed dose to the target volume, while achieving low entrance doses. Both treatment plans were designed using smeared compensators and expanded apertures, as would be utilized for a patient in the clinic. Plan 1a contained two beams that were set to orthogonal angles and a zero degree couch kick. Plan 1b utilized two beams set to 10 and 80 degrees with a 15 degree couch kick. EBT2 film and TLD were inserted and the phantom was irradiated 3 times for each plan. Both plans passed the criteria for the TLD measurements where the TLD values were within 7% of the dose calculated by Eclipse. Utilizing the 5%/3mm criteria, the 3 trial average of overall pass rate was 71% for Plan 1a. The 3 trial average for the overall pass rate was 76% for Plan 1b. The trials were then analyzed using RPC conventional lung treatment guidelines set forth by the RTOG: 5%/5mm, and an overall pass rate of 85%. Utilizing these criteria, only Plan 1b passed for all 3 trials, with an average overall pass rate of 89%.

EVALUATION OF INTENSITY MODULATED RADIATION THERAPY (IMRT) DELIVERY ERROR DUE TO IMRT TREATMENT PLAN COMPLEXITY AND IMPROPERLY MATCHED DOSIMETRY DATA

Intensity modulated radiation therapy (IMRT) is a technique that delivers a highly conformal dose distribution to a target volume while attempting to maximally spare the surrounding normal tissues. IMRT is a common treatment modality used for treating head and neck (H&N) cancers, and the presence of many critical structures in this region requires accurate treatment delivery. The Radiological Physics Center (RPC) acts as both a remote and on-site quality assurance agency that credentials institutions participating in clinical trials. To date, about 30% of all IMRT participants have failed the RPC’s remote audit using the IMRT H&N phantom. The purpose of this project is to evaluate possible causes of H&N IMRT delivery errors observed by the RPC, specifically IMRT treatment plan complexity and the use of improper dosimetry data from machines that were thought to be matched but in reality were not. Eight H&N IMRT plans with a range of complexity defined by total MU (1460-3466), number of segments (54-225), and modulation complexity scores (MCS) (0.181-0.609) were created in Pinnacle v.8m. These plans were delivered to the RPC’s H&N phantom on a single Varian Clinac. One of the IMRT plans (1851 MU, 88 segments, and MCS=0.469) was equivalent to the median H&N plan from 130 previous RPC H&N phantom irradiations. This average IMRT plan was also delivered on four matched Varian Clinac machines and the dose distribution calculated using a different 6MV beam model. Radiochromic film and TLD within the phantom were used to analyze the dose profiles and absolute doses, respectively. The measured and calculated were compared to evaluate the dosimetric accuracy. All deliveries met the RPC acceptance criteria of ±7% absolute dose difference and 4 mm distance-to-agreement (DTA). Additionally, gamma index analysis was performed for all deliveries using a ±7%/4mm and ±5%/3mm criteria. Increasing the treatment plan complexity by varying the MU, number of segments, or varying the MCS resulted in no clear trend toward an increase in dosimetric error determined by the absolute dose difference, DTA, or gamma index. Varying the delivery machines as well as the beam model (use of a Clinac 6EX 6MV beam model vs. Clinac 21EX 6MV model), also did not show any clear trend towards an increased dosimetric error using the same criteria indicated above.

The impact of a cooking and gardening summer camp experience on the fruit and vegetable consumption of elementary school-aged children

Childhood obesity is a significant public health problem. Over 15 percent of children in the United States are obese, and about 25 percent of children in Texas are overweight (CDC NHANES). Furthermore, about 30 percent of elementary school aged children in Harris County, Texas are overweight or obese (Children at Risk Institute 2010). In addition to actions such as increasing physical activity, decreasing television watching and video game time, decreasing snacking on low nutrient calorie dense foods and sugar sweetened beverages, children need to consume more fruits and vegetables. According to the National Health and Nutrition Examination Survey (NHANES) from 2002, about 26 percent of U.S. children are meeting the recommendations for daily fruit intake and about 16 percent are meeting the recommendations for daily vegetable intake (CDC NHANES). In 2004, the average total intake of vegetables was 0.9 cups per day and 1.1 cups of fruit per day by children ages four to nine years old in the U.S. (CDC NHANES). Not only do children need effective nutrition education to learn about fruits and vegetables, they also need access and repeated exposure to fruits and vegetables (Anderson 2009, Briefel 2009). Nutrition education interventions that provide a structured, hands-on curriculum such as school gardens have produced significant changes in child fruit and vegetable intake (Blair 2009, McAleese 2007). To prevent childhood obesity from continuing into adolescence and adulthood, effective nutrition education interventions need to be implemented immediately and for the long-term. However, research has shown short-term nutrition education interventions such as summer camps to be effective for significant changes in child fruit and vegetable intake, preferences, and knowledge (Heim 2009). ^ A four week summer camp based on cooking and gardening was implemented at 6 Multi-Service centers in a large, urban city. The participants included children ranging in age from 7 to 14 years old (n=64). The purpose of the camp was to introduce children to their food from the seed to the plate through the utilization of gardening and culinary exercises. The summer camp activities were aimed at increasing the children's exposure, willingness to try, preferences, knowledge, and intake of fruits and vegetables. A survey was given on the first day of camp and again on the last day of camp that measured the pre- and post differences in knowledge, intake, willingness to try, and preferences of fruits and vegetables. The present study examined the short-term effectiveness of a cooking and garden-based nutrition education program on the knowledge, willingness, preferences, and intake among children aged 8 to 13 years old (n=40). The final sample of participants (n=40) was controlled for those who completed pre- and post-test surveys and who were in or above the third grade level. Results showed a statistically significant increase in the reported intake of vegetables and preferences for vegetables, specifically green beans, and fruits. There was also a significant increase in preferences for fruits among boys and participants ages 11 to 13 years. The results showed a change in the expected direction of willingness to try, preferences for vegetables, and intake of fruit, however these were not statistically significant. Interestingly, the results also showed a decrease in the intake of low nutrient calorie dense foods such as sweets and candy.^