Formative Evaluation of the "Time Twisters": A Comic Book Based Obesity Prevention Curriculum for Elementary School Students

Introduction: Obesity is a public health problem, particularly in Hispanic children. Alternative media channels may offer the potential to motivate children to engage in health promoting behaviors. A comic book, “Time Twisters”, was developed to impact screen time use, physical activity, and dietary behavior for elementary school children and evaluated for acceptability and feasibility prior to implementation in a multi-component physical activity intervention. [See PDF for complete abstract]

Evaluation and Model of a Clinical Librarian Program

Clinical medical librarianship is entering its second decade, but little evaluative data has accrued in the literature. Variations from the original programs and novel new approaches have insured the survival of the program so far. The clinical librarian (CL) forms a vital link between the library and the health care professional, operating as an important information transfer agent. However, to further insure the survival of these vital programs, hard evaluative evidence is needed. The University of Texas Medical Branch (UTMB) at Galveston began a CL Program in 1978/79. An extensive three-year pre/post evaluation study was conducted using a specifically developed evaluation model, which, if adopted by others, will provide the needed comparative data. Both a pilot study, or formative evaluation, and a summative evaluation were conducted. The results of this evaluation confirmed many of the conclusions reported by other CL programs. Eight hypotheses were proposed at the beginning of this study. Data were collected and used to support acceptance or rejection of the null hypotheses, and conclusions were drawn according to the results. Implications relevant to the study conclusions and future trends in medical librarianship are also discussed in the closing chapter.

Implementation of an Anthropomorphic Phantom for the Evaluation of Proton Therapy Treatment Procedures

With an increasing number of institutions offering proton therapy, the number of multi-institutional clinical trials involving proton therapy will also increase in the coming years. The Radiological Physics Center monitors sites involved in clinical trials through the use of site visits and remote auditing with thermoluminescent dosimeters (TLD) and mailable anthropomorphic phantoms. Currently, there are no heterogeneous phantoms that have been commissioned to evaluate proton therapy. It was hypothesized that an anthropomorphic pelvis phantom can be designed to audit treatment procedures (patient simulation, treatment planning and treatment delivery) at proton facilities to confirm agreement between the measured dose and calculated dose within 5%/3mm with a reproducibility of 3%. A pelvis phantom originally designed for use with photon treatments was retrofitted for use in proton therapy. The relative stopping power (SP) of each phantom material was measured. Hounsfield Units (HU) for each phantom material were measured with a CT scanner and compared to the relative stopping power calibration curve. The tissue equivalency for each material was calculated. Two proton treatment plans were created; one which did not correct for material SP differences (Plan 1) and one plan which did correct for SP differences (Plan 2). Film and TLD were loaded into the phantom and the phantom was irradiated 3 times per plan. The measured values were compared to the HU-SP calibration curve and it was found that the stopping powers for the materials could be underestimated by 5-10%. Plan 1 passed the criteria for the TLD and film margins with reproducibility under 3% between the 3 trials. Plan 2 failed because the right-left film dose profile average displacement was -9.0 mm on the left side and 6.0 mm on the right side. Plan 2 was intended to improve the agreements and instead introduced large displacements along the path of the beam. Plan 2 more closely represented the actual phantom composition with corrected stopping powers and should have shown an agreement between the measured and calculated dose within 5%/3mm. The hypothesis was rejected and the pelvis phantom was found to be not suitable to evaluate proton therapy treatment procedures.

Controlled Software Evaluation Methodology: Case Simulation and Cognitive User Analysis

Software for use with patient records is challenging to design and difficult to evaluate because of the tremendous variability of patient circumstances. A method was devised by the authors to overcome a number of difficulties. The method evaluates and compares objectively various software products for use in emergency departments and compares software to conventional methods like dictation and templated chart forms. The technique utilizes oral case simulation and video recording for analysis. The methodology and experiences of executing a study using this case simulation are discussed in this presentation.

Preliminary Evaluation of a Guideline Classification System

In a previous paper, we presented a proposed expansion of the National Guideline Clearing-house (NGC) classification1. We performed a preliminary evaluation of the classification based on 100 guidelines randomly selected from the NGC collection. We found that 89 of the 100 guidelines could be assigned to a single guideline category. To test inter-observer agreement, twenty guidelines were also categorized by a second investigator. Agreement was found to be 40-90% depending on the axis, which compares favorably with agreement among MeSH indexers (30-60%)2. We conclude that categorization is feasible. Further research is needed to clarify axes with poor inter-observer agreement.

Using technology to teach technology: design and evaluation of bilingual online physician education about electronic medical records.

The "EMR Tutorial" is designed to be a bilingual online physician education environment about electronic medical records. After iterative assessment and redesign, the tutorial was tested in two groups: U.S. physicians and Mexican medical students. Split-plot ANOVA revealed significantly different pre-test scores in the two groups, significant cognitive gains for the two groups overall, and no significant difference in the gains made by the two groups. Users rated the module positively on a satisfaction questionnaire.

EVALUATION OF THE QUANTITATIVE ACCURACY OF A COMMERCIALLY-AVAILABLE POSITRON EMISSION MAMMOGRAPHY SCANNER

Objective: The PEM Flex Solo II (Naviscan, Inc., San Diego, CA) is currently the only commercially-available positron emission mammography (PEM) scanner. This scanner does not apply corrections for count rate effects, attenuation or scatter during image reconstruction, potentially affecting the quantitative accuracy of images. This work measures the overall quantitative accuracy of the PEM Flex system, and determines the contributions of error due to count rate effects, attenuation and scatter. Materials and Methods: Gelatin phantoms were designed to simulate breasts of different sizes (4 – 12 cm thick) with varying uniform background activity concentration (0.007 – 0.5 μCi/cc), cysts and lesions (2:1, 5:1, 10:1 lesion-to-background ratios). The overall error was calculated from ROI measurements in the phantoms with a clinically relevant background activity concentration (0.065 μCi/cc). The error due to count rate effects was determined by comparing the overall error at multiple background activity concentrations to the error at 0.007 μCi/cc. A point source and cold gelatin phantoms were used to assess the errors due to attenuation and scatter. The maximum pixel values in gelatin and in air were compared to determine the effect of attenuation. Scatter was evaluated by comparing the sum of all pixel values in gelatin and in air. Results: The overall error in the background was found to be negative in phantoms of all thicknesses, with the exception of the 4-cm thick phantoms (0%±7%), and it increased with thickness (-34%±6% for the 12-cm phantoms). All lesions exhibited large negative error (-22% for the 2:1 lesions in the 4-cm phantom) which increased with thickness and with lesion-to-background ratio (-85% for the 10:1 lesions in the 12-cm phantoms). The error due to count rate in phantoms with 0.065 μCi/cc background was negative (-23%±6% for 4-cm thickness) and decreased with thickness (-7%±7% for 12 cm). Attenuation was a substantial source of negative error and increased with thickness (-51%±10% to -77% ±4% in 4 to 12 cm phantoms, respectively). Scatter contributed a relatively constant amount of positive error (+23%±11%) for all thicknesses. Conclusion: Applying corrections for count rate, attenuation and scatter will be essential for the PEM Flex Solo II to be able to produce quantitatively accurate images.

Commentary: Dedication of Additional Resources to Evaluation and Low-Income Schools is Critical to Increasing Levels of Safe Walking and Bicycling to School

A commentary on Mendoza et al.'s article entitled, "Ethnic Minority Children’s Active Commuting to School and Association with Physical Activity and Pedestrian Safety Behaviors."

Can prospective usability evaluation predict data errors?

Increasing amounts of clinical research data are collected by manual data entry into electronic source systems and directly from research subjects. For this manual entered source data, common methods of data cleaning such as post-entry identification and resolution of discrepancies and double data entry are not feasible. However data accuracy rates achieved without these mechanisms may be higher than desired for a particular research use. We evaluated a heuristic usability method for utility as a tool to independently and prospectively identify data collection form questions associated with data errors. The method evaluated had a promising sensitivity of 64% and a specificity of 67%. The method was used as described in the literature for usability with no further adaptations or specialization for predicting data errors. We conclude that usability evaluation methodology should be further investigated for use in data quality assurance.

Activity of anidulafungin in a murine model of Candida krusei infection: evaluation of mortality and disease burden by quantitative tissue cultures and measurement of serum (1,3)-beta-D-glucan levels.

Experience with anidulafungin against Candida krusei is limited. Immunosuppressed mice were injected with 1.3 x 10(7) to 1.5 x 10(7) CFU of C. krusei. Animals were treated with saline, 40 mg/kg fluconazole, 1 mg/kg amphotericin B, or 10 and 20 mg/kg anidulafungin for 5 days. Anidulafungin improved survival and significantly reduced the number of CFU/g in kidneys and serum beta-glucan levels.

Evaluation of Recurrence Risks for Left-Sided Cardiac Lesions

It is widely accepted that hypoplastic left heart syndrome (HLHS), aortic valve stenosis with or without bicuspid aortic valve (AS/BAV) and coarctation of the aorta (CoA) occur in families more commonly with each other than with any other congenital heart defect (CHD). Genetic counseling for CHDs is currently based on empiric risk estimates derived from data collected on all types of CHDs between 1968 and 1990. Additionally, for the specific group of defects described above, termed left-sided lesions, estimates are available for sibling recurrence. Utilizing family history data from 757 probands recruited between 1997 and 2007 from The Children’s Hospital of Philadelphia, this study reassessed the pre/recurrence risks for LSLs specifically. Sibling pre/recurrence risks for HLHS (5.5%, 95% CI: 3.1%-8.9%), CoA (4.0%, 95% CI: 2.1%-6.7%), and AS/BAV (6.0%, 95% CI: 3.3%-9.8%) were higher than currently quoted risks based on sibling data for individual LSLs. Additionally, the prevalence of BAV in 202, apparently unaffected, parents of 134 probands was assessed by echocardiography. BAV, which occurs at a frequency of 1% in the general population, was found to occur in approximately 10% of parents of LSL probands. Lastly, among affected first-degree relative pairs (i.e. siblings, parent-offspring), the majority (65%-70%) were both affected with a LSL. Defect specific concordance rates were highest for AS/BAV. Together, these findings suggest that over the past 20 years with changing diagnostic capabilities and environmental/maternal conditions (e.g. folic acid fortification, increased maternal diabetes and obesity) recurrence risks may have increased, as compared to current LSL specific risk estimates. Based on these risk estimate increases and prior studies, a protocol for screening first-degree relatives of LSL probands should be devised.

EVALUATION OF INTENSITY MODULATED RADIATION THERAPY (IMRT) DELIVERY ERROR DUE TO IMRT TREATMENT PLAN COMPLEXITY AND IMPROPERLY MATCHED DOSIMETRY DATA

Intensity modulated radiation therapy (IMRT) is a technique that delivers a highly conformal dose distribution to a target volume while attempting to maximally spare the surrounding normal tissues. IMRT is a common treatment modality used for treating head and neck (H&N) cancers, and the presence of many critical structures in this region requires accurate treatment delivery. The Radiological Physics Center (RPC) acts as both a remote and on-site quality assurance agency that credentials institutions participating in clinical trials. To date, about 30% of all IMRT participants have failed the RPC’s remote audit using the IMRT H&N phantom. The purpose of this project is to evaluate possible causes of H&N IMRT delivery errors observed by the RPC, specifically IMRT treatment plan complexity and the use of improper dosimetry data from machines that were thought to be matched but in reality were not. Eight H&N IMRT plans with a range of complexity defined by total MU (1460-3466), number of segments (54-225), and modulation complexity scores (MCS) (0.181-0.609) were created in Pinnacle v.8m. These plans were delivered to the RPC’s H&N phantom on a single Varian Clinac. One of the IMRT plans (1851 MU, 88 segments, and MCS=0.469) was equivalent to the median H&N plan from 130 previous RPC H&N phantom irradiations. This average IMRT plan was also delivered on four matched Varian Clinac machines and the dose distribution calculated using a different 6MV beam model. Radiochromic film and TLD within the phantom were used to analyze the dose profiles and absolute doses, respectively. The measured and calculated were compared to evaluate the dosimetric accuracy. All deliveries met the RPC acceptance criteria of ±7% absolute dose difference and 4 mm distance-to-agreement (DTA). Additionally, gamma index analysis was performed for all deliveries using a ±7%/4mm and ±5%/3mm criteria. Increasing the treatment plan complexity by varying the MU, number of segments, or varying the MCS resulted in no clear trend toward an increase in dosimetric error determined by the absolute dose difference, DTA, or gamma index. Varying the delivery machines as well as the beam model (use of a Clinac 6EX 6MV beam model vs. Clinac 21EX 6MV model), also did not show any clear trend towards an increased dosimetric error using the same criteria indicated above.

Evaluation of deformable image registration for improved 4D CT-derived ventilation for image guided radiotherapy

Recent treatment planning studies have demonstrated the use of physiologic images in radiation therapy treatment planning to identify regions for functional avoidance. This image-guided radiotherapy (IGRT) strategy may reduce the injury and/or functional loss following thoracic radiotherapy. 4D computed tomography (CT), developed for radiotherapy treatment planning, is a relatively new imaging technique that allows the acquisition of a time-varying sequence of 3D CT images of the patient's lungs through the respiratory cycle. Guerrero et al. developed a method to calculate ventilation imaging from 4D CT, which is potentially better suited and more broadly available for IGRT than the current standard imaging methods. The key to extracting function information from 4D CT is the construction of a volumetric deformation field that accurately tracks the motion of the patient's lungs during the respiratory cycle. The spatial accuracy of the displacement field directly impacts the ventilation images; higher spatial registration accuracy will result in less ventilation image artifacts and physiologic inaccuracies. Presently, a consistent methodology for spatial accuracy evaluation of the DIR transformation is lacking. Evaluation of the 4D CT-derived ventilation images will be performed to assess correlation with global measurements of lung ventilation, as well as regional correlation of the distribution of ventilation with the current clinical standard SPECT. This requires a novel framework for both the detailed assessment of an image registration algorithm's performance characteristics as well as quality assurance for spatial accuracy assessment in routine application. Finally, we hypothesize that hypo-ventilated regions, identified on 4D CT ventilation images, will correlate with hypo-perfused regions in lung cancer patients who have obstructive lesions. A prospective imaging trial of patients with locally advanced non-small-cell lung cancer will allow this hypothesis to be tested. These advances are intended to contribute to the validation and clinical implementation of CT-based ventilation imaging in prospective clinical trials, in which the impact of this imaging method on patient outcomes may be tested.