The Development and Implementation of an Anthropomorphic Head Phantom for the Assessment of Proton Therapy Treatment Procedures

Proton therapy has become an increasingly more common method of radiation therapy, with the dose sparing to distal tissue making it an appealing option, particularly for treatment of brain tumors. This study sought to develop a head phantom for the Radiological Physics Center (RPC), the first to be used for credentialing of institutions wishing to participate in clinical trials involving brain tumor treatment of proton therapy. It was hypothesized that a head phantom could be created for the evaluation of proton therapy treatment procedures (treatment simulation, planning, and delivery) to assure agreement between the measured dose and calculated dose within ±5%/3mm with a reproducibility of ±3%. The relative stopping power (RSP) and Hounsfield Units (HU) were measured for potential phantom materials and a human skull was cast in tissue-equivalent Alderson material (RLSP 1.00, HU 16) with anatomical airways and a cylindrical hole for imaging and dosimetry inserts drilled into the phantom material. Two treatment plans, proton passive scattering and proton spot scanning, were created. Thermoluminescent dosimeters (TLDs) and film were loaded into the phantom dosimetry insert. Each treatment plan was delivered three separate times. Each treatment plan passed our 5%/3mm criteria, with a reproducibility of ±3%. The hypothesis was accepted and the phantom was found to be suitable for remote audits of proton therapy treatment facilities.

Commentary on "A Needs Assessment Examining Low-Income Fathers’ Barriers to Participation in Parenting Programs"

The article provides insight on issues serving as barriers to low-income fathers' involvement with their children and with parenting programs.

A Model for Family Preservation Case Assessment

The outcomes of family preservation practice have been researched and debated. The effectiveness of family preservation is still inconclusive and many of the findings may only be inferred to specific situations. Few studies have addressed the assessment techniques or outcome factors from a qualitative perspective. This article synthesizes current literature, research and practice, and proposes a practice framework with questioning techniques to assist practitioners in assessing the strengths and characteristics of a family, and making decisions on whether or not familybased services are appropriate for the family. Two actual cases are presented to illustrate how the worker can benefit from having the assessment data derived from this model.

Assessment of interrater agreement using a binomial-based statistic: K(bin)

This project develops K(bin), a relatively simple, binomial based statistic for assessing interrater agreement in which expected agreement is calculated a priori from the number of raters involved in the study and number of categories on the rating tool. The statistic is logical in interpretation, easily calculated, stable for small sample sizes, and has application over a wide range of possible combinations from the simplest case of two raters using a binomial scale to multiple raters using a multiple level scale.^ Tables of expected agreement values and tables of critical values for K(bin) which include power to detect three levels of the population parameter K for n from 2 to 30 and observed agreement $\ge$.70 calculated at alpha =.05,.025, and.01 are included.^ An example is also included which describes the use of the tables for planning and evaluating an interrater reliability study using the statistic, K(bin). ^

Outcomes assessment of a pediatric practice guideline

Objective. This study examines the structure, processes, and data necessary to assess the outcome variables, length of stay and total cost, for a pediatric practice guideline. The guideline was developed by a group of physicians and ancillary staff members representing the services that most commonly provide treatment for asthma patients at Texas Children's Hospital, as a means of standardizing care. Outcomes have needed to be assessed to determine the practice guideline's effectiveness.^ Data sources and study design. Data for the study were collected retrospectively from multiple hospital data bases and from inpatient chart reviews. All patients in this quasi-experimental study had a diagnosis of Asthma (ICD-9-CM Code 493.91) at the time of admission.^ The study examined data for 100 patients admitted between September 15, 1995 and November 15, 1995, whose physician had elected to apply the asthma practice guideline at the time of the patient's admission. The study examined data for 66 inpatients admitted between September 15, 1995 and November 15, 1995, whose physician elected not to apply the asthma practice guideline. The principal outcome variables were identified as "Length of Stay" and "Cost".^ Principal findings. The mean length of stay for the group in which the practice guideline was applied was 2.3 days, and 3.1 days for the comparison group, who did not receive care directed by the practice guideline. The difference was statistically significant (p value = 0.008). There was not a demonstrable difference in risk factors, health status, or quality of care between the groups. Although not showing statistical significance in the univariate analysis, private insurance showed a significant difference in the logistic regression model presenting an elevated odds ratio (odds ratio = 2.2 for a hospital stay $\le$2 days to an odds ratio = 4.7 for a hospital stay $\le$3 days) showing that patients with private insurance experienced greater risk of a shorter hospital stay than the patients with public insurance in each of the logistic regression models. Public insurance included; Medicaid, Medicare, and charity cases. Private insurance included; private insurance policies whether group, individual, or managed care. The cost of an admission was significantly less for the group in which the practice guideline was applied, with a mean difference between the two groups of $1307 per patient.^ Conclusion. The implementation and utilization of a pediatric practice guideline for asthma inpatients at Texas Children's Hospital has a significant impact in terms of reducing the total cost of the hospital stay and length of the hospital stay for asthma patients admitted to Texas Children's Hospital. ^

The evolution and assessment of pharmaceutical care: Structure, processes, and outcomes

The evolution of pharmaceutical care is identified through a complete review of the literature published in the American Journal of Health-System Pharmacy, the sole comprehensive publication of institutional pharmacy practice. The evolution is categorized according to characteristics of structure (organizational structure, the role of the pharmacist), process (drug delivery systems, formulary management, acquiring drug products, methods to impact drug therapy decisions), and outcomes (cost of drug delivery, cost of drug acquisition and use, improved safety, improved health outcomes) recorded from the 1950s through the 1990s. While significant progress has been made in implementing basic drug distribution systems, levels of pharmacy involvement with direct patient care is still limited.^ A new practice framework suggests enhanced direct patient care involvement through increase in the efficiency and effectiveness of traditional pharmacy services. Recommendations advance internal and external organizational structure relationships that position pharmacists to fully use their unique skills and knowledge to impact drug therapy decisions and outcomes. Specific strategies facilitate expansion of the breadth and scope of each process component in order to expand the depth of integration of pharmacy and pharmaceutical care within the broad healthcare environment. Economic evaluation methods formally evaluate the impact of both operational and clinical interventions.^ Outcome measurements include specific recommendations and methods to increase efficiency of drug acquisition, emphasizing pharmacists' roles that impact physician prescribing decisions. Effectiveness measures include those that improve safety of drug distribution systems, decrease the potential of adverse drug therapy events, and demonstrate that pharmaceutical care can significantly contribute to improvement in overall health status.^ The implementation of the new framework is modeled on a case study at the M.D. Anderson Cancer Center. The implementation of several new drug distribution methods facilitated the redeployment of personnel from distributive functions to direct patient care activities with significant personnel and drug cost reduction. A cost-benefit analysis illustrates that framework process enhancements produced a benefit-to-cost ratio of 7.9. In addition, measures of effectiveness demonstrated significant levels of safety and enhanced drug therapy outcomes. ^

Managing the risks of medical technology: Do hazard surveillance systems provide an early warning of medical device problems?

The Food and Drug Administration (FDA) is responsible for risk assessment and risk management in the post-market surveillance of the U.S. medical device industry. One of the FDA regulatory mechanisms, the Medical Device Reporting System (MDR) is an adverse event reporting system intended to provide the FDA with advance warning of device problems. It includes voluntary reporting for individuals, and mandatory reporting for device manufacturers. ^ In a study of alleged breast implant safety problems, this research examines the organizational processes by which the FDA gathers data on adverse events and uses adverse event reporting systems to assess and manage risk. The research reviews the literature on problem recognition, risk perception, and organizational learning to understand the influence highly publicized events may have on adverse event reporting. Understanding the influence of an environmental factor, such as publicity, on adverse event reporting can provide insight into the question of whether the FDA's adverse event reporting system operates as an early warning system for medical device problems. ^ The research focuses on two main questions. The first question addresses the relationship between publicity and the voluntary and mandatory reporting of adverse events. The second question examines whether government agencies make use of these adverse event reports. ^ Using quantitative and qualitative methods, a longitudinal study was conducted of the number and content of adverse event reports regarding breast implants filed with the FDA's medical device reporting system during 1985–1991. To assess variation in publicity over time, the print media were analyzed to identify articles related to breast implant failures. ^ The exploratory findings suggest that an increase in media activity is related to an increase in voluntary reporting, especially following periods of intense media coverage of the FDA. However, a similar relationship was not found between media activity and manufacturers' mandatory adverse event reporting. A review of government committee and agency reports on the FDA published during 1976–1996 produced little evidence to suggest that publicity or MDR information contributed to problem recognition, agenda setting, or the formulation of policy recommendations. ^ The research findings suggest that the reporting of breast implant problems to FDA may reflect the perceptions and concerns of the reporting groups, a barometer of the volume and content of media attention. ^

EMPLOYMENT AND EXPOSURES IN THE PETROLEUM REFINING AND PETROCHEMICAL INDUSTRIES AND THE RISK OF LUNG CANCER (EPIDEMIOLOGY, ASSESSMENT)

This dissertation addresses the risk of lung cancer associated with occupational exposures in the petroleum refining and petrochemical industries. Earlier epidemiologic studies of this association did not adjust for cigarette smoking or have specific exposure classifications. The Texas EXposure Assessment System (TEXAS) was developed with data from a population-based, case-comparison study conducted in five southeast Texas counties between 1976 and 1980. The Texas Exposure Assessment System uses job and process categories developed by the American Petroleum Institute, as well as time-oriented variables to identify high risk groups.^ An industry-wide, increased risk for lung cancer was associated with jobs having low-level hydrocarbon exposure that also include other occupational inhalation exposures (OR = 2.0--adjusted for smoking and latency effects). The prohibition of cigarette smoking for jobs with high-level hydrocarbon exposure might explain part of the increased risk for jobs with low-level hydrocarbon exposures. Asbestos exposure comprises a large part of the risk associated with jobs having other inhalation exposures besides hydrocarbons. Workers in petroleum refineries were not shown to have an increased, occupational risk for lung cancer. The increased risk for lung cancer among petrochemical workers (OR = 3.1--smoking and latency adjusted) is associated with all jobs that involve other inhalation exposure characteristics (not only low-level hydrocarbon exposures). Findings for contract workers and workers exposed to specific chemicals were inconclusive although some hypotheses for future research were identified.^ The study results demonstrate that the predominant risk for lung cancer is due to cigarette smoking (OR = 9.8). Cigarette smoking accounts for 86.5% of the incident lung cancer cases within the study area. Workers in the petroleum industry smoke significantly less than persons employed in other industries (p << 0.001). Only 2.2% of the incident lung cancer cases may be attributed to petroleum industry jobs; lifestyle factors (e.g., nutrition) may be associated with the balance of the cases. The results from this study also suggest possible high risk time periods (OR = 3.9--smoking and occupation adjusted). Artifacts in time-oriented findings may result because of the latency interval for lung cancer, secular peaks in age-, sex-specific incidence rates, or periods of hazardous exposures in the petroleum industry. ^

THE DESIGN AND DEVELOPMENT OF A SURVEY INSTRUMENT FOR THE ASSESSMENT OF OCCUPATIONAL STRESS

Using stress and coping as a unifying theoretical concept, a series of five models was developed in order to synthesize the survey questions and to classify information. These models identified the question, listed the research study, described measurements, listed workplace data, and listed industry and national reference data.^ A set of 38 instrument questions was developed within the five coping correlate categories. In addition, a set of 22 stress symptoms was also developed. The study was conducted within two groups, police and professors, on a large university campus. The groups were selected because their occupations were diverse, but they were a part of the same macroenvironment. The premise was that police officers would be more highly stressed than professors.^ Of a total study group of 80, there were 37 respondents. The difference in the mean stress responses was observable between the two groups. Not only were the responses similar within each group, but the stress level of response was also similar within each group. While the response to the survey instrument was good, only 3 respondents answered the stress symptom survey properly. It was determined that none of the 37 respondents believed that they were ill. This perception of being well was also evidenced by the grand mean of the stress scores of 2.76 (3.0 = moderate stress). This also caused fewer independent variables to be entered in the multiple regression model.^ The survey instrument was carefully designed to be universal. Universality is the ability to transcend occupational or regional definitions as applied to stress. It is the ability to measure responses within broad categories such as physiological, emotional, behavioral, social, and cognitive functions without losing the ability to measure the detail within the individual questions, or the relationships between questions and categories.^ Replication is much easier to achieve with standardized categories, questions, and measurement procedures such as those developed for the universal survey instrument. Because the survey instrument is universal it can be used as an analytical device, an assessment device, a basic tool for planning and a follow-up instrument to measure individual response to planned reductions in occupational stress. (Abstract shortened with permission of author.) ^

The accuracy of self-reported medical history: A preliminary analysis of the promise of internet-based research in Inflammatory Bowel Diseases

BACKGROUND AND AIMS: Internet-based surveys provide a potentially important tool for Inflammatory Bowel Disease (IBD) research. The advantages include low cost, large numbers of participants, rapid study completion and less extensive infrastructure than traditional methods. The aim was to determine the accuracy of patient self-reporting in internet-based IBD research and identify predictors of greater reliability. METHODS: 197 patients from a tertiary care center answered an online survey concerning personal medical history and an evaluation of disease specific knowledge. Self-reported medical details were compared with data abstracted from medical records. Agreement was assessed by kappa (κ) statistics. RESULTS: Participants responded correctly with excellent agreement (κ=0.96-0.97) on subtype of IBD and history of surgery. The agreement was also excellent for colectomy (κ=0.88) and small bowel resection (κ=0.91), moderate for abscesses and fistulas (κ=0.60 and 0.63), but poor regarding partial colectomy (κ=0.39). Time since last colonoscopy was self-reported with better agreement (κ=0.84) than disease activity. For disease location/extent, moderate agreements at κ=69% and 64% were observed for patients with Crohn's disease and ulcerative colitis, respectively. Subjects who scored higher than the average in the IBD knowledge assessment were significantly more accurate about disease location than their complementary group (74% vs. 59%, p=0.02). CONCLUSION: This study demonstrates that IBD patients accurately report their medical history regarding type of disease and surgical procedures. More detailed medical information is less reliably reported. Disease knowledge assessment may help in identifying the most accurate individuals and could therefore serve as validity criteria. Internet-based surveys are feasible with high reliability about basic disease features only. However, the participants in this study were engaged at a tertiary center, which potentially leads to a bias and compromises generalization to an unfiltered patient group.

Effects of geriatric clinical skills training on the attitudes of medical students.

BACKGROUND Physicians' attitudes, knowledge and skills are powerful determinants of quality of care for older patients. Previous studies found that using educational interventions to improve attitude is a difficult task. No previous study sought to determine if a skills-oriented educational intervention improved student attitudes towards elderly patients. METHODS This study evaluated the effect of a geriatric clinical skills training (CST) on attitudes of University of Bern medical students in their first year of clinical training. The geriatric CST consisted of four 2.5-hour teaching sessions that covered central domains of geriatric assessment (e.g., cognition, mobility), and a textbook used by students to self-prepare. Students' attitudes were the primary outcome, and were assessed with the 14-item University of California at Los Angeles Geriatrics Attitudes Scale (UCLA-GAS) in a quasi-randomized fashion, either before or after geriatric CST. RESULTS A total of 154 medical students participated. Students evaluated before the CST had a median UCLA-GAS overall scale of 49 (interquartile range 44-53). After the CST, the scores increased slightly, to 51 (interquartile range 47-54; median difference 2, 95% confidence interval 0-4, P = 0.062). Of the four validated UCLA-GAS subscales, only the resource distribution subscale was significantly higher in students evaluated after the geriatric CST (median difference 1, 95% confidence interval 0-2, P = 0.005). CONCLUSIONS Teaching that targets specific skills may improve the attitudes of medical students towards elderly patients, though the improvement was slight. The addition of attitude-building elements may improve the effectiveness of future skills-oriented educational interventions.

The mini-clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned?

OBJECTIVES The generation of learning goals (LGs) that are aligned with learning needs (LNs) is one of the main purposes of formative workplace-based assessment. In this study, we aimed to analyse how often trainer–student pairs identified corresponding LNs in mini-clinical evaluation exercise (mini-CEX) encounters and to what degree these LNs aligned with recorded LGs, taking into account the social environment (e.g. clinic size) in which the mini-CEX was conducted. METHODS Retrospective analyses of adapted mini-CEX forms (trainers’ and students’ assessments) completed by all Year 4 medical students during clerkships were performed. Learning needs were defined by the lowest score(s) assigned to one or more of the mini-CEX domains. Learning goals were categorised qualitatively according to their correspondence with the six mini-CEX domains (e.g. history taking, professionalism). Following descriptive analyses of LNs and LGs, multi-level logistic regression models were used to predict LGs by identified LNs and social context variables. RESULTS A total of 512 trainers and 165 students conducted 1783 mini-CEXs (98% completion rate). Concordantly, trainer–student pairs most often identified LNs in the domains of ‘clinical reasoning’ (23% of 1167 complete forms), ‘organisation/efficiency’ (20%) and ‘physical examination’ (20%). At least one ‘defined’ LG was noted on 313 student forms (18% of 1710). Of the 446 LGs noted in total, the most frequently noted were ‘physical examination’ (49%) and ‘history taking’ (21%). Corresponding LNs as well as social context factors (e.g. clinic size) were found to be predictors of these LGs. CONCLUSIONS Although trainer–student pairs often agreed in the LNs they identified, many assessments did not result in aligned LGs. The sparseness of LGs, their dependency on social context and their partial non-alignment with students’ LNs raise questions about how the full potential of the mini-CEX as not only a ‘diagnostic’ but also an ‘educational’ tool can be exploited.

Assessment of the excretion time of electronic capsules placed in the intestinal lumen of cows with cecal dilatation-dislocation, healthy control cows, and cows with left displacement of the abomasum

OBJECTIVE To analyze the transit time from various locations in the intestines of cows with cecal dilatation-dislocation (CDD), healthy control cows, and cows with left displacement of the abomasum (LDA). ANIMALS 15 cows with naturally occurring CDD (group 1), 14 healthy control cows (group 2), and 18 cows with LDA (group 3). PROCEDURES 5 electronic transmitters were encased in capsules and placed in the lumen of the ileum, cecum, proximal portion of the colon, and 2 locations in the spiral colon (colon 1 and colon 2) and used to measure the transit time (ie, time between placement in the lumen and excretion of the capsules from the rectum). Excretion time of the capsules from each intestinal segment was compared among groups. RESULTS Cows recovered well from surgery, except for 1 cow with relapse of CDD 4 days after surgery and 2 cows with incisional infection. High variability in capsule excretion times was observed for all examined intestinal segments in all groups. Significant differences were detected for the excretion time from the colon (greater in cows with CDD than in healthy control cows) and cecum (less in cows with LDA than in cows of the other 2 groups). CONCLUSIONS AND CLINICAL RELEVANCE The technique developed to measure excretion time of capsules from bovine intestines was safe and reliable; however, the large variability observed for all intestinal segments and all groups would appear to be a limitation for its use in assessment of intestinal transit time of cattle in future studies.

FAIR_OSCE – Feedback structure for assessment of interactive roleplay in Objective Structured Clinical Exams

Introduction Since the quality of patient portrayal of standardized patients (SPs) during an Objective Structured Clinical Exam (OSCE) has a major impact on the reliability and validity of the exam, quality control should be initiated. Literature about quality control of SPs’ performance focuses on feedback [1, 2] or completion of checklists [3, 4]. Since we did not find a published instrument meeting our needs for the assessment of patient portrayal, we developed such an instrument after being inspired by others [5] and used it in our high-stakes exam. Project description SP trainers from five medical faculties collected and prioritized quality criteria for patient portrayal. Items were revised twice, based on experiences during OSCEs. The final instrument contains 14 criteria for acting (i.e. adequate verbal and non-verbal expression) and standardization (i.e. verbatim delivery of the first sentence). All partners used the instrument during a high-stakes OSCE. SPs and trainers were introduced to the instrument. The tool was used in training (more than 100 observations) and during the exam (more than 250 observations). Outcome High quality of SPs’ patient portrayal during the exam was documented. More than 90% of SP performances were rated to be completely correct or sufficient. An increase in quality of performance between training and exam was noted. For example, the rate of completely correct reaction in medical tests increased from 88% to 95%. Together with 4% of sufficient performances these 95% add up to 99% of the reactions in medical tests meeting the standards of the exam. SP educators using the instrument reported an augmentation of SPs’ performance induced by the use of the instrument. Disadvantages mentioned were the high concentration needed to observe all criteria and the cumbersome handling of the paper-based forms. Discussion We were able to document a very high quality of SP performance in our exam. The data also indicates that our training is effective. We believe that the high concentration needed using the instrument is well invested, considering the observed enhancement of performance. The development of an iPad-based application for the form is planned to address the cumbersome handling of the paper.

Quality assurance of simulated patient feedback in communication training for fourth-year medical students

Introduction In our program, simulated patients (SPs) give feedback to medical students in the course of communication skills training. To ensure effective training, quality control of the SPs’ feedback should be implemented. At other institutions, medical students evaluate the SPs’ feedback for quality control (Bouter et al., 2012). Thinking about implementing quality control for SPs’ feedback in our program, we wondered whether the evaluation by students would result in the same scores as evaluation by experts. Methods Consultations simulated by 4th-year medical students with SPs were video taped including the SP’s feedback to the students (n=85). At the end of the training sessions students rated the SPs’ performance using a rating instrument called Bernese Assessment for Role-play and Feedback (BARF) containing 11 items concerning feedback quality. Additionally the videos were evaluated by 3 trained experts using the BARF. Results The experts showed a high interrater agreement when rating identical feedbacks (ICCunjust=0.953). Comparing the rating of students and experts, high agreement was found with regard to the following items: 1. The SP invited the student to reflect on the consultation first, Amin (= minimal agreement) 97% 2. The SP asked the student what he/she liked about the consultation, Amin = 88%. 3. The SP started with positive feedback, Amin = 91%. 4. The SP was comparing the student with other students, Amin = 92%. In contrast the following items showed differences between the rating of experts and students: 1. The SP used precise situations for feedback, Amax (=maximal agreement) 55%, Students rated 67 of SPs’ feedbacks to be perfect with regard to this item (highest rating on a 5 point Likert scale), while only 29 feedbacks were rated this way by the experts. 2. The SP gave precise suggestions for improvement, Amax 75%, 62 of SPs’ feedbacks obtained the highest rating from students, while only 44 of SPs’ feedbacks achieved the highest rating in the view of the experts. 3. The SP speaks about his/her role in the third person, Amax 60%. Students rated 77 feedbacks with the highest score, while experts judged only 43 feedbacks this way. Conclusion Although evaluation by the students was in agreement with that of experts concerning some items, students rated the SPs’ feedback more often with the optimal score than experts did. Moreover it seems difficult for students to notice when SPs talk about the role in the first instead of the third person. Since precision and talking about the role in the third person are important quality criteria of feedback, this result should be taken into account when thinking about students’ evaluation of SPs’ feedback for quality control. Bouter, S., E. van Weel-Baumgarten, and S. Bolhuis. 2012. Construction and Validation of the Nijmegen Evaluation of the Simulated Patient (NESP): Assessing Simulated Patients’ Ability to Role-Play and Provide Feedback to Students. Academic Medicine: Journal of the Association of American Medical Colleges