The use of mechanisms and modes of toxic action in integrated testing strategies: the report and recommendations of a workshop held as part of the European Union OSIRIS Integrated Project

This report on The Potential of Mode of Action (MoA) Information Derived from Non-testing and Screening Methodologies to Support Informed Hazard Assessment, resulted from a workshop organised within OSIRIS (Optimised Strategies for Risk Assessment of Industrial Chemicals through Integration of Non-test and Test Information), a project partly funded by the EU Commission within the Sixth Framework Programme. The workshop was held in Liverpool, UK, on 30 October 2008, with 35 attendees. The goal of the OSIRIS project is to develop integrated testing strategies (ITS) fit for use in the REACH system, that would enable a significant increase in the use of non-testing information for regulatory decision making, and thus minimise the need for animal testing. One way to improve the evaluation of chemicals may be through categorisation by way of mechanisms or modes of toxic action. Defining such groups can enhance read-across possibilities and priority settings for certain toxic modes or chemical structures responsible for these toxic modes. Overall, this may result in a reduction of in vivo testing on organisms, through combining available data on mode of action and a focus on the potentially most-toxic groups. In this report, the possibilities of a mechanistic approach to assist in and guide ITS are explored, and the differences between human health and environmental areas are summarised.

Camp For All Connection: a community health information outreach project

Purpose: The purpose of the Camp For All Connection project is to facilitate access to electronic health information resources at the Camp For All facility. Setting/Participants/Resources: Camp For All is a barrier-free camp working in partnership with organizations to enrich the lives of children and adults with chronic illnesses and disabilities and their families by providing camping and retreat experiences. The camp facility is located on 206 acres in Burton, Texas. The project partners are Texas Woman's University, Houston Academy of Medicine-Texas Medical Center Library, and Camp For All. Brief Description: The Camp For All Connection project placed Internet-connected workstations at the camp's health center in the main lodge and provided training in the use of electronic health information resources. A train-the-trainer approach was used to provide training to Camp For All staff. Results/Outcome: Project workstations are being used by health care providers and camp staff for communication purposes and to make better informed health care decisions for Camp For All campers. Evaluation Method: A post-training evaluation was administered at the end of the train-the-trainer session. In addition, a series of site visits and interviews was conducted with camp staff members involved in the project. The site visits and interviews allowed for ongoing dialog between project staff and project participants.

EVALUATION OF INTENSITY MODULATED RADIATION THERAPY (IMRT) DELIVERY ERROR DUE TO IMRT TREATMENT PLAN COMPLEXITY AND IMPROPERLY MATCHED DOSIMETRY DATA

Intensity modulated radiation therapy (IMRT) is a technique that delivers a highly conformal dose distribution to a target volume while attempting to maximally spare the surrounding normal tissues. IMRT is a common treatment modality used for treating head and neck (H&N) cancers, and the presence of many critical structures in this region requires accurate treatment delivery. The Radiological Physics Center (RPC) acts as both a remote and on-site quality assurance agency that credentials institutions participating in clinical trials. To date, about 30% of all IMRT participants have failed the RPC’s remote audit using the IMRT H&N phantom. The purpose of this project is to evaluate possible causes of H&N IMRT delivery errors observed by the RPC, specifically IMRT treatment plan complexity and the use of improper dosimetry data from machines that were thought to be matched but in reality were not. Eight H&N IMRT plans with a range of complexity defined by total MU (1460-3466), number of segments (54-225), and modulation complexity scores (MCS) (0.181-0.609) were created in Pinnacle v.8m. These plans were delivered to the RPC’s H&N phantom on a single Varian Clinac. One of the IMRT plans (1851 MU, 88 segments, and MCS=0.469) was equivalent to the median H&N plan from 130 previous RPC H&N phantom irradiations. This average IMRT plan was also delivered on four matched Varian Clinac machines and the dose distribution calculated using a different 6MV beam model. Radiochromic film and TLD within the phantom were used to analyze the dose profiles and absolute doses, respectively. The measured and calculated were compared to evaluate the dosimetric accuracy. All deliveries met the RPC acceptance criteria of ±7% absolute dose difference and 4 mm distance-to-agreement (DTA). Additionally, gamma index analysis was performed for all deliveries using a ±7%/4mm and ±5%/3mm criteria. Increasing the treatment plan complexity by varying the MU, number of segments, or varying the MCS resulted in no clear trend toward an increase in dosimetric error determined by the absolute dose difference, DTA, or gamma index. Varying the delivery machines as well as the beam model (use of a Clinac 6EX 6MV beam model vs. Clinac 21EX 6MV model), also did not show any clear trend towards an increased dosimetric error using the same criteria indicated above.

An evaluation of the personal response system program for the elderly in Harris County, Texas

The Personal Response System Program at Huffington Center on Aging, Baylor College of Medicine, provides emergency call systems for elderly people living independently in Houston, Texas. The goal of the project was to complete a formative evaluation of the Personal Response System Program. The specific aims of the evaluation were three-fold. One aim was to evaluate participant health status and level of disability. The second aim was to develop a health care cost estimation strategy. Finally, a preliminary cost-effectiveness analysis was completed to evaluate the program's impact on health care costs and health status among the elderly target population. ^ The evaluation was a longitudinal, randomized experimental design. After the screening of 120 volunteers for eligibility, clients were asked to complete a written questionnaire and a monthly health service contact diary. Volunteers were contacted by telephone interviewers to collect health status information from 100 eligible clients (83%) on three occasions during the six months of follow-up. ^ Initially, volunteers were randomized to two experimental groups. The two groups were found to be comparable at the beginning of the study. No significant differences were detected related to health status, level of disability, or history of physician visits at baseline. However, the group with the Personal Response System (PRS) device had more adverse health events, higher IADL scores, more frequent use of walkers, lower average health status scores, and fewer community volunteers hours than the usual care comparison group. ^ The health care costs were estimated based on an algorithm adapted from the American Medical Association guidelines. Average total health care costs for the group with the PRS device ($912) were greater than the usual care group ($464). However, median health care values for the PRS group ($263) were similar to the usual care comparison group ($234). The preliminary findings indicated that the use of the PRS device was not associated with health care cost savings. ^ In the preliminary cost-effectiveness analysis, use of the personal response system was found to be associated with increased mental health status among elderly clients. The cost-effectiveness evaluation indicated that the associated cost for six months was $710 per unit increase in mental component score when the $150 PRS subscription was included. However, clients with the PRS device were found to have a greater decline in physical health status during the six-month follow-up. The beneficial effect on mental health status was found to be in contrast to negative findings associated with changes in physical health status. The implications for future research relate to the need to identify risk factors among geriatric populations to better target groups that would most likely benefit from PRS Program enrollment. ^

Management of Joint Research Activities within ERA-ARD: Guidelines for ARD programme planning, monitoring, evaluation and impact assessment

The present document has been elaborated in the context of the ERA-ARD project “The Agricultural Research for Development (ARD) dimension of the European Research Area (ERA) “. It is based on work done within Task 3.2 to identify a set of common or compatible methodologies for ARD planning, monitoring and evaluation and impact assessment. This set should serve as a guide for the management of joint ARD activities that are presently developed within the framework of the ERA-ARD project.

Development and Evaluation of a New Tablet Computer Application for the Therapy of Brain-Injured Patients with Aphasia

Introduction Language is the most important mean of communication and plays a central role in our everyday life. Brain damage (e.g. stroke) can lead to acquired disorders of lan- guage affecting the four linguistic modalities (i.e. reading, writing, speech production and comprehension) in different combinations and levels of severity. Every year, more than 5000 people (Aphasie Suisse) are affected by aphasia in Switzerland alone. Since aphasia is highly individual, the level of difficulty and the content of tasks have to be adapted continuously by the speech therapists. Computer-based assignments allow patients to train independently at home and thus increasing the frequency of ther- apy. Recent developments in tablet computers have opened new opportunities to use these devices for rehabilitation purposes. Especially older people, who have no prior experience with computers, can benefit from the new technologies. Methods The aim of this project was to develop an application that enables patients to train language related tasks autonomously and, on the other hand, allows speech therapists to assign exercises to the patients and to track their results online. Seven categories with various types of assignments were implemented. The application has two parts which are separated by a user management system into a patient interface and a therapist interface. Both interfaces were evaluated using the SUS (Subject Usability Scale). The patient interface was tested by 15 healthy controls and 5 patients. For the patients, we also collected tracking data for further analysis. The therapist interface was evaluated by 5 speech therapists. Results The SUS score are xpatients = 98 and xhealthy = 92.7 (median = 95, SD = 7, 95% CI [88.8, 96.6]) in case of the patient interface and xtherapists = 68 in case of the therapist interface. Conclusion Both, the patients and the healthy subjects, attested high SUS scores to the patient interface. These scores are considered as "best imaginable". The therapist interface got a lower SUS score compared to the patient interface, but is still considered as "good" and "usable". The user tracking system and the interviews revealed that there is room for improvements and inspired new ideas for future versions.

Addressing Multilevel Program Complexity by Evaluation Design

In this paper, we present the evaluation design for a complex multilevel program recently introduced in Switzerland. The evaluation embraces the federal level, the cantonal program level, and the project level where target groups are directly addressed. We employ Pawson and Tilley’s realist evaluation approach, in order to do justice to the varying context factors that impact the cantonal programs leading to varying effectiveness of the implemented activities. The application of the model to the canton of Uri shows that the numerous vertical and horizontal relations play a crucial role for the program’s effectiveness. As a general learning for the evaluation of complex programs, we state that there is a need to consider all affected levels of a program and that no monocausal effects can be singled out in programs where multiple interventions address the same problem. Moreover, considering all affected levels of a program can mean going beyond the borders of the actual program organization and including factors that do not directly interfere with the policy delivery as such. In particular, we found that the relationship between the cantonal and the federal level was a crucial organizational factor influencing the effectiveness of the cantonal program.

Evaluation of leaders – does gender still matter?

Purpose: Leadership positions are still stereotyped as male, especially in male-dominated fields such as STEM. Therefore, women in such positions run the risk of being evaluated less favorably than men. Our study investigates how female and male leaders in existing teams (engineering project) are evaluated, and how these evaluations change over time. Design/Methodology: Participants worked in 45 teams to develop specific engineering projects. Evaluations of 45 leaders (33% women) by 258 team members (39% women) were analyzed, that is, leaders’ self-evaluation and their evaluation by team members. Results: Although female and male leaders did not differ in their self-evaluations at the beginning of the project, female leaders evaluated themselves better within time. However, team members evaluated female leaders better than male leaders at the beginning of the project. These gender differences disappeared over the time. Limitations: It should be replicated in a non-student sample. Implications: The results show that female leaders entering a male-dominated field (engineering) are evaluated better by team members than male leaders at the beginning of the team work, in line with the ‘shifting standard model’ (Biernat & Fuegen, 2001). While the initial impression formation of female and male leaders is influenced by category membership, its impact decreases over time as a consequence of individualization (Fiske & Neuberg, 1990); this results in similar evaluations over time. Originality: To our knowledge this is the first study to systematically test perceptions of change in the evaluation over time of female and male leaders in natural setting.

Evaluation of soil salinity amelioration technologies in Timpaki, Crete

Salinization is a soil threat that adversely affects ecosystem services and diminishes soil functions in many arid and semi-arid regions. Soil salinity management depends on a range of factors, and can be complex expensive and time demanding. Besides taking no action, possible management strategies include amelioration and adaptation measures. The WOCAT Technologies Questionnaire is a standardized methodology for monitoring, evaluating and documenting sustainable land management practices through interaction with the stakeholders. Here we use WOCAT for the systematic analysis and evaluation of soil salinization amelioration measures, for the RECARE project Case Study in Greece, the Timpaki basin, a semi-arid region in south-central Crete where the main land use is horticulture in greenhouses irrigated by groundwater. Excessive groundwater abstractions have resulted in a drop of the groundwater level in the coastal part of the aquifer, thus leading to seawater intrusion and in turn to soil salinization due to irrigation with brackish water. Amelioration technologies that have already been applied in the case study by the stakeholders are examined and classified depending on the function they promote and/or improve. The documented technologies are evaluated for their impacts on ecosystem services, cost and input requirements. Preliminary results show that technologies which promote maintaining existing crop types while enhancing productivity and decreasing soil salinity such as composting, mulching, rain water harvesting and seed biopriming are preferred by the stakeholders. Further work will include result validation using qualitative approaches.

Evaluation of promising technologies for soil salinity amelioration in Timpaki (Crete): A participatory approach

Soil salinity management can be complex, expensive, and time demanding, especially in arid and semi-arid regions. Besides taking no action, possible management strategies include amelioration and adaptation measures. Here we apply the World Overview of Conservation Approaches and Technologies (WOCAT) framework for the systematic analysis and evaluation and selection of soil salinisation amelioration technologies in close collaboration with stakeholders. The participatory approach is applied in the RECARE (Preventing and Remediating degradation of soils in Europe through Land Care) project case study of Timpaki, a semiarid region in south-central Crete (Greece) where the main land use is horticulture in greenhouses irrigated by groundwater. Excessive groundwater abstractions have resulted in a drop of the groundwater level in the coastal part of the aquifer, thus leading to seawater intrusion and in turn to soil salinisation. The documented technologies are evaluated for their impacts on ecosystem services, cost, and input requirements using a participatory approach and field evaluations. Results show that technologies which promote maintaining existing crop types while enhancing productivity and decreasing soil salinity are preferred by the stakeholders. The evaluation concludes that rainwater harvesting is the optimal solution for direct soil salinity mitigation, as it addresses a wider range of ecosystem and human well-being benefits. Nevertheless, this merit is offset by poor financial motivation making agronomic measures more attractive to users.

Evaluation of Leaders – Does Gender Really Matter?

We examined the leaders’ self-evaluation and their evaluation by subordinates. We found that, over time, female leaders evaluated themselves better than male leaders and that subordinates evaluated female leaders better than male leaders at the beginning of the project. The latter gender differences disappeared over the course of the project.

A MANAGEMENT INFORMATION SYSTEM AND EVALUATION SCHEME FOR THE UNIVERSITY OF TEXAS EMPLOYEE ASSISTANCE PROGRAMS

Early Employee Assistance Programs (EAPs) had their origin in humanitarian motives, and there was little concern for their cost/benefit ratios; however, as some programs began accumulating data and analyzing it over time, even with single variables such as absenteeism, it became apparent that the humanitarian reasons for a program could be reinforced by cost savings particularly when the existence of the program was subject to justification.^ Today there is general agreement that cost/benefit analyses of EAPs are desirable, but the specific models for such analyses, particularly those making use of sophisticated but simple computer based data management systems, are few.^ The purpose of this research and development project was to develop a method, a design, and a prototype for gathering managing and presenting information about EAPS. This scheme provides information retrieval and analyses relevant to such aspects of EAP operations as: (1) EAP personnel activities, (2) Supervisory training effectiveness, (3) Client population demographics, (4) Assessment and Referral Effectiveness, (5) Treatment network efficacy, (6) Economic worth of the EAP.^ This scheme has been implemented and made operational at The University of Texas Employee Assistance Programs for more than three years.^ Application of the scheme in the various programs has defined certain variables which remained necessary in all programs. Depending on the degree of aggressiveness for data acquisition maintained by program personnel, other program specific variables are also defined. ^

Evaluation of candidate genes for susceptibility to spina bifida

Neural tube defects (NTDs) are the most common severely disabling birth defects in the United States, with a frequency of approximately 1–2 of every 1,000 births. This text includes the identification and evaluation of candidate susceptibility genes that confer risk for the development of neural tube defects (NTDs). The project focused on isolated meningomyelocele, also termed spina bifida (SB). ^ Spina bifida is a complex disease with multifactorial inheritance, therefore the subject population (consisting of North American Caucasians and Hispanics of Mexicali-American descent) was composed of 459 simplex SB families who were tested for genetic associations utilizing the transmission disequilibrium test (TDT), a nonparametric linkage technique. Three categories of candidate genes were studied, including (1) human equivalents of genes determined in mouse models to cause NTDs, (2) HOX and PAX genes, and (3) the MTHFR gene involved in the metabolic pathway of folate. ^ The C677T variant of the 5,10-methylenetetrahydrofolate reductase (MTHFR) gene was the first mutation in this gene to be implicated as a risk factor for NTDs. Our evaluation of the MTHFR gene provides evidence that maternal C677T homozygosity is a risk factor for upper level spina bifida defects in Hispanics [OR = 2.3, P = 0.02]. This observed risk factor is of great importance due to the high prevalence of this homozygous genotype in the Hispanic population. Additionally, maternal C677T/A1298C compound heterozygosity is a risk factor for upper level spina bifida defects in non-Hispanic whites [OR = 3.6, P = 0.03]. ^ For TDT analysis, our total population of 1128 subjects were genotyped for 54 markers from within and/or flanking the 20 candidate genes/gene regions of interest. Significant TDT findings were obtained for 3 of the 54 analyzed markers: d20s101 flanking the PAX1 gene (P = 0.019), d1s228 within the PAX7 gene (P = 0.011), and d2s110 within the PAX8 gene (P = 0.013). These results were followed-up by testing the genes directly for mutations utilizing single-strand conformational analysis (SSCA) and direct sequencing. Multiple variations were detected in each of these PAX genes; however, these variations were not passed from parent to child in phase with the positively transmitted alleles. Therefore, these variations do not contribute to the susceptibility of spina bifida, but rather are previously unreported single nucleotide polymorphisms. ^

Evaluation of the causal pathways through which subjective norms influence mammography intention and stage of change in a national sample of women veterans

Few studies have investigated causal pathways linking psychosocial factors to each other and to screening mammography. Conflicting hypotheses exist in the theoretic literature regarding the role and importance of subjective norms, a person's perceived social pressure to perform the behavior and his/her motivation to comply. The Theory of Reasoned Action (TRA) hypothesizes that subjective norms directly affect intention; while the Transtheoretical Model (TTM) hypothesizes that attitudes mediate the influence of subjective norms on stage of change. No one has examined which hypothesis best predicts the effect of subjective norms on mammography intention and stage of change. Two statistical methods are available for testing mediation, sequential regression analysis (SRA) and latent variable structural equation modeling (LVSEM); however, software to apply LVSEM to dichotomous variables like intention has only recently become available. No one has compared the methods to determine whether or not they yield similar results for dichotomous variables. ^ Study objectives were to: (1) determine whether the effect of subjective norms on mammography intention and stage of change are mediated by pros and cons; and (2) compare mediation results from the SRA and LVSEM approaches when the outcome is dichotomous. We conducted a secondary analysis of data from a national sample of women veterans enrolled in Project H.O.M.E. (H&barbelow;ealthy O&barbelow;utlook on the M&barbelow;ammography E&barbelow;xperience), a behavioral intervention trial. ^ Results showed that the TTM model described the causal pathways better than the TRA one; however, we found support for only one of the TTM causal mechanisms. Cons was the sole mediator. The mediated effect of subjective norms on intention and stage of change by cons was very small. These findings suggest that interventionists focus their efforts on reducing negative attitudes toward mammography when resources are limited. ^ Both the SRA and LVSEM methods provided evidence for complete mediation, and the direction, magnitude, and standard errors of the parameter estimates were very similar. Because SRA parameter estimates were not biased toward the null, we can probably assume negligible measurement error in the independent and mediator variables. Simulation studies are needed to further our understanding of how these two methods perform under different data conditions. ^

Sexual orientation and sexual behavior patterns: Evaluation of agreement and variation in a cohort of male, African American drug users in Houston, TX

Background. Sexual orientation and sexual behavior among men have shown disagreement in past studies. The term "on the down low" has been adopted by many to describe "straight" identifying men who have sex with men but do not inform their primary female partner. Methods. This secondary analysis of data collected from the "DASH Project---A Hepatitis B Vaccine Model for HIV Vaccine Trial in Drug Users," assessed sexual behavior patterns among African American drug-using men over time. Using a screener questionnaire to determine sexual orientation and sexual behavior of the men, the study specifically evaluated "straight" identified men who have sex with women only (MSW) to determine what factors were associated with sexual behavior variation to include men during follow-up. The Fisher's Exact Test was used to evaluate the factors. Results. Variation of sexual behavior was highest among "bisexual" identified men followed by "gay" identified men. Fifteen of the original 593 "straight" and MSW men had sexual behavior variation to include men. In the analysis of "straight" and MSW men with variation in sexual behavior compared to those who did not, living on the streets, greater number of sexual partners, trading sex for drugs, and trading sex for money were associated with sexual behavior variation (all p-values <0.01). Conclusions. The factors were only associated when considering the interview when the variation occurred. The same factors at screening were not predictive of sexual behavior variation in the future. Environmental factors, such as living situation, appear to play a role in sexual behavior variations in "straight" and MSW men. ^ Keywords. sexual behavior, sexual orientation, Fisher's Exact Test^