Using Factorial Surveys and Stated Choice Experiments to Investigate Discriminatory Attitudes and Preferences

Empirical research on discriminatory attitudes and behaviour grapples with the social undesirability of its object. In many studies using regular survey methods, estimates are biased, and the social context of discrimination is not taken into account. Several methods have been developed, especially to deal with the first problem. In this regard, the estimation of the ‘true value’ of discriminatory attitudes is at the centre of interest. However, methodological contributions focusing on the social context of attitude communication and discriminatory behaviour, as well as the correlation between both, are rare. We present two experimental methods which address those issues: factorial surveys and stated choice experiments. In a first study, the usefulness of factorial surveys is demonstrated with data on German anti-Semitism (N=279). We show that the rate of approval with anti-Semitic statements increases if (a) respondents are told that the majority of fellows agree with such statements, (b) the term “Jews” is replaced by the term “Israelis”, and (c) reference to the Holocaust is made. Apart from the main effects of these experimental factors, significant interaction effects regarding the political attitudes and social status of respondents are observed. In a second study, a stated choice experiment on the purchase of olive oil and tomatoes was conducted in Germany (N=440). We find that respondents prefer Italian and Dutch products (control treatment) compared to Israeli and Palestinian ones (discrimination treatments). There are no significant differences between preferences for a so called ‘Peace product’ (which is produced jointly by Israelis and Palestinians) and products from Italy as well as the Netherlands. Yet, taking discriminatory attitudes (anti-Semitic and anti-Arabic attitudes) into account, a strong correlation between those attitudes and stated behaviour (purchase of Israeli, Palestinian and jointly produced products) can be found. This adds support to the hypothesis that discriminatory attitudes hold behavioural consequences.

Predictors of healthcare professionals' attitudes towards family involvement in safety-relevant behaviours: a cross-sectional factorial survey study.

OBJECTIVES To investigate predictors of healthcare professionals' (HCPs) attitudes towards family involvement in safety-relevant behaviours. DESIGN A cross-sectional fractional factorial survey that assessed HCPs' attitudes towards family involvement in two error scenarios relating to hand hygiene and medication safety. Each survey comprised two randomised vignettes that described the potential error, how the family member communicated with the HCP about the error and how the HCP responded to the family member's question. SETTING 5 teaching hospitals in London, the Midlands and York. HCPs were approached on a range of medical and surgical wards. PARTICIPANTS 160 HCPs (73 doctors; 87 nurses) aged between 21 and 65 years (mean 37) 102 were female. OUTCOME MEASURES HCP approval of family member's behaviour; HCP reaction to the family member; anticipated effects on the family member-HCP relationship; HCP support for being questioned about hand hygiene/medication; affective rating responses. RESULTS HCPs supported family member's intervening (88%) but only 41% agreed this would have positive effects on the family member/HCP relationship. Across vignettes and error scenarios the strongest predictors of attitudes were how the HCP (in the scenario) responded to the family member and whether an error actually occurred. Doctors (vs nurses) provided systematically more positive affective ratings to the vignettes. CONCLUSIONS Important predictors of HCPs' attitudes towards family members' involvement in patient safety have been highlighted. In particular, a discouraging response from HCP's decreased support for family members being involved and had strong perceived negative effects on the family member/HCP relationship.

Validierung einer deutschsprachigen Version des Career Futures Inventory (CFI): Berufliche Anpassungsfähigkeit, beruflicher Optimismus, Arbeitsmarktwissen und Berufserfolg

Das Career Futures Inventory (CFI; Rottingaus, Day & Borgen, 2005) erfasst die drei laufbahnbezogenen Zukunftsfaktoren career adaptability (Berufliche Anpassungsfähigkeit), career optimism (Beruflicher Optimismus) und knowledge of job market (Arbeitsmarktwissen). Die Ziele dieser Studie waren (a) eine deutschsprachige Version des CFIs zu konstruieren und (b) an zwei Stichproben mit Erwerbstätigen mittels (c) unterschiedlicher Indikatoren des Berufserfolgs und anhand von Persönlichkeitseigenschaften zu validieren. Es konnte in beiden Stichproben (N1 = 153; N2 = 110) die 3-faktorielle Struktur des CFIs nachgewiesen werden. Zudem konnten Annahmen zur konvergenten und diskriminanten Validität in beiden Stichproben bestätigt werden, da die CFI-Faktoren in erwarteter Richtung mit Berufserfolg (z. B. Beförderungen, Karrierezufriedenheit) bzw. Persönlichkeitseigenschaften (d. h. Big Five) korrelierten bzw. nicht korrelierten. Eine Analyse der inkrementellen Validität zeigte, dass Arbeitsmarktwissen zusätzliche Varianz beim Gehalt über Kontrollvariablen und Persönlichkeit hinaus erklärte. Hinsichtlich Karrierezufriedenheit war dies für beruflichen Optimismus der Fall. Diese Validierungsstudie ermöglicht den Einsatz des CFIs im deutschsprachigen Raum.

Clinical validity of the nerve root sedimentation sign in patients with suspected lumbar spinal stenosis

BACKGROUND CONTEXT The nerve root sedimentation sign in transverse magnetic resonance imaging has been shown to discriminate well between selected patients with and without lumbar spinal stenosis (LSS), but the performance of this new test, when used in a broader patient population, is not yet known. PURPOSE To evaluate the clinical performance of the nerve root sedimentation sign in detecting central LSS above L5 and to determine its potential significance for treatment decisions. STUDY DESIGN Retrospective cohort study. PATIENT SAMPLE One hundred eighteen consecutive patients with suspected LSS (52% women, median age 62 years) with a median follow-up of 24 months. OUTCOME MEASURES Oswestry disability index (ODI) and back and leg pain relief. METHODS We performed a clinical test validation study to assess the clinical performance of the sign by measuring its association with health outcomes. Subjects were patients referred to our orthopedic spine unit from 2004 to 2007 before the sign had been described. Based on clinical and radiological diagnostics, patients had been treated with decompression surgery or nonsurgical treatment. Changes in the ODI and pain from baseline to 24-month follow-up were compared between sedimentation sign positives and negatives in both treatment groups. RESULTS Sixty-nine patients underwent surgery. Average baseline ODI in the surgical group was 54.7%, and the sign was positive in 39 patients (mean ODI improvement 29.0 points) and negative in 30 (ODI improvement 28.4), with no statistically significant difference in ODI and pain improvement between groups. In the 49 patients of the nonsurgical group, mean baseline ODI was 42.4%; the sign was positive in 18 (ODI improvement 0.6) and negative in 31 (ODI improvement 17.7). A positive sign was associated with a smaller ODI and back pain improvement than negative signs (both p<.01 on t test). CONCLUSIONS In patients commonly treated with decompression surgery, the sedimentation sign does not appear to predict surgical outcome. In nonsurgically treated patients, a positive sign is associated with more limited improvement. In these cases, surgery might be effective, but this needs investigation in prospective randomized trials (Australian New Zealand Clinical Trial Registry, number ACTRN12610000567022).

Measuring depression with a well-being index: Further evidence for the validity of the WHO Well-Being Index (WHO-5) as a measure of the severity of depression

BACKGROUND: In recent years, the WHO Wellbeing Index (WHO-5) has been used as a screening measure for depression. Nevertheless, research on the validity of this measure in the context of clinical depression is sparse. QUESTIONS: The aim of the present study was to investigate the measurement invariance of the WHO-5 across depressed and non-depressed individuals, as well as the shape and specificity of its relationship to measures of depression severity. METHOD: Of the 414 subjects who completed the WHO-5 and the Beck Depression Inventory-II (BDI-II), 207 had a diagnosis of a major depressive episode (MDE). A subsample also completed the Beck Anxiety Inventory (BAI) and was assessed by clinicians using the Hamilton Depression Rating Scale (HAM-D) and the Hamilton Anxiety Rating Scale (HAM-A). RESULTS: The WHO-5 demonstrated strong measurement invariance regarding the presence or absence of a current MDE. The WHO-5 showed a very high negative association with self- and observer-rated measures of depressive symptoms, especially in the range of mild to moderate symptoms. These associations were still substantial after controlling for measures of anxiety symptoms. LIMITATIONS: In addition to a diagnostic interview, only one measure for self- and observer-rated symptoms of depression was used. Furthermore, the observer-rated measure was only assessed in one subsample that exhibited a somewhat restricted range of depression severity. CONCLUSION: Although this index was originally designed as a measure of well-being, the results support the use of the WHO-5 in the context of depression research.

Exploring the validity and reliability of a questionnaire for evaluating virtual patient design with a special emphasis on fostering clinical reasoning

Background: Virtual patients (VPs) are increasingly used to train clinical reasoning. So far, no validated evaluation instruments for VP design are available. Aims: We examined the validity of an instrument for assessing the perception of VP design by learners. Methods: Three sources of validity evidence were examined: (i) Content was examined based on theory of clinical reasoning and an international VP expert team. (ii) The response process was explored in think-aloud pilot studies with medical students and in content analyses of free text questions accompanying each item of the instrument. (iii) Internal structure was assessed by exploratory factor analysis (EFA) and inter-rater reliability by generalizability analysis. Results: Content analysis was reasonably supported by the theoretical foundation and the VP expert team. The think-aloud studies and analysis of free text comments supported the validity of the instrument. In the EFA, using 2547 student evaluations of a total of 78 VPs, a three-factor model showed a reasonable fit with the data. At least 200 student responses are needed to obtain a reliable evaluation of a VP on all three factors. Conclusion: The instrument has the potential to provide valid information about VP design, provided that many responses per VP are available.

General distress, hopelessness—suicidal ideation and worrying in adolescence: Concurrent and predictive validity of a symptom-level bifactor model for clinical diagnoses

BACKGROUND: Clinical disorders often share common symptoms and aetiological factors. Bifactor models acknowledge the role of an underlying general distress component and more specific sub-domains of psychopathology which specify the unique components of disorders over and above a general factor. METHODS: A bifactor model jointly calibrated data on subjective distress from The Mood and Feelings Questionnaire and the Revised Children's Manifest Anxiety Scale. The bifactor model encompassed a general distress factor, and specific factors for (a) hopelessness-suicidal ideation, (b) generalised worrying and (c) restlessness-fatigue at age 14 which were related to lifetime clinical diagnoses established by interviews at ages 14 (concurrent validity) and current diagnoses at 17 years (predictive validity) in a British population sample of 1159 adolescents. RESULTS: Diagnostic interviews confirmed the validity of a symptom-level bifactor model. The underlying general distress factor was a powerful but non-specific predictor of affective, anxiety and behaviour disorders. The specific factors for hopelessness-suicidal ideation and generalised worrying contributed to predictive specificity. Hopelessness-suicidal ideation predicted concurrent and future affective disorder; generalised worrying predicted concurrent and future anxiety, specifically concurrent generalised anxiety disorders. Generalised worrying was negatively associated with behaviour disorders. LIMITATIONS: The analyses of gender differences and the prediction of specific disorders was limited due to a low frequency of disorders other than depression. CONCLUSIONS: The bifactor model was able to differentiate concurrent and predict future clinical diagnoses. This can inform the development of targeted as well as non-specific interventions for prevention and treatment of different disorders.

The impact of environmental enrichment on the outcome variability and scientific validity of laboratory animal studies.

It has been widely accepted for some time that species-appropriate environmental enrichment is important for the welfare of research animals, but its impact on research data initially received little attention. This has now changed, as the use of enrichment as one element of routine husbandry has expanded. In addition to its use in the care of larger research animals, such as nonhuman primates, it is now being used to improve the environments of small research animals, such as rodents, which are used in significantly greater numbers and in a wide variety of studies. Concern has been expressed that enrichment negatively affects both experimental validity and reproducibility. However, when a concise definition of enrichment is used, with a sound understanding of the biology and behaviour of the animal as well as the research constraints, it becomes clear that the welfare of research animals can be enhanced through environmental enrichment without compromising their purpose. Indeed, it is shown that the converse is true: the provision of suitable enrichment enhances the well-being of the animal, thereby refining the animal model and improving the research data. Thus, the argument is made that both the validity and reproducibility of the research are enhanced when proper consideration is given to the research animal's living environment and the animal's opportunities to express species-typical behaviours.

Completeness of Follow-Up Determines Validity of Study Findings: Results of a Prospective Repeated Measures Cohort Study.

BACKGROUND Current reporting guidelines do not call for standardised declaration of follow-up completeness, although study validity depends on the representativeness of measured outcomes. The Follow-Up Index (FUI) describes follow-up completeness at a given study end date as ratio between the investigated and the potential follow-up period. The association between FUI and the accuracy of survival-estimates was investigated. METHODS FUI and Kaplan-Meier estimates were calculated twice for 1207 consecutive patients undergoing aortic repair during an 11-year period: in a scenario A the population's clinical routine follow-up data (available from a prospective registry) was analysed conventionally. For the control scenario B, an independent survey was completed at the predefined study end. To determine the relation between FUI and the accuracy of study findings, discrepancies between scenarios regarding FUI, follow-up duration and cumulative survival-estimates were evaluated using multivariate analyses. RESULTS Scenario A noted 89 deaths (7.4%) during a mean considered follow-up of 30±28months. Scenario B, although analysing the same study period, detected 304 deaths (25.2%, P<0.001) as it scrutinized the complete follow-up period (49±32months). FUI (0.57±0.35 versus 1.00±0, P<0.001) and cumulative survival estimates (78.7% versus 50.7%, P<0.001) differed significantly between scenarios, suggesting that incomplete follow-up information led to underestimation of mortality. Degree of follow-up completeness (i.e. FUI-quartiles and FUI-intervals) correlated directly with accuracy of study findings: underestimation of long-term mortality increased almost linearly by 30% with every 0.1 drop in FUI (adjusted HR 1.30; 95%-CI 1.24;1.36, P<0.001). CONCLUSION Follow-up completeness is a pre-requisite for reliable outcome assessment and should be declared systematically. FUI represents a simple measure suited as reporting standard. Evidence lacking such information must be challenged as potentially flawed by selection bias.

Validity of SYNTAX score II for risk stratification of percutaneous coronary interventions: A patient-level pooled analysis of 5,433 patients enrolled in contemporary coronary stent trials.

OBJECTIVES To assess the clinical profile and long-term mortality in SYNTAX score II based strata of patients who received percutaneous coronary interventions (PCI) in contemporary randomized trials. BACKGROUND The SYNTAX score II was developed in the randomized, all-comers' SYNTAX trial population and is composed by 2 anatomical and 6 clinical variables. The interaction of these variables with the treatment provides individual long-term mortality predictions if a patient undergoes coronary artery bypass grafting (CABG) or PCI. METHODS Patient-level (n=5433) data from 7 contemporary coronary drug-eluting stent (DES) trials were pooled. The mortality for CABG or PCI was estimated for every patient. The difference in mortality estimates for these two revascularization strategies was used to divide the patients into three groups of theoretical treatment recommendations: PCI, CABG or PCI/CABG (the latter means equipoise between CABG and PCI for long term mortality). RESULTS The three groups had marked differences in their baseline characteristics. According to the predicted risk differences, 5115 patients could be treated either by PCI or CABG, 271 should be treated only by PCI and, rarely, CABG (n=47) was recommended. At 3-year follow-up, according to the SYNTAX score II recommendations, patients recommended for CABG had higher mortality compared to the PCI and PCI/CABG groups (17.4%; 6.1% and 5.3%, respectively; P<0.01). CONCLUSIONS The SYNTAX score II demonstrated capability to help in stratifying PCI procedures.

The impact of the position effect on the factorial structure of the Culture Fair Test (CFT)

The Culture Fair Test (CFT) is a psychometric test of fluid intelligence consisting of four subtests; Series, Classification, Matrices, and Topographies. The four subtests are only moderately intercorrelated, doubting the notion that they assess the same construct (i.e., fluid intelligence). As an explanation of these low correlations, we investigated the position effect. This effect is assumed to reflect implicit learning during testing. By applying fixed-links modeling to analyze the CFT data of 206 participants, we identified position effects as latent variables in the subtests; Classification, Matrices, and Topographies. These position effects were disentangled from a second set of latent variables representing fluid intelligence inherent in the four subtests. After this separation of position effect and basic fluid intelligence, the latent variables representing basic fluid intelligence in the subtests Series, Matrices, and Topographies could be combined to one common latent variable which was highly correlated with fluid intelligence derived from the subtest Classification (r=.72). Correlations between the three latent variables representing the position effects in the Classification, Matrices, and Topographies subtests ranged from r=.38 to r=.59. The results indicate that all four CFT subtests measure the same construct (i.e., fluid intelligence) but that the position effect confounds the factorial structure

Measuring Spatial Presence: Introducing and Validating the Pictorial Presence SAM

The aim of the present study was to develop a pictorial presence scale using selfassessment- manikins (SAM). The instrument assesses presence sub-dimensions (selflocation and possible actions) as well as presence determinants (attention allocation, spatial situation model, higher cognitive involvement, and suspension of disbelief). To qualitatively validate the scale, think-aloud protocols and interviews (n = 12) were conducted. The results reveal that the SAM items are quickly filled out as well as easily, intuitively, and unambiguously understood. Furthermore, the instrument’s validity and sensitivity was quantitatively examined in a two-factorial design (n = 317). Factors were medium (written story, audio book, video, and computer game) and distraction (non-distraction vs. distraction). Factor analyses reveal that the SAM presence dimensions and determinants closely correspond to those of the MEC Spatial Presence Questionnaire, which was used as a comparison measure. The findings of the qualitative and quantitative validation procedures show that the Pictorial Presence SAM successfully assesses spatial presence. In contrast to the verbal questionnaire data (MEC), the significant distraction effect suggests that the new scale is even more sensitive. This points out that the scale can be a useful alternative to existing verbal presence selfreport measures.

Validity and reliability of a measure of Latina mother's nutritional self-efficacy

Background. Not only has obesity played a role in Texas adults but it is also becoming a large issue among low-income Latino children. In Latino children between 2-5 years of age, the Pediatric Nutrition Surveillance data in 1997 found the prevalence of obesity was 12 percent, highest among all ethnic groups. Children learn what and how to eat from their environment. Despite many mothers being working mothers they are still the principal caregivers and source of influence on their toddler's diet. Self-efficacy, a concept created by Albert Bandura, one's belief that one is capable of performing a behavior needed to reach an intended goal, is increasingly becoming important in nutrition and health education. This study is important to understand the degree of impact that a mother's self-efficacy will have on a child's diet. This is useful knowing if influencing a mother's self-efficacy could improve a child's diet to prevent certain public health issues such as obesity and diabetes. The purpose of this study was to examine nutrition self-efficacy of Latina mothers, focusing on sweets and beverage and if their self-efficacy impacted their child's diet. Methods. The data was collected during July-September 2008. Mothers were recruited from two federally qualified San Antonio health centers. In order to qualify, participants had to be Hispanic with children of toddler age. Mothers were informed of incentives available upon completion. The interview consisted of demographic info, a set of five self-efficacy questions repeated at completion, testing reliability and a 24-hour food recall diary asked of the participant's child's diet. Results. There were 225 mothers who participated between both clinics. The Crohnbach alpha scores for the two different times the self-efficacy questions were asked were .44 corresponding to the first time and .49 for the second time. The three most common beverages reported were milk, juice, and water. The mothers who met or gave their child more milk than recommended by the scientific community, 800mg of calcium/3 cups (24oz) set, had a higher self-efficacy score than those who did not meet the standard at all. Mothers who gave their children more juice than the standard recommends, 4-6oz for children 1-6 years of age, had slightly higher self-efficacy scores than mother's who simply met the standard. In general, the lower the mother's self-efficacy, the more sweets they gave their child and vice versa. Conclusion. This study's Kappa values were adequate and this research showed that Latina mothers did in fact have high self-efficacy. In general some of the children's diets did not reflect the current scientific nutrition recommendations. In order to improve self-efficacy and have an impact on children's diets, the scientific community has a responsibility to make recommendations that are easily understood and can be put into practice. The public health community needs to ensure that we encourage those we serve to be more active in their health and educate them about what constitutes good health and nutrition for both themselves and their children.^