Controlling for culture-specific response bias using ipsatization and response style indicators: Family orientation in seventeen cultures and two generations

Within-subject standardization (ipsatization) has been advocated as a possible means to control for culture-specific responding (e.g., Fisher, 2004). However, the consequences of different kinds of ipsatization procedures for the interpretation of mean differences remain unclear. The current study compared several ipsatization procedures with ANCOVA-style procedures using response style indicators for the construct of family orientation with data from 14 cultures and two generations from the Value-of-Children-(VOC)-Study (4135 dyads). Results showed that within-subject centering/standardizing across all Likert-scale items of the comprehensive VOC-questionnaire removed most of the original cross-cultural variation in family orientation and lead to a non-interpretable pattern of means in both generations. Within-subject centering/standardizing using a subset of 19 unrelated items lead to a decrease to about half of the original effect size and produced a theoretically meaningful pattern of means. A similar effect size and similar mean differences were obtained when using a measure of acquiescent responding based on the same set of items in an ANCOVA-style analysis. Additional models controlling for extremity and modesty performed worse, and combinations did not differ from the acquiescence-only model. The usefulness of different approaches to control for uniform response styles (scalar equivalence not given) in cross- cultural comparisons is discussed.

School-age children show a bias toward fantasy classifications after playing a platform game

We investigated the influence of playing a video game on children’s ability to distinguish between fantasy and reality. School-age children played a platform game for 15 min and then performed a fantasy/reality distinction task in which they were to judge whether images (from the platform game and from other games) were fantasy images or reality images. Unlike those in the control group (who played a memory game), the children in the experimental group showed a response bias toward mistakenly classifying reality images from the video game as fantasy images (as determined by means of an analysis based on signal detection theory). We conclude that playing the video game exerted a short-term influence on children’s ability to distinguish between fantasy and reality.

Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa

Disturbances in reward processing have been implicated in bulimia nervosa (BN). Abnormalities in processing reward-related stimuli might be linked to dysfunctions of the catecholaminergic neurotransmitter system, but findings have been inconclusive. A powerful way to investigate the relationship between catecholaminergic function and behavior is to examine behavioral changes in response to experimental catecholamine depletion (CD). The purpose of this study was to uncover putative catecholaminergic dysfunction in remitted subjects with BN who performed a reinforcement-learning task after CD. CD was achieved by oral alpha-methyl-para-tyrosine (AMPT) in 19 unmedicated female subjects with remitted BN (rBN) and 28 demographically matched healthy female controls (HC). Sham depletion administered identical capsules containing diphenhydramine. The study design consisted of a randomized, double-blind, placebo-controlled crossover, single-site experimental trial. The main outcome measures were reward learning in a probabilistic reward task analyzed using signal-detection theory. Secondary outcome measures included self-report assessments, including the Eating Disorder Examination-Questionnaire. Relative to healthy controls, rBN subjects were characterized by blunted reward learning in the AMPT-but not in placebo-condition. Highlighting the specificity of these findings, groups did not differ in their ability to perceptually distinguish between stimuli. Increased CD-induced anhedonic (but not eating disorder) symptoms were associated with a reduced response bias toward a more frequently rewarded stimulus. In conclusion, under CD, rBN subjects showed reduced reward learning compared with healthy control subjects. These deficits uncover disturbance of the central reward processing systems in rBN related to altered brain catecholamine levels, which might reflect a trait-like deficit increasing vulnerability to BN.

Opinions on registering trial details: a survey of academic researchers

BACKGROUND: The World Health Organization (WHO) has established a set of items related to study design and administrative information that should build the minimum set of data in a study register. A more comprehensive data set for registration is currently developed by the Ottawa Group. Since nothing is known about the attitudes of academic researchers towards prospective study registration, we surveyed academic researchers about their opinion regarding the registration of study details proposed by the WHO and the Ottawa Group. METHODS: This was a web-based survey of academic researchers currently running an investigator-initiated clinical study which is registered with clinicaltrials.gov. In July 2006 we contacted 1299 principal investigators of clinical studies by e-mail explaining the purpose of the survey and a link to access a 52-item questionnaire based on the proposed minimum data set by the Ottawa Group. Two reminder e-mails were sent each two weeks apart. Association between willingness to disclose study details and study phase was assessed using the chi-squared test for trend. To explore the potential influence of non-response bias we used logistic regression to assess associations between factors associated with non-response and the willingness to register study details. RESULTS: Overall response was low as only 282/1299 (22%) principal investigators participated in the survey. Disclosing study documents, in particular the study protocol and financial agreements, was found to be most problematic with only 31% of respondents willing to disclose these publicly. Consequently, only 34/282 (12%) agreed to disclose all details proposed by the Ottawa Group. Logistic regression indicated no association between characteristics of non-responders and willingness to disclose details. CONCLUSION: Principal investigators of non-industry sponsored studies are reluctant to disclose all data items proposed by the Ottawa Group. Disclosing the study protocol and financial agreements was found to be most problematic. Future discussions on trial registration should not only focus on industry but also on academic researchers.

Meta-analysis and dose-response metaregression: circulating insulin-like growth factor I (IGF-I) and mortality

Context: IGF-I plays a central role in metabolism and growth regulation. High IGF-I levels are associated with increased cancer risk and low IGF-I levels with increased risk for cardiovascular disease. Objective: Our objective was to determine the relationship between circulating IGF-I levels and mortality in the general population using random-effects meta-analysis and dose-response metaregression. Data Sources: We searched PubMed, EMBASE, Web of Science, and Cochrane Library from 1985 to September 2010 to identify relevant studies. Study Selection: Population-based cohort studies and (nested) case-control studies reporting on the relation between circulating IGF-I and mortality were assessed for eligibility. Data Extraction: Data extraction was performed by two investigators independently, using a standardized data extraction sheet. Data Synthesis: Twelve studies, with 14,906 participants, were included. Overall, risk of bias was limited. Mortality in subjects with low or high IGF-I levels was compared with mid-centile reference categories. All-cause mortality was increased in subjects with low as well as high IGF-I, with a hazard ratio (HR) of 1.27 (95% CI = 1.08–1.49) and HR of 1.18 (95% CI = 1.04–1.34), respectively. Dose-response metaregression showed a U-shaped relation of IGF-I and all-cause mortality (P = 0.003). The predicted HR for the increase in mortality comparing the 10th IGF-I with the 50th percentile was 1.56 (95% CI = 1.31–1.86); the predicted HR comparing the 90th with the 50th percentile was 1.29 (95% CI = 1.06–1.58). A U-shaped relationship was present for both cancer mortality and cardiovascular mortality. Conclusions: Both low and high IGF-I concentrations are associated with increased mortality in the general population.

Association between reported exposure to road traffic and respiratory symptoms in children: evidence of bias

BACKGROUND: Many studies showing effects of traffic-related air pollution on health rely on self-reported exposure, which may be inaccurate. We estimated the association between self-reported exposure to road traffic and respiratory symptoms in preschool children, and investigated whether the effect could have been caused by reporting bias. METHODS: In a random sample of 8700 preschool children in Leicestershire, UK, exposure to road traffic and respiratory symptoms were assessed by a postal questionnaire (response rate 80%). The association between traffic exposure and respiratory outcomes was assessed using unconditional logistic regression and conditional regression models (matching by postcode). RESULTS: Prevalence odds ratios (95% confidence intervals) for self-reported road traffic exposure, comparing the categories 'moderate' and 'dense', respectively, with 'little or no' were for current wheezing: 1.26 (1.13-1.42) and 1.30 (1.09-1.55); chronic rhinitis: 1.18 (1.05-1.31) and 1.31 (1.11-1.56); night cough: 1.17 (1.04-1.32) and 1.36 (1.14-1.62); and bronchodilator use: 1.20 (1.04-1.38) and 1.18 (0.95-1.46). Matched analysis only comparing symptomatic and asymptomatic children living at the same postcode (thus exposed to similar road traffic) showed similar ORs, suggesting that parents of children with respiratory symptoms reported more road traffic than parents of asymptomatic children. CONCLUSIONS: Our study suggests that reporting bias could explain some or even all the association between reported exposure to road traffic and disease. Over-reporting of exposure by only 10% of parents of symptomatic children would be sufficient to produce the effect sizes shown in this study. Future research should be based only on objective measurements of traffic exposure.

A non-spatial bias favouring fixated stimuli revealed in patients with spatial neglect

The cardinal feature of spatial neglect is severely impaired exploration of the contralesional space, a failure resulting in unawareness of many contralesional stimuli. This deficit is exacerbated by a reflexive attentional bias toward ipsilesional items. Here we show that, in addition to these spatially lateralized failures, neglect patients also exhibit a severe bias favouring stimuli presented at fixation. We tested neglect patients and matched healthy and right-hemisphere damaged patients without neglect in a task requiring saccade execution to targets in the left or right hemifield. Targets were presented alone or simultaneously with a distracter that appeared in the same hemifield, in the opposite hemifield, or at fixation. We found two fundamental biases in saccade initiation of neglect patients: irrelevant distracters presented in the preserved hemifield tended to capture gaze reflexively, resulting in a large number of saccades erroneously directed toward the distracter. Additionally, distracters presented at fixation severely disrupted saccade initiation irrespective of saccade direction, leading to disproportionately increased latencies of left and right saccades. This latency increase was specific to oculomotor responses of neglect patients and was not observed when a manual response was required. These results show that, in addition to their failure to inhibit reflexive glances toward ipsilesional items neglect patients exhibit a strong oculomotor bias favouring fixated stimuli. We conclude that impaired initiation of saccades in any direction contributes to the deficits of spatial exploration that characterize spatial neglect.

Asking Sensitive Questions in Online Surveys: An Experimental Comparison of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies show that asking sensitive questions is problematic also in self-administered mode. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors gained via online surveys can be challenged. A well-known method to combat these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online mode is still lacking. Moreover, an alternative approach called the Crosswise Model (CM) has recently been suggested to overcome some of the deficiencies of the RRT. In the context of an online survey on plagiarism and cheating on exams among students of two Swiss universities (N = 6,494), we tested different implementations of the RRT and the CM and compared them to direct questioning using a randomized experimental design. Results reveal a poor performance of the RRT, which failed to elicit higher prevalence estimates than direct questioning. Using the CM however, significantly higher prevalence estimates were obtained making it a promising new alternative to the conventional RRT.

Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Evidence for an encounter expectancy bias in fear of spiders.

Whereas research has demonstrated that phobic or fearful individuals overestimate the likelihood of incurring aversive consequences from an encounter with feared stimuli, it has not yet been systematically investigated whether these individuals also overestimate the likelihood (i.e., the frequency) of such encounters. In the current study, spider-fearful and control participants were presented with background information that allowed them to estimate the overall likelihood that different kinds of animals (spiders, snakes, or birds) would be encountered. Spider-fearful participants systematically overestimated the likelihood of encountering a spider with respect to the likelihood of encountering a snake or a bird. No such expectancy bias was observed in control participants. The results thus strengthen our idea that there indeed exist two different types of expectancy bias in high fear and phobia that can be related to different components of the fear response. A conscientious distinction and examination of these two types of expectancy bias are of potential interest for therapeutic applications.