Meta-analysis and dose-response metaregression: circulating insulin-like growth factor I (IGF-I) and mortality

Context: IGF-I plays a central role in metabolism and growth regulation. High IGF-I levels are associated with increased cancer risk and low IGF-I levels with increased risk for cardiovascular disease. Objective: Our objective was to determine the relationship between circulating IGF-I levels and mortality in the general population using random-effects meta-analysis and dose-response metaregression. Data Sources: We searched PubMed, EMBASE, Web of Science, and Cochrane Library from 1985 to September 2010 to identify relevant studies. Study Selection: Population-based cohort studies and (nested) case-control studies reporting on the relation between circulating IGF-I and mortality were assessed for eligibility. Data Extraction: Data extraction was performed by two investigators independently, using a standardized data extraction sheet. Data Synthesis: Twelve studies, with 14,906 participants, were included. Overall, risk of bias was limited. Mortality in subjects with low or high IGF-I levels was compared with mid-centile reference categories. All-cause mortality was increased in subjects with low as well as high IGF-I, with a hazard ratio (HR) of 1.27 (95% CI = 1.08–1.49) and HR of 1.18 (95% CI = 1.04–1.34), respectively. Dose-response metaregression showed a U-shaped relation of IGF-I and all-cause mortality (P = 0.003). The predicted HR for the increase in mortality comparing the 10th IGF-I with the 50th percentile was 1.56 (95% CI = 1.31–1.86); the predicted HR comparing the 90th with the 50th percentile was 1.29 (95% CI = 1.06–1.58). A U-shaped relationship was present for both cancer mortality and cardiovascular mortality. Conclusions: Both low and high IGF-I concentrations are associated with increased mortality in the general population.

Association between reported exposure to road traffic and respiratory symptoms in children: evidence of bias

BACKGROUND: Many studies showing effects of traffic-related air pollution on health rely on self-reported exposure, which may be inaccurate. We estimated the association between self-reported exposure to road traffic and respiratory symptoms in preschool children, and investigated whether the effect could have been caused by reporting bias. METHODS: In a random sample of 8700 preschool children in Leicestershire, UK, exposure to road traffic and respiratory symptoms were assessed by a postal questionnaire (response rate 80%). The association between traffic exposure and respiratory outcomes was assessed using unconditional logistic regression and conditional regression models (matching by postcode). RESULTS: Prevalence odds ratios (95% confidence intervals) for self-reported road traffic exposure, comparing the categories 'moderate' and 'dense', respectively, with 'little or no' were for current wheezing: 1.26 (1.13-1.42) and 1.30 (1.09-1.55); chronic rhinitis: 1.18 (1.05-1.31) and 1.31 (1.11-1.56); night cough: 1.17 (1.04-1.32) and 1.36 (1.14-1.62); and bronchodilator use: 1.20 (1.04-1.38) and 1.18 (0.95-1.46). Matched analysis only comparing symptomatic and asymptomatic children living at the same postcode (thus exposed to similar road traffic) showed similar ORs, suggesting that parents of children with respiratory symptoms reported more road traffic than parents of asymptomatic children. CONCLUSIONS: Our study suggests that reporting bias could explain some or even all the association between reported exposure to road traffic and disease. Over-reporting of exposure by only 10% of parents of symptomatic children would be sufficient to produce the effect sizes shown in this study. Future research should be based only on objective measurements of traffic exposure.

ASSESSING THE UNRELIABILITY OF THE MEDICAL LITERATURE: A RESPONSE TO "WHY MOST PUBLISHED RESEARCH FINDINGS ARE FALSE"

A recent article in this journal (Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2: e124) argued that more than half of published research findings in the medical literature are false. In this commentary, we examine the structure of that argument, and show that it has three basic components: 1)An assumption that the prior probability of most hypotheses explored in medical research is below 50%. 2)Dichotomization of P-values at the 0.05 level and introduction of a “bias” factor (produced by significance-seeking), the combination of which severely weakens the evidence provided by every design. 3)Use of Bayes theorem to show that, in the face of weak evidence, hypotheses with low prior probabilities cannot have posterior probabilities over 50%. Thus, the claim is based on a priori assumptions that most tested hypotheses are likely to be false, and then the inferential model used makes it impossible for evidence from any study to overcome this handicap. We focus largely on step (2), explaining how the combination of dichotomization and “bias” dilutes experimental evidence, and showing how this dilution leads inevitably to the stated conclusion. We also demonstrate a fallacy in another important component of the argument –that papers in “hot” fields are more likely to produce false findings. We agree with the paper’s conclusions and recommendations that many medical research findings are less definitive than readers suspect, that P-values are widely misinterpreted, that bias of various forms is widespread, that multiple approaches are needed to prevent the literature from being systematically biased and the need for more data on the prevalence of false claims. But calculating the unreliability of the medical research literature, in whole or in part, requires more empirical evidence and different inferential models than were used. The claim that “most research findings are false for most research designs and for most fields” must be considered as yet unproven.

A non-spatial bias favouring fixated stimuli revealed in patients with spatial neglect

The cardinal feature of spatial neglect is severely impaired exploration of the contralesional space, a failure resulting in unawareness of many contralesional stimuli. This deficit is exacerbated by a reflexive attentional bias toward ipsilesional items. Here we show that, in addition to these spatially lateralized failures, neglect patients also exhibit a severe bias favouring stimuli presented at fixation. We tested neglect patients and matched healthy and right-hemisphere damaged patients without neglect in a task requiring saccade execution to targets in the left or right hemifield. Targets were presented alone or simultaneously with a distracter that appeared in the same hemifield, in the opposite hemifield, or at fixation. We found two fundamental biases in saccade initiation of neglect patients: irrelevant distracters presented in the preserved hemifield tended to capture gaze reflexively, resulting in a large number of saccades erroneously directed toward the distracter. Additionally, distracters presented at fixation severely disrupted saccade initiation irrespective of saccade direction, leading to disproportionately increased latencies of left and right saccades. This latency increase was specific to oculomotor responses of neglect patients and was not observed when a manual response was required. These results show that, in addition to their failure to inhibit reflexive glances toward ipsilesional items neglect patients exhibit a strong oculomotor bias favouring fixated stimuli. We conclude that impaired initiation of saccades in any direction contributes to the deficits of spatial exploration that characterize spatial neglect.

Asking Sensitive Questions in Online Surveys: An Experimental Comparison of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies show that asking sensitive questions is problematic also in self-administered mode. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors gained via online surveys can be challenged. A well-known method to combat these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online mode is still lacking. Moreover, an alternative approach called the Crosswise Model (CM) has recently been suggested to overcome some of the deficiencies of the RRT. In the context of an online survey on plagiarism and cheating on exams among students of two Swiss universities (N = 6,494), we tested different implementations of the RRT and the CM and compared them to direct questioning using a randomized experimental design. Results reveal a poor performance of the RRT, which failed to elicit higher prevalence estimates than direct questioning. Using the CM however, significantly higher prevalence estimates were obtained making it a promising new alternative to the conventional RRT.

Design and analysis for three level hierarchical structures with count response

In numerous intervention studies and education field trials, random assignment to treatment occurs in clusters rather than at the level of observation. This departure of random assignment of units may be due to logistics, political feasibility, or ecological validity. Data within the same cluster or grouping are often correlated. Application of traditional regression techniques, which assume independence between observations, to clustered data produce consistent parameter estimates. However such estimators are often inefficient as compared to methods which incorporate the clustered nature of the data into the estimation procedure (Neuhaus 1993).1 Multilevel models, also known as random effects or random components models, can be used to account for the clustering of data by estimating higher level, or group, as well as lower level, or individual variation. Designing a study, in which the unit of observation is nested within higher level groupings, requires the determination of sample sizes at each level. This study investigates the design and analysis of various sampling strategies for a 3-level repeated measures design on the parameter estimates when the outcome variable of interest follows a Poisson distribution. ^ Results study suggest that second order PQL estimation produces the least biased estimates in the 3-level multilevel Poisson model followed by first order PQL and then second and first order MQL. The MQL estimates of both fixed and random parameters are generally satisfactory when the level 2 and level 3 variation is less than 0.10. However, as the higher level error variance increases, the MQL estimates become increasingly biased. If convergence of the estimation algorithm is not obtained by PQL procedure and higher level error variance is large, the estimates may be significantly biased. In this case bias correction techniques such as bootstrapping should be considered as an alternative procedure. For larger sample sizes, those structures with 20 or more units sampled at levels with normally distributed random errors produced more stable estimates with less sampling variance than structures with an increased number of level 1 units. For small sample sizes, sampling fewer units at the level with Poisson variation produces less sampling variation, however this criterion is no longer important when sample sizes are large. ^ 1Neuhaus J (1993). “Estimation efficiency and Tests of Covariate Effects with Clustered Binary Data”. Biometrics , 49, 989–996^

Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.

Evidence for an encounter expectancy bias in fear of spiders.

Whereas research has demonstrated that phobic or fearful individuals overestimate the likelihood of incurring aversive consequences from an encounter with feared stimuli, it has not yet been systematically investigated whether these individuals also overestimate the likelihood (i.e., the frequency) of such encounters. In the current study, spider-fearful and control participants were presented with background information that allowed them to estimate the overall likelihood that different kinds of animals (spiders, snakes, or birds) would be encountered. Spider-fearful participants systematically overestimated the likelihood of encountering a spider with respect to the likelihood of encountering a snake or a bird. No such expectancy bias was observed in control participants. The results thus strengthen our idea that there indeed exist two different types of expectancy bias in high fear and phobia that can be related to different components of the fear response. A conscientious distinction and examination of these two types of expectancy bias are of potential interest for therapeutic applications.

Effects of stereotypic behaviour and chronic mild stress on judgement bias in laboratory mice

Cognitive processes are influenced by underlying affective states, and tests of cognitive bias have recently been developed to assess the valence of affective states in animals. These tests are based on the fact that individuals in a negative affective state interpret ambiguous stimuli more pessimistically than individuals in a more positive state. Using two strains of mice we explored whether unpredictable chronic mild stress (UCMS) can induce a negative judgement bias and whether variation in the expression of stereotypic behaviour is associated with variation in judgement bias. Sixteen female CD-1 and 16 female C57BL/6 mice were trained on a tactile conditional discrimination test with grade of sandpaper as a cue for differential food rewards. Once they had learned the discrimination, half of the mice were subjected to UCMS for three weeks to induce a negative affective state. Although UCMS induced a reduced preference for the higher value reward in the judgement bias test, it did not affect saccharine preference or hypothalamic–pituitary–adrenal (HPA) activity. However, UCMS affected responses to ambiguous (intermediate) cues in the judgement bias test. While control mice showed a graded response to ambiguous cues, UCMS mice of both strains did not discriminate between ambiguous cues and tended to show shorter latencies to the ambiguous cues and the negative reference cue. UCMS also increased bar-mouthing in CD-1, but not in C57BL/6 mice. Furthermore, mice with higher levels of stereotypic behaviour made more optimistic choices in the judgement bias test. However, no such relationship was found for stereotypic bar-mouthing, highlighting the importance of investigating different types of stereotypic behaviour separately.

Response to chemotherapy, recurrence and survival in advanced-stage ovarian, fallopian tube and primary peritoneal cancer patients with non-Ashkenazi Jewish BRCA mutations, compared to those without

Objectives. Previous studies have shown a survival advantage in ovarian cancer patients with Ashkenazi-Jewish (AJ) BRCA founder mutations, compared to sporadic ovarian cancer patients. The purpose of this study was to determine if this association exists in ovarian cancer patients with non-Ashkenazi Jewish BRCA mutations. In addition, we sought to account for possible "survival bias" by minimizing any lead time that may exist between diagnosis and genetic testing. ^ Methods. Patients with stage III/IV ovarian, fallopian tube, or primary peritoneal cancer and a non-Ashkenazi Jewish BRCA1 or 2 mutation, seen for genetic testing January 1996-July 2007, were identified from genetics and institutional databases. Medical records were reviewed for clinical factors, including response to initial chemotherapy. Patients with sporadic (non-hereditary) ovarian, fallopian tube, or primary peritoneal cancer, without family history of breast or ovarian cancer, were compared to similar cases, matched by age, stage, year of diagnosis, and vital status at time interval to BRCA testing. When possible, 2 sporadic patients were matched to each BRCA patient. An additional group of unmatched, sporadic ovarian, fallopian tube and primary peritoneal cancer patients was included for a separate analysis. Progression-free (PFS) & overall survival (OS) were calculated by the Kaplan-Meier method. Multivariate Cox proportional hazards models were calculated for variables of interest. Matched pairs were treated as clusters. Stratified log rank test was used to calculate survival data for matched pairs using paired event times. Fisher's exact test, chi-square, and univariate logistic regression were also used for analysis. ^ Results. Forty five advanced-stage ovarian, fallopian tube and primary peritoneal cancer patients with non-Ashkenazi Jewish (non-AJ) BRCA mutations, 86 sporadic-matched and 414 sporadic-unmatched patients were analyzed. Compared to the sporadic-matched and sporadic-unmatched ovarian cancer patients, non-AJ BRCA mutation carriers had longer PFS (17.9 & 13.8 mos. vs. 32.0 mos., HR 1.76 [95% CI 1.13–2.75] & 2.61 [95% CI 1.70–4.00]). In relation to the sporadic- unmatched patients, non-AJ BRCA patients had greater odds of complete response to initial chemotherapy (OR 2.25 [95% CI 1.17–5.41]) and improved OS (37.6 mos. vs. 101.4 mos., HR 2.64 [95% CI 1.49–4.67]). ^ Conclusions. This study demonstrates a significant survival advantage in advanced-stage ovarian cancer patients with non-AJ BRCA mutations, confirming the previous studies in the Jewish population. Our efforts to account for "survival bias," by matching, will continue with collaborative studies. ^

Validity of using item response theory to analyze data from the Work Limitations Questionnaire

The Work Limitations Questionnaire (WLQ) is used to determine the amount of work loss and productivity which stem from certain health conditions, including rheumatoid arthritis and cancer. The questionnaire is currently scored using methodology from Classical Test Theory. Item Response Theory, on the other hand, is a theory based on analyzing item responses. This study wanted to determine the validity of using Item Response Theory (IRT), to analyze data from the WLQ. Item responses from 572 employed adults with dysthymia, major depressive disorder (MDD), double depressive disorder (both dysthymia and MDD), rheumatoid arthritis and healthy individuals were used to determine the validity of IRT (Adler et al., 2006).^ PARSCALE, which is IRT software from Scientific Software International, Inc., was used to calculate estimates of the work limitations based on item responses from the WLQ. These estimates, also known as ability estimates, were then correlated with the raw score estimates calculated from the sum of all the items responses. Concurrent validity, which claims a measurement is valid if the correlation between the new measurement and the valid measurement is greater or equal to .90, was used to determine the validity of IRT methodology for the WLQ. Ability estimates from IRT were found to be somewhat highly correlated with the raw scores from the WLQ (above .80). However, the only subscale which had a high enough correlation for IRT to be considered valid was the time management subscale (r = .90). All other subscales, mental/interpersonal, physical, and output, did not produce valid IRT ability estimates.^ An explanation for these lower than expected correlations can be explained by the outliers found in the sample. Also, acquiescent responding (AR) bias, which is caused by the tendency for people to respond the same way to every question on a questionnaire, and the multidimensionality of the questionnaire (the WLQ is composed of four dimensions and thus four different latent variables) probably had a major impact on the IRT estimates. Furthermore, it is possible that the mental/interpersonal dimension violated the monotonocity assumption of IRT causing PARSCALE to fail to run for these estimates. The monotonicity assumption needs to be checked for the mental/interpersonal dimension. Furthermore, the use of multidimensional IRT methods would most likely remove the AR bias and increase the validity of using IRT to analyze data from the WLQ.^

Bioenergetic trade-offs in the sea cucumber Apostichopus japonicus (Echinodermata: Holothuroidea) in response to CO2-driven ocean acidification

Ocean acidification (OA) caused by excessive CO2 is a potential ecological threat to marine organisms. The impacts of OA on echinoderms are well-documented, but there has been a strong bias towards sea urchins, and limited information is available on sea cucumbers. This work examined the effect of medium-term (60 days) exposure to three pH levels (pH 8.06, 7.72, and 7.41, covering present and future pH variability) on the bioenergetic responses of the sea cucumber, Apostichopus japonicus, an ecologically and economically important holothurian in Asian coasts. Results showed that the measured specific growth rate linearly decreased with decreased pH, leading to a 0.42 %/day decrease at pH 7.41 compared with that at pH 8.06. The impacts of pH on physiological energetics were variable: measured energy consumption and defecation rates linearly decreased with decreased pH, whereas maintenance energy in calculated respiration and excretion were not significantly affected. No shift in energy allocation pattern was observed in A. japonicus upon exposure to pH 7.72 compared with pH 8.06. However, a significant shift in energy budget occurred upon exposure to pH 7.41, leading to decreased energy intake and increased percentage of energy that was lost in feces, thereby resulting in a significantly lowered allocation into somatic growth. These findings indicate that adult A. japonicus is resilient to the OA scenario at the end of the twenty-first century, but further acidification may negatively influence the grazing capability and growth, thereby influencing its ecological functioning as an "ecosystem engineer" and potentially harming its culture output.

Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT)

Gaining valid answers to so-called sensitive questions is an age-old problem in survey research. Various techniques have been developed to guarantee anonymity and minimize the respondent's feelings of jeopardy. Two such techniques are the randomized response technique (RRT) and the unmatched count technique (UCT). In this study we evaluate the effectiveness of different implementations of the RRT (using a forced-response design) in a computer-assisted setting and also compare the use of the RRT to that of the UCT. The techniques are evaluated according to various quality criteria, such as the prevalence estimates they provide, the ease of their use, and respondent trust in the techniques. Our results indicate that the RRTs are problematic with respect to several domains, such as the limited trust they inspire and non-response, and that the RRT estimates are unreliable due to a strong false "no" bias, especially for the more sensitive questions. The UCT, however, performed well compared to the RRTs on all the evaluated measures. The UCT estimates also had more face validity than the RRT estimates. We conclude that the UCT is a promising alternative to RRT in self-administered surveys and that future research should be directed towards evaluating and improving the technique.

Current-voltage response of a spherical plasma contactor

A theoretical model for a contactor, collecting electrons from an ambient, unmagnetized plasma and emitting a current Iiis discussed. The relation between Ii and the potential bias of the contactor is found to be crucial for the formation of a quasineutral core around the anode and, consequently, for the current colleted. Approximate analytical laws and charts for the current-voltage response are provided.

Female preference for swords in Xiphophorus helleri reflects a bias for large apparent size

Swordtail fish (Poeciliidae: genus Xiphophorus) are a paradigmatic case of sexual selection by sensory exploitation. Female preference for males with a conspicuous “sword” ornament is ancestral, suggesting that male morphology has evolved in response to a preexisting bias. The perceptual mechanisms underlying female mate choice have not been identified, complicating efforts to understand the selection pressures acting on ornament design. We consider two alternative models of receiver behavior, each consistent with previous results. Females could respond either to specific characteristics of the sword or to more general cues, such as the apparent size of potential mates. We showed female swordtails a series of computer-altered video sequences depicting a courting male. Footage of an intact male was preferred strongly to otherwise identical sequences in which portions of the sword had been deleted selectively, but a disembodied courting sword was less attractive than an intact male. There was no difference between responses to an isolated sword and to a swordless male of comparable length, or between an isolated sword and a homogenous background. Female preference for a sworded male was abolished by enlarging the image of a swordless male to compensate for the reduction in length caused by removing the ornament. This pattern of results is consistent with mate choice being mediated by a general preference for large males rather than by specific characters. Similar processes may account for the evolution of exaggerated traits in other systems.