Looking for Validity or Testing It? The Perils of Stepwise Regression, Extreme-Scores Analysis, Heteroscedasticity, and Measurement Error

When researchers introduce a new test they have to demonstrate that it is valid, using unbiased designs and suitable statistical procedures. In this article we use Monte Carlo analyses to highlight how incorrect statistical procedures (i.e., stepwise regression, extreme scores analyses) or ignoring regression assumptions (e.g., heteroscedasticity) contribute to wrong validity estimates. Beyond these demonstrations, and as an example, we re-examined the results reported by Warwick, Nettelbeck, and Ward (2010) concerning the validity of the Ability Emotional Intelligence Measure (AEIM). Warwick et al. used the wrong statistical procedures to conclude that the AEIM was incrementally valid beyond intelligence and personality traits in predicting various outcomes. In our re-analysis, we found that the reliability-corrected multiple correlation of their measures with personality and intelligence was up to .69. Using robust statistical procedures and appropriate controls, we also found that the AEIM did not predict incremental variance in GPA, stress, loneliness, or well-being, demonstrating the importance for testing validity instead of looking for it.

Toll-interacting protein modulates colitis susceptibility in mice.

BACKGROUND: The intestinal epithelium accommodates with a myriad of commensals to maintain immunological homeostasis, but the underlying mechanisms regulating epithelial responsiveness to flora-derived signals remain poorly understood. Herein, we sought to determine the role of the Toll/interleukin (IL)-1 receptor regulator Toll-interacting protein (Tollip) in intestinal homeostasis. METHODS: Colitis susceptibility was determined after oral dextran sulfate sodium (DSS) administration or by breeding Tollip on an IL-10 background. The intestinal flora was depleted with 4 antibiotics before DSS exposure to assess its contribution in colitis onset. Bone marrow chimeras were generated to identify the cellular compartment, whereby Tollip may negatively regulate intestinal inflammation in response to DSS. Tollip-dependent epithelial barrier functions were studied in vitro by using Tollip-knockdown in Caco-2 cells and in vivo by immunohistochemistry and fluorescein isothiocyanate-labeled dextran gavage. RESULTS: Genetic ablation of Tollip did not lead to spontaneous intestinal inflammatory disorders. However, Tollip deficiency aggravated spontaneous disease onset in IL-10 mice and increased susceptibility to DSS colitis. Increased colitis severity in Tollip-deficient mice was not improved by bacterial flora depletion using broad-spectrum antibiotics. In addition, DSS exposure of bone marrow chimeric mice revealed a protective role for Tollip in nonhematopoietic cells. Knockdown of Tollip in epithelial cells led to exaggerated NFκ-B activity and proinflammatory cytokine secretion. Finally, DSS-treated Tollip mice showed enhanced intestinal permeability and increased epithelial apoptosis when compared with wild-type controls, a finding that coincided with tight junction alterations on injury. CONCLUSION: Overall, our data show an essential role for Tollip on colitis susceptibility in mice.

Toll-Interacting Protein Deficiency Leads to Increased Susceptibility to Acute and Chronic Colitis.

BACKGROUND: Sensing of bacterial products via Toll-like receptors is critical to maintain gut immune homeostasis. The Toll-Interacting Protein (Tollip) inhibits downstream signaling through the IL-1 receptor, TLR-2 and TLR-4. Here,we aimed to address the role of Tollip in acute and chronic inflammatory responses in the gut. MATERIAL AND METHODS: WT or Tollip-deficient mice were exposed to dextran sulfate sodium (DSS) 1.5% in the drinking water during 7 days. To generate bone-marrow chimeras, WT or Tollip deficient mice were 900-rads irradiated, transplanted with WT or Tollip deficient bone-marrow cells and challenged with DSS 2-3 months after transplantation. IL-10 deficient mice were bred with Tollip deficient mice and colitis was compared at various time points. RESULTS: Upon DSS exposure, Tollip-deficient mice had increased body weight loss and increased pro-inflammatory cytokine expression compared to WT controls. Challenge of bone-marrow chimeras showed that colitis susceptibility was also increased when Tollip deficiency was restricted to non-hematopoietic cells. DSS-exposure lead to a disorganized distribution of zona-occludens-1, a tight junction marker and increased number of apoptotic, cleaved caspase 3 positive, epithelial cells in Tollip-deficient compared to WT mice. Chronic colitis was also affected by Tollip deficiency as Tollip/IL-10 deficient mice had more severe histological stigmata of colitis and higher IL-17 expression than IL-10 deficient controls. CONCLUSION: Tollip in non-hematopoietic cells is critical for adequate response to a chemical-induced stress in the gut and to hamper chronic bacteria-driven colitis. Modulation of epithelial cell integrity via Tollip likely contributes to the observed defects.

KRAS mutation testing for predicting response to anti-EGFR therapy for colorectal carcinoma: proposal for an European quality assurance program.

Novel therapeutic agents targeting the epidermal growth factor receptor (EGFR) have improved outcomes for patients with colorectal carcinoma. However, these therapies are effective only in a subset of patients. Activating mutations in the KRAS gene are found in 30-40% of colorectal tumors and are associated with poor response to anti-EGFR therapies. Thus, KRAS mutation status can predict which patient may or may not benefit from anti-EGFR therapy. Although many diagnostic tools have been developed for KRAS mutation analysis, validated methods and standardized testing procedures are lacking. This poses a challenge for the optimal use of anti-EGFR therapies in the management of colorectal carcinoma. Here we review the molecular basis of EGFR-targeted therapies and the resistance to treatment conferred by KRAS mutations. We also present guideline recommendations and a proposal for a European quality assurance program to help ensure accuracy and proficiency in KRAS mutation testing across the European Union.

Hypoxia-inducible miR-210 regulates the susceptibility of tumor cells to lysis by cytotoxic T cells.

Hypoxia in the tumor microenvironment plays a central role in the evolution of immune escape mechanisms by tumor cells. In this study, we report the definition of miR-210 as a miRNA regulated by hypoxia in lung cancer and melanoma, documenting its involvement in blunting the susceptibility of tumor cells to lysis by antigen-specific cytotoxic T lymphocytes (CTL). miR-210 was induced in hypoxic zones of human tumor tissues. Its attenuation in hypoxic cells significantly restored susceptibility to autologous CTL-mediated lysis, independent of tumor cell recognition and CTL reactivity. A comprehensive approach using transcriptome analysis, argonaute protein immunoprecipitation, and luciferase reporter assay revealed that the genes PTPN1, HOXA1, and TP53I11 were miR-210 target genes regulated in hypoxic cells. In support of their primary importance in mediating the immunosuppressive effects of miR-210, coordinate silencing of PTPN1, HOXA1, and TP53I11 dramatically decreased tumor cell susceptibility to CTL-mediated lysis. Our findings show how miR-210 induction links hypoxia to immune escape from CTL-mediated lysis, by providing a mechanistic understanding of how this miRNA mediates immunosuppression in oxygen-deprived regions of tumors where cancer stem-like cells and metastatic cellular behaviors are known to evolve.

Host genome influences on susceptibility to HIV-1

In vitro and in vivo analyses identified a significant component of heritability in cellular or host susceptibility to HIV-1. The bases for susceptibility can be traced to genetic differences (inter-species) resulting from evolutionary adaptation to exogenous (and endogenous) retroviral infections, and to intra-species and inter-individual (human) differences associated with genetic variation. We have completed large scale evolutionary analysis of genes involved in HIV life cycle and pathogenesis, as well as participating and conducting genome-wide association studies, linkage analysis, and transcriptome analysis. These studies allowed a better understanding of the influence of common human variants in HIV-1 susceptibility and define a number of experimental challenges in the filed: understanding of the role of rare and private mutations in susceptibility, and the development of better tools for the integration of data from large-scale studies.

Une méta-analyse GWA de la glycémie après 2h d'HGPO révèle que GIPR est associé avec la sécrétion de l'insuline en réponse au glucose et que l'ADCY5 est un nouveau gène de suseptibilité au diabète de type 2. [A meta-analysis of GWA blood glucose after 2 h of OGTT revealed that GIPR is associated with the secretion of insulin based on glucose and ADCY5 is a new susceptibility gene for type 2 diabetes.]

Introduction: Les études GVvA (Genome-wide association ,-studies) ont identifié et confirmé plus de 20 gènes de susceptibilité au DT2 et ont contribué à mieux comprendre sa physiopathologie. L'hyperglycémie à jeun (GJ), et 2 heures après une HGPO (G2h) sont les deux mesures cliniques du diagnostic du DT2. Nous avons identifié récemment la G6P du pancréas (G6PC2) comme déterminant de la variabilité physiologique de la GJ puis Ie récepteur à la mélatonine (MTNRIB) qui de plus lie la régulation du rythme circadien au DT2. Dans ce travail nous avons étudié la génétique de la G2h à l'aide de l'approche GWA. Résultats: Nous avons réalisé une méta-analyse GWA dans le cadre de MAGIC (Meta-Analysis of Glucose and Insulin related traits Consortium) qui a inclus 9 études GWA (N=15'234). La réplication de 29 loci (N=6958-30 121, P < 10-5 ) a confirmé 5 nouveaux loci; 2 étant connus comme associés avec Ie DT2 (TCF7L2, P = 1,6 X 10-10 ) et la GJ (GCKR, p = 5,6 X 10-10 ); alors que GIPR (p= 5,2 X 10-12), VSP13C (p= 3,9 X 10-8) et ADCY5 (p = 1,11 X 10-15 ) sont inédits. GIPR code Ie récepteur au GIP (gastric inhibitory polypeptide) qui est sécrété par les ceIlules intestinales pour stimuler la sécrétion de l'insuline en réponse au glucose (l'effet incrétine). Les porteurs du variant GIPR qui augmente la G2h ont également un indice insulinogénique plus bas, (p= 1,0 X 10-17) mais ils ne présentent aucune modification de leur glycémie suite à une hyperglycémie provoquée par voie veineuse (p= 0,21). Ces résultats soutiennent un effet incrétine du locus GIPR qui expliquerait ~9,6 % de la variance total de ce trait. La biologie de ADCY5 et VPS13C et son lien avec l'homéostasie du glucose restent à élucider. GIPR n'est pas associé avec le risque de DT2 indiquant qu'il influence la variabilité physiologique de la G2h alors que le locus ADCY5 est associé avec le DT2 (OR = 1,11, P = 1,5 X 10-15). Conclusion: Notre étude démontre que l'étude de la G2h est une approche efficace d'une part pour la compréhension de la base génétique de la physiologie de ce trait clinique important et d'autre part pour identifier de nouveaux gènes de susceptibilité au DT2.

Methicillin-resistant Staphylococcus aureus with intermediate susceptibility to vancomycin: are strict additional contact measures sufficient?

Background: A hospitalised patient infected with MRSA was found to harbour a VISA strain after 6 weeks of treatment with vancomycin. Additional contact measures were reinforced according to CDCs recommendations. We decide to evaluate if these applied control measures were effective. Objective: To evaluate the efficacy of strict additional contact measures to contain the dissemination of VISA from an infected patient. Methods: All patients from the unit were screened weekly for MRSA during a 6-week period, whereas health care workers (HCW) were screened only once. Screening specimen included nose, throat, groin, and clinical specimens for patients, and only nose and throat for HCW. Broth enrichment and chromogenic agar (MRSA-select) were used for MRSA detection. All MRSA isolates were tested on Van screen plates, and growing colonies were tested for MIC of vancomycin. MIC was performed using Etest. Population analysis was done for VISA confirmation. One strain per person was typed by Double Locus Sequence Typing (based on clfB and spa sequencing). Results: 66 patients hospitalized in the same service during the 6 weeks and 55 HCW were screened for MRSA and VISA. MRSA was found in 16/66 (24%) patients and 1/55 (2%) HCW. 16/17 MRSA from patients belonged to the same genotype that the VISA strain. The remaining patient had a MRSA identical to the HCW isolate. Among the 16 MRSA isolates sharing the same genotype than the VISA strain, two showed Etests vancomycin MIC of only 4 mg/L. MIC results were confirmed by the population analysis. They were not considered as VISA, but as MRSA with increased vancomycin MICs. Both isolates were obtained from two roommates. Conclusion: Strict additional contact measures were found to be effective to contain VISA dissemination. However, the identification of two isolates with increased vancomycin MIC (4 mg/L) in two roommates raised the question of the need to routinely test this susceptibility and of adequate control measures for patients harbouring such isolates.

Testing the competitive exclusion principle using various niche parameters in a native (Natrix maura) and an introduced (N. tessellata) colubrid

Despite the increase of animal and plant introductions worldwide and the strong augmentation of the reptile trade, few invasive snake populations have been studied. Dice snakes (Natrix tessellata) were introduced to the shores of Lake Geneva (Switzerland) in the early 1920s, and are now well established. This region of introduction was previously inhabited by Viperine snakes (N. maura). Ever since these two species have been under monitoring (which began in 1996) the Viperine snake population has shown drastic decline. We examine here the possibility of trophic competition by analysing diet composition, prey size and trophic niche overlap. Spatial distribution is also assessed in order to address the question of spatial competitive exclusion. We found very similar diets, and thus a high trophic niche overlap, indicating no partitioning of the trophic resource. No arguments in favour of spatial competitive exclusion were found. Our study suggests that trophic competition may occur between the two natricines and that it may give an explanation for the drastic decline of the Viperine snake in this area. Other pathways potentially playing a role in the exclusion of the Viperine snake are discussed.

Dissecting the genetic heterogeneity of depression through age at onset.

Genome-wide studies in major depression have identified few replicated associations, potentially due to heterogeneity within the disorder. Several studies have suggested that age at onset (AAO) can distinguish sub-types of depression with specific heritable components. This paper investigates the role of AAO in the genetic susceptibility for depression using genome-wide association data on 2,746 cases and 1,594 screened controls from the RADIANT studies, with replication performed in 1,471 cases and 1,403 controls from two Munich studies. Three methods were used to analyze AAO: First a time-to-event analysis with controls censored, secondly comparing controls to case-subsets defined using AAO cut-offs, and lastly analyzing AAO as a quantitative trait. In the time-to-event analysis three SNPs reached suggestive significance (P < 5E-06), overlapping with the original case-control analysis of this study. In a case-control analysis using AAO thresholds, SNPs in 10 genomic regions showed suggestive association though again none reached genome-wide significance. Lastly, case-only analysis of AAO as a quantitative trait resulted in 5 SNPs reaching suggestive significance. Sex specific analysis was performed as a secondary analysis, yielding one SNP reaching genome-wide significance in early-onset males. No SNPs achieved significance in the replication study after correction for multiple testing. Analysis of AAO as a quantitative trait did suggest that, across all SNPs, common genetic variants explained a large proportion of the variance (51%, P = 0.04). This study provides the first focussed analysis of the genetic contribution to AAO in depression, and establishes a statistical framework that can be applied to a quantitative trait underlying any disorder. © 2012 Wiley Periodicals, Inc.