Effect of Population Heterogenization on the Reproducibility of Mouse Behavior: A Multi-Laboratory Study

In animal experiments, animals, husbandry and test procedures are traditionally standardized to maximize test sensitivity and minimize animal use, assuming that this will also guarantee reproducibility. However, by reducing within-experiment variation, standardization may limit inference to the specific experimental conditions. Indeed, we have recently shown in mice that standardization may generate spurious results in behavioral tests, accounting for poor reproducibility, and that this can be avoided by population heterogenization through systematic variation of experimental conditions. Here, we examined whether a simple form of heterogenization effectively improves reproducibility of test results in a multi-laboratory situation. Each of six laboratories independently ordered 64 female mice of two inbred strains (C57BL/6NCrl, DBA/2NCrl) and examined them for strain differences in five commonly used behavioral tests under two different experimental designs. In the standardized design, experimental conditions were standardized as much as possible in each laboratory, while they were systematically varied with respect to the animals' test age and cage enrichment in the heterogenized design. Although heterogenization tended to improve reproducibility by increasing within-experiment variation relative to between-experiment variation, the effect was too weak to account for the large variation between laboratories. However, our findings confirm the potential of systematic heterogenization for improving reproducibility of animal experiments and highlight the need for effective and practicable heterogenization strategies.

Orientation-selective functional magnetic resonance imaging adaptation in primary visual cortex revisited

The processing of orientations is at the core of our visual experience. Orientation selectivity in human visual cortex has been inferred from psychophysical experiments and more recently demonstrated with functional magnetic resonance imaging (fMRI). One method to identify orientation-selective responses is fMRI adaptation, in which two stimuli—either with the same or with different orientations—are presented successively. A region containing orientation-selective neurons should demonstrate an adapted response to the “same orientation” condition in contrast to the “different orientation” condition. So far, human primary visual cortex (V1) showed orientation-selective fMRI adaptation only in experimental designs using prolonged pre-adaptation periods (∼40 s) in combination with top-up stimuli that are thought to maintain the adapted level. This finding has led to the notion that orientation-selective short-term adaptation in V1 (but not V2 or V3) cannot be demonstrated using fMRI. The present study aimed at re-evaluating this question by testing three differently timed adaptation designs. With the use of a more sensitive analysis technique, we show robust orientation-selective fMRI adaptation in V1 evoked by a short-term adaptation design.

A novel comparative research platform designed to determine the functional significance of tree species diversity in European forests

One of the current advances in functional biodiversity research is the move away from short-lived test systems towards the exploration of diversity-ecosystem functioning relationships in structurally more complex ecosystems. In forests, assumptions about the functional significance of tree species diversity have only recently produced a new generation of research on ecosystem processes and services. Novel experimental designs have now replaced traditional forestry trials, but these comparatively young experimental plots suffer from specific difficulties that are mainly related to the tree size and longevity. Tree species diversity experiments therefore need to be complemented with comparative observational studies in existing forests. Here we present the design and implementation of a new network of forest plots along tree species diversity gradients in six major European forest types: the FunDivEUROPE Exploratory Platform. Based on a review of the deficiencies of existing observational approaches and of unresolved research questions and hypotheses, we discuss the fundamental criteria that shaped the design of our platform. Key features include the extent of the species diversity gradient with mixtures up to five species, strict avoidance of a dilution gradient, special attention to community evenness and minimal covariation with other environmental factors. The new European research platform permits the most comprehensive assessment of tree species diversity effects on forest ecosystem functioning to date since it offers a common set of research plots to groups of researchers from very different disciplines and uses the same methodological approach in contrasting forest types along an extensive environmental gradient. (C) 2013 Elsevier GmbH. All rights reserved.

Elucidating the Functional Relationship Between Working Memory Capacity and Psychometric Intelligence: A Fixed-Links Modeling Approach for Experimental Repeated-Measures Designs

Numerous studies reported a strong link between working memory capacity (WMC) and fluid intelligence (Gf), although views differ in respect to how close these two constructs are related to each other. In the present study, we used a WMC task with five levels of task demands to assess the relationship between WMC and Gf by means of a new methodological approach referred to as fixed-links modeling. Fixed-links models belong to the family of confirmatory factor analysis (CFA) and are of particular interest for experimental, repeated-measures designs. With this technique, processes systematically varying across task conditions can be disentangled from processes unaffected by the experimental manipulation. Proceeding from the assumption that experimental manipulation in a WMC task leads to increasing demands on WMC, the processes systematically varying across task conditions can be assumed to be WMC-specific. Processes not varying across task conditions, on the other hand, are probably independent of WMC. Fixed-links models allow for representing these two kinds of processes by two independent latent variables. In contrast to traditional CFA where a common latent variable is derived from the different task conditions, fixed-links models facilitate a more precise or purified representation of the WMC-related processes of interest. By using fixed-links modeling to analyze data of 200 participants, we identified a non-experimental latent variable, representing processes that remained constant irrespective of the WMC task conditions, and an experimental latent variable which reflected processes that varied as a function of experimental manipulation. This latter variable represents the increasing demands on WMC and, hence, was considered a purified measure of WMC controlled for the constant processes. Fixed-links modeling showed that both the purified measure of WMC (β = .48) as well as the constant processes involved in the task (β = .45) were related to Gf. Taken together, these two latent variables explained the same portion of variance of Gf as a single latent variable obtained by traditional CFA (β = .65) indicating that traditional CFA causes an overestimation of the effective relationship between WMC and Gf. Thus, fixed-links modeling provides a feasible method for a more valid investigation of the functional relationship between specific constructs.

Sensitive Questions in Online Surveys: An Experimental Evaluation of the Randomized Response Technique and the Crosswise Model

Self-administered online surveys provide a higher level of privacy protection to respondents than surveys administered by an interviewer. Yet, studies indicate that asking sensitive questions is problematic also in self-administered surveys. Because respondents might not be willing to reveal the truth and provide answers that are subject to social desirability bias, the validity of prevalence estimates of sensitive behaviors from online surveys can be challenged. A well-known method to overcome these problems is the Randomized Response Technique (RRT). However, convincing evidence that the RRT provides more valid estimates than direct questioning in online surveys is still lacking. A new variant of the RRT called the Crosswise Model has recently been proposed to overcome some of the deficiencies of existing RRT designs. We therefore conducted an experimental study in which different implementations of the RRT, including two implementations of the crosswise model, were tested and compared to direct questioning. Our study is a large-scale online survey (N = 6,037) on sensitive behaviors by students such as cheating in exams and plagiarism. Results indicate that the crosswise-model RRT---unlike the other variants of RRT we evaluated---yields higher prevalence estimates of sensitive behaviors than direct questioning. Whether higher estimates are a sufficient condition for more valid results, however, remains questionable.