An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials

Published evidence suggests that aspects of trial design lead to biased intervention effect estimates, but findings from different studies are inconsistent. This study combined data from 7 meta-epidemiologic studies and removed overlaps to derive a final data set of 234 unique meta-analyses containing 1973 trials. Outcome measures were classified as "mortality," "other objective," "or subjective," and Bayesian hierarchical models were used to estimate associations of trial characteristics with average bias and between-trial heterogeneity. Intervention effect estimates seemed to be exaggerated in trials with inadequate or unclear (vs. adequate) random-sequence generation (ratio of odds ratios, 0.89 [95% credible interval {CrI}, 0.82 to 0.96]) and with inadequate or unclear (vs. adequate) allocation concealment (ratio of odds ratios, 0.93 [CrI, 0.87 to 0.99]). Lack of or unclear double-blinding (vs. double-blinding) was associated with an average of 13% exaggeration of intervention effects (ratio of odds ratios, 0.87 [CrI, 0.79 to 0.96]), and between-trial heterogeneity was increased for such studies (SD increase in heterogeneity, 0.14 [CrI, 0.02 to 0.30]). For each characteristic, average bias and increases in between-trial heterogeneity were driven primarily by trials with subjective outcomes, with little evidence of bias in trials with objective and mortality outcomes. This study is limited by incomplete trial reporting, and findings may be confounded by other study design characteristics. Bias associated with study design characteristics may lead to exaggeration of intervention effect estimates and increases in between-trial heterogeneity in trials reporting subjectively assessed outcomes.

Hierarchical modeling gave plausible estimates of associations between metabolic syndrome and components of antiretroviral therapy

OBJECTIVE: Hierarchical modeling has been proposed as a solution to the multiple exposure problem. We estimate associations between metabolic syndrome and different components of antiretroviral therapy using both conventional and hierarchical models. STUDY DESIGN AND SETTING: We use discrete time survival analysis to estimate the association between metabolic syndrome and cumulative exposure to 16 antiretrovirals from four drug classes. We fit a hierarchical model where the drug class provides a prior model of the association between metabolic syndrome and exposure to each antiretroviral. RESULTS: One thousand two hundred and eighteen patients were followed for a median of 27 months, with 242 cases of metabolic syndrome (20%) at a rate of 7.5 cases per 100 patient years. Metabolic syndrome was more likely to develop in patients exposed to stavudine, but was less likely to develop in those exposed to atazanavir. The estimate for exposure to atazanavir increased from hazard ratio of 0.06 per 6 months' use in the conventional model to 0.37 in the hierarchical model (or from 0.57 to 0.81 when using spline-based covariate adjustment). CONCLUSION: These results are consistent with trials that show the disadvantage of stavudine and advantage of atazanavir relative to other drugs in their respective classes. The hierarchical model gave more plausible results than the equivalent conventional model.

European summer temperatures since Roman times

The spatial context is critical when assessing present-day climate anomalies, attributing them to potential forcings and making statements regarding their frequency and severity in a long-term perspective. Recent international initiatives have expanded the number of high-quality proxy-records and developed new statistical reconstruction methods. These advances allow more rigorous regional past temperature reconstructions and, in turn, the possibility of evaluating climate models on policy-relevant, spatio-temporal scales. Here we provide a new proxy-based, annually-resolved, spatial reconstruction of the European summer (June–August) temperature fields back to 755 CE based on Bayesian hierarchical modelling (BHM), together with estimates of the European mean temperature variation since 138 BCE based on BHM and composite-plus-scaling (CPS). Our reconstructions compare well with independent instrumental and proxy-based temperature estimates, but suggest a larger amplitude in summer temperature variability than previously reported. Both CPS and BHM reconstructions indicate that the mean 20th century European summer temperature was not significantly different from some earlier centuries, including the 1st, 2nd, 8th and 10th centuries CE. The 1st century (in BHM also the 10th century) may even have been slightly warmer than the 20th century, but the difference is not statistically significant. Comparing each 50 yr period with the 1951–2000 period reveals a similar pattern. Recent summers, however, have been unusually warm in the context of the last two millennia and there are no 30 yr periods in either reconstruction that exceed the mean average European summer temperature of the last 3 decades (1986–2015 CE). A comparison with an ensemble of climate model simulations suggests that the reconstructed European summer temperature variability over the period 850–2000 CE reflects changes in both internal variability and external forcing on multi-decadal time-scales. For pan-European temperatures we find slightly better agreement between the reconstruction and the model simulations with high-end estimates for total solar irradiance. Temperature differences between the medieval period, the recent period and the Little Ice Age are larger in the reconstructions than the simulations. This may indicate inflated variability of the reconstructions, a lack of sensitivity and processes to changes in external forcing on the simulated European climate and/or an underestimation of internal variability on centennial and longer time scales.

Primary care physician supply and other key determinants of health care utilisation: The case of Switzerland

Background The Swiss government decided to freeze new accreditations for physicians in private practice in Switzerland based on the assumption that demand-induced health care spending may be cut by limiting care offers. This legislation initiated an ongoing controversial public debate in Switzerland. The aim of this study is therefore the determination of socio-demographic and health system-related factors of per capita consultation rates with primary care physicians in the multicultural population of Switzerland. Methods The data were derived from the complete claims data of Swiss health insurers for 2004 and included 21.4 million consultations provided by 6564 Swiss primary care physicians on a fee-for-service basis. Socio-demographic data were obtained from the Swiss Federal Statistical Office. Utilisation-based health service areas were created and were used as observational units for statistical procedures. Multivariate and hierarchical models were applied to analyze the data. Results Models within the study allowed the definition of 1018 primary care service areas with a median population of 3754 and an average per capita consultation rate of 2.95 per year. Statistical models yielded significant effects for various geographical, socio-demographic and cultural factors. The regional density of physicians in independent practice was also significantly associated with annual consultation rates and indicated an associated increase 0.10 for each additional primary care physician in a population of 10,000 inhabitants. Considerable differences across Swiss language regions were observed with reference to the supply of ambulatory health resources provided either by primary care physicians, specialists, or hospital-based ambulatory care. Conclusion The study documents a large small-area variation in utilisation and provision of health care resources in Switzerland. Effects of physician density appeared to be strongly related to Swiss language regions and may be rooted in the different cultural backgrounds of the served populations.

Plant diversity effects on the water balance of an experimental grassland

In the literature, contrasting effects of plant species richness on the soil water balance are reported. Our objective was to assess the effects of plant species and functional richness and functional identity on soil water contents and water fluxes in the experimental grassland of the Jena Experiment. The Jena Experiment comprises 86 plots on which plant species richness (0, 1, 2, 4, 8, 16, and 60) and functional group composition (zero to four functional groups: legumes, grasses, tall herbs, and small herbs) were manipulated in a factorial design. We recorded meteorological data and soil water contents of the 0·0–0·3 and 0·3–0·7 m soil layers and calculated actual evapotranspiration (ETa), downward flux (DF), and capillary rise with a soil water balance model for the period 2003–2007. Missing water contents were estimated with a Bayesian hierarchical model. Species richness decreased water contents in subsoil during wet soil conditions. Presence of tall herbs increased soil water contents in topsoil during dry conditions and decreased soil water contents in subsoil during wet conditions. Presence of grasses generally decreased water contents in topsoil, particularly during dry phases; increased ETa and decreased DF from topsoil; and decreased ETa from subsoil. Presence of legumes, in contrast, decreased ETa and increased DF from topsoil and increased ETa from subsoil. Species richness probably resulted in complementary water use. Specific functional groups likely affected the water balance via specific root traits (e.g. shallow dense roots of grasses and deep taproots of tall herbs) or specific shading intensity caused by functional group effects on vegetation cover. Copyright © 2013 John Wiley & Sons, Ltd.

Negative emotional stimuli enhance vestibular processing

Recent studies have shown that vestibular stimulation can influence affective processes. In the present study, we examined whether emotional information can also modulate vestibular perception. Participants performed a vestibular discrimination task on a motion platform while viewing emotional pictures. Six different picture categories were taken from the International Affective Picture System: mutilation, threat, snakes, neutral objects, sports and erotic pictures. Using a Bayesian hierarchical approach we were able to show that vestibular discrimination improved when participants viewed emotionally negative pictures (mutilation, threat, snake) when compared to neutral objects. There was no difference in vestibular discrimination while viewing emotionally positive compared to neutral pictures. We conclude that some of the mechanisms involved in the processing of vestibular information are also sensitive to emotional content. Emotional information signals importance and mobilizes the body for action. In case of danger, a successful motor response requires precise vestibular processing. Therefore, negative emotional information improves processing of vestibular information.

Negative emotional stimuli enhance vestibular processing

Recent studies have shown that vestibular stimulation can influence affective processes. In the present study, we examined whether emotional information can also modulate vestibular perception. Participants performed a vestibular discrimination task on a motion platform while viewing emotional pictures. Six different picture categories were taken from the International Affective Picture System: mutilation, threat, snakes, neutral objects, sports and erotic pictures. Using a Bayesian hierarchical approach we were able to show that vestibular discrimination improved when participants viewed emotionally negative pictures (mutilation, threat, snake) when compared to neutral objects. There was no difference in vestibular discrimination while viewing emotionally positive compared to neutral pictures. We conclude that some of the mechanisms involved in the processing of vestibular information are also sensitive to emotional content. Emotional information signals importance and mobilizes the body for action. In case of danger, a successful motor response requires precise vestibular processing. Therefore, negative emotional information improves processing of vestibular information.

Establishing the skill of climate field reconstruction techniques for precipitation with pseudoproxy experiments

This study aims at assessing the skill of several climate field reconstruction techniques (CFR) to reconstruct past precipitation over continental Europe and the Mediterranean at seasonal time scales over the last two millennia from proxy records. A number of pseudoproxy experiments are performed within the virtual reality ofa regional paleoclimate simulation at 45 km resolution to analyse different aspects of reconstruction skill. Canonical Correlation Analysis (CCA), two versions of an Analog Method (AM) and Bayesian hierarchical modeling (BHM) are applied to reconstruct precipitation from a synthetic network of pseudoproxies that are contaminated with various types of noise. The skill of the derived reconstructions is assessed through comparison with precipitation simulated by the regional climate model. Unlike BHM, CCA systematically underestimates the variance. The AM can be adjusted to overcome this shortcoming, presenting an intermediate behaviour between the two aforementioned techniques. However, a trade-off between reconstruction-target correlations and reconstructed variance is the drawback of all CFR techniques. CCA (BHM) presents the largest (lowest) skill in preserving the temporal evolution, whereas the AM can be tuned to reproduce better correlation at the expense of losing variance. While BHM has been shown to perform well for temperatures, it relies heavily on prescribed spatial correlation lengths. While this assumption is valid for temperature, it is hardly warranted for precipitation. In general, none of the methods outperforms the other. All experiments agree that a dense and regularly distributed proxy network is required to reconstruct precipitation accurately, reflecting its high spatial and temporal variability. This is especially true in summer, when a specifically short de-correlation distance from the proxy location is caused by localised summertime convective precipitation events.

Reciprocity as a trigger of social cooperation in contemporary immigration societies?

While the system stabilizing function of reciprocity is widely acknowledged, much less attention has been paid to the argument that reciprocity might initiate social cooperation in the first place. This paper tests Gouldner’s early assumption that reciprocity may act as a ‘starting mechanism’ of social cooperation in consolidating societies. The empirical test scenario builds on unequal civic engagement between immigrants and nationals, as this engagement gap can be read as a lack of social cooperation in consolidating immigration societies. Empirical analyses using survey data on reciprocal norms and based on Bayesian hierarchical modelling lend support for Gouldner’s thesis, underlining thereby the relevance of reciprocity in today’s increasingly diverse societies: individual norms of altruistic reciprocity elevate immigrants’ propensity to volunteer, reducing thereby the engagement gap between immigrants and natives in the area of informal volunteering. In other words, compliance with altruistic reciprocity may trigger cooperation in social strata, where it is less likely to occur. The positive moderation of the informal engagement gap through altruistic reciprocity turns out to be most pronounced for immigrants who are least likely to engage in informal volunteering, meaning low, but also high educated immigrants.

Negative Emotional Stimuli Enhance Vestibular Processing

Recent studies have shown that vestibular stimulation can influence affective processes. In the present study, we examined whether emotional information can also modulate vestibular perception. Participants performed a vestibular discrimination task on a motion platform while viewing emotional pictures. Six different picture categories were taken from the International Affective Picture System: mutilation, threat, snakes, neutral objects, sports, and erotic pictures. Using a Bayesian hierarchical approach, we were able to show that vestibular discrimination improved when participants viewed emotionally negative pictures (mutilation, threat, snake) when compared to neutral/positive objects. We conclude that some of the mechanisms involved in the processing of vestibular information are also sensitive to emotional content. Emotional information signals importance and mobilizes the body for action. In case of danger, a successful motor response requires precise vestibular processing. Therefore, negative emotional information improves processing of vestibular information.

Source Memory for Mental Imagery: Influences of the Stimuli’s Ease of Imagery.

The present study investigated how ease of imagery influences source monitoring accuracy. Two experiments were conducted in order to examine how ease of imagery influences the probability of source confusions of perceived and imagined completions of natural symmetric shapes. The stimuli consisted of binary pictures of natural objects, namely symmetric pictures of birds, butterflies, insects, and leaves. The ease of imagery (indicating the similarity of the sources) and the discriminability (indicating the similarity of the items) of each stimulus were estimated in a pretest and included as predictors of the memory performance for these stimuli. It was found that confusion of the sources becomes more likely when the imagery process was relatively easy. However, if the different processes of source monitoring-item memory, source memory and guessing biases-are disentangled, both experiments support the assumption that the effect of decreased source memory for easily imagined stimuli is due to decision processes and misinformation at retrieval rather than encoding processes and memory retention. The data were modeled with a Bayesian hierarchical implementation of the one high threshold source monitoring model.

A Hierarchical Bayesian Model for Measuring Motion Adaptation

Previous research has shown that motion imagery draws on the same neural circuits that are involved in perception of motion, thus leading to a motion aftereffect (Winawer et al., 2010). Imagined stimuli can induce a similar shift in participants’ psychometric functions as neural adaptation due to a perceived stimulus. However, these studies have been criticized on the grounds that they fail to exclude the possibility that the subjects might have guessed the experimental hypothesis, and behaved accordingly (Morgan et al., 2012). In particular, the authors claim that participants can adopt arbitrary response criteria, which results in similar changes of the central tendency μ of psychometric curves as those shown by Winawer et al. (2010).