Multivariable adjustments counteract spectrum and test review bias in accuracy studies

OBJECTIVES: The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solutions to two major threats to validity: spectrum bias and test review bias. STUDY DESIGN AND SETTING: Using a clinical example, we demonstrate that these solutions fail and propose an alternative solution that concomitantly addresses both sources of bias. We also derive formulas that prove the generality of our arguments. RESULTS: A logical extension of our ideas is to extend STARD item 23 by adding a requirement for multivariable statistical adjustment using information collected in QUADAS items 1, 2, and 12 and STARD items 3-5, 11, 15, and 18. CONCLUSION: We recommend reporting not only variation of diagnostic accuracy across subgroups (STARD item 23) but also the effects of the multivariable adjustments on test performance. We also suggest that the QUADAS be supplemented by an item addressing the appropriateness of statistical methods, in particular whether multivariable adjustments have been included in the analysis.

A multi-center study: Intra-scan and inter-scan variability of diffusion spectrum imaging

The objective of this study was to investigate whether it is possible to pool together diffusion spectrum imaging data from four different scanners, located at three different sites. Two of the scanners had identical configuration whereas two did not. To measure the variability, we extracted three scalar maps (ADC, FA and GFA) from the DSI and utilized a region and a tract-based analysis. Additionally, a phantom study was performed to rule out some potential factors arising from the scanner performance in case some systematic bias occurred in the subject study. This work was split into three experiments: intra-scanner reproducibility, reproducibility with twin-scanner settings and reproducibility with other configurations. Overall for the intra-scanner and twin-scanner experiments, the region-based analysis coefficient of variation (CV) was in a range of 1%-4.2% and below 3% for almost every bundle for the tract-based analysis. The uncinate fasciculus showed the worst reproducibility, especially for FA and GFA values (CV 3.7-6%). For the GFA and FA maps, an ICC value of 0.7 and above is observed in almost all the regions/tracts. Looking at the last experiment, it was found that there is a very high similarity of the outcomes from the two scanners with identical setting. However, this was not the case for the two other imagers. Given the fact that the overall variation in our study is low for the imagers with identical settings, our findings support the feasibility of cross-site pooling of DSI data from identical scanners.

Climate spectrum estimation in the presence of timescale errors

We introduce an algorithm (called REDFITmc2) for spectrum estimation in the presence of timescale errors. It is based on the Lomb-Scargle periodogram for unevenly spaced time series, in combination with the Welch's Overlapped Segment Averaging procedure, bootstrap bias correction and persistence estimation. The timescale errors are modelled parametrically and included in the simulations for determining (1) the upper levels of the spectrum of the red-noise AR(1) alternative and (2) the uncertainty of the frequency of a spectral peak. Application of REDFITmc2 to ice core and stalagmite records of palaeoclimate allowed a more realistic evaluation of spectral peaks than when ignoring this source of uncertainty. The results support qualitatively the intuition that stronger effects on the spectrum estimate (decreased detectability and increased frequency uncertainty) occur for higher frequencies. The surplus information brought by algorithm REDFITmc2 is that those effects are quantified. Regarding timescale construction, not only the fixpoints, dating errors and the functional form of the age-depth model play a role. Also the joint distribution of all time points (serial correlation, stratigraphic order) determines spectrum estimation.

'Alternate-goal bias' in antisaccades and the influence of expectation

Saccadic performance depends on the requirements of the current trial, but also may be influenced by other trials in the same experiment. This effect of trial context has been investigated most for saccadic error rate and reaction time but seldom for the positional accuracy of saccadic landing points. We investigated whether the direction of saccades towards one goal is affected by the location of a second goal used in other trials in the same experimental block. In our first experiment, landing points ('endpoints') of antisaccades but not prosaccades were shifted towards the location of the alternate goal. This spatial bias decreased with increasing angular separation between the current and alternative goals. In a second experiment, we explored whether expectancy about the goal location was responsible for the biasing of the saccadic endpoint. For this, we used a condition where the saccadic goal randomly changed from one trial to the next between locations on, above or below the horizontal meridian. We modulated the prior probability of the alternate-goal location by showing cues prior to stimulus onset. The results showed that expectation about the possible positions of the saccadic goal is sufficient to bias saccadic endpoints and can account for at least part of this phenomenon of 'alternate-goal bias'.

Assessment of publication bias in dental specialty journals

OBJECTIVE: The purpose of this study was to investigate the presence of publication bias (acceptance of articles indicating statistically significant results). METHODS: The journals possessing the highest impact factor (2008 data) in each dental specialty were included in the study. The content of the 6 most recent issues of each journal was hand searched and research articles were classified into 4 type categories: cross-sectional, case-control, cohort, and interventional (nonrandomized clinical trials and randomized controlled trials). In total, 396 articles were included in the analysis. Descriptive statistics and univariate and multivariate logistic regression was used to examine the association between article-reported statistical significance (dependent variable) and journal impact factor and article study type subject area (independent variables). RESULTS: A statistically significant acceptance rate of positive result was found, ranging from 75% to 90%, whereas the value of impact factor was not related to publication bias among leading dental journals. Compared with other research designs, clinical intervention studies (randomized or nonrandomized) presented the highest percentage of nonsignificant findings (20%); RCTs represented 6% of the examined investigations. CONCLUSIONS: Compared with the Journal of Clinical Periodontology, all other subspecialty journals, except the Journal of Oral and Maxillofacial Surgery, showed significantly decreased odds of publishing an RCT, which ranged from 60% to 93% (P < .05).

Avoidance and inhibition do not predict nonrespondent bias among patients with inflammatory bowel disease

It has been suggested that participant withdrawal from studies can bias estimates. However, this is only possible when withdrawers and nonwithdrawers differ in an important way. We tested the hypothesis that withdrawers are more likely than nonwithdrawers to be avoidant and negatively affected.

Desmosomal gene analysis in arrhythmogenic right ventricular dysplasia/cardiomyopathy: spectrum of mutations and clinical impact in practice

Five desmosomal genes have been recently implicated in arrhythmogenic right ventricular dysplasia/cardiomyopathy (ARVD/C) but the clinical impact of genetics remains poorly understood. We wanted to address the potential impact of genotyping.

Assertive community treatment as part of integrated care versus standard care: a 12-month trial in patients with first- and multiple-episode schizophrenia spectrum disorders treated with quetiapine immediate release (ACCESS trial)

The ACCESS trial examined the 12-month effectiveness of continuous therapeutic assertive community treatment (ACT) as part of integrated care compared to standard care in a catchment area comparison design in patients with schizophrenia spectrum disorders treated with quetiapine immediate release.

Fertility preservation in >1,000 patients: patient's characteristics, spectrum, efficacy and risks of applied preservation techniques

Data on the characteristics of female patients counselled for fertility preservation and the efficacy and risk of the applied procedures are still poor. We therefore analysed the registry of a network of 70 infertility centers which are involved in fertility preservation in Germany, Switzerland and Austria, called FertiPROTEKT ( hhtp://www.fertiprotekt.eu ).

Vertical bias in neglect: A question of time?

Neglect is defined as the failure to attend and to orient to the contralesional side of space. A horizontal bias towards the right visual field is a classical finding in patients who suffered from a right-hemispheric stroke. The vertical dimension of spatial attention orienting has only sparsely been investigated so far. The aim of this study was to investigate the specificity of this vertical bias by means of a search task, which taps a more pronounced top-down attentional component. Eye movements and behavioural search performance were measured in thirteen patients with left-sided neglect after right hemispheric stroke and in thirteen age-matched controls. Concerning behavioural performance, patients found significantly less targets than healthy controls in both the upper and lower left quadrant. However, when targets were located in the lower left quadrant, patients needed more visual fixations (and therefore longer search time) to find them, suggesting a time-dependent vertical bias.

Reproducibility and day time bias correction of optoelectronic leg volumetry: a prospective cohort study

Background Leg edema is a common manifestation of various underlying pathologies. Reliable measurement tools are required to quantify edema and monitor therapeutic interventions. Aim of the present work was to investigate the reproducibility of optoelectronic leg volumetry over 3 weeks' time period and to eliminate daytime related within-individual variability. Methods Optoelectronic leg volumetry was performed in 63 hairdressers (mean age 45 ± 16 years, 85.7% female) in standing position twice within a minute for each leg and repeated after 3 weeks. Both lower leg (legBD) and whole limb (limbBF) volumetry were analysed. Reproducibility was expressed as analytical and within-individual coefficients of variance (CVA, CVW), and as intra-class correlation coefficients (ICC). Results A total of 492 leg volume measurements were analysed. Both legBD and limbBF volumetry were highly reproducible with CVA of 0.5% and 0.7%, respectively. Within-individual reproducibility of legBD and limbBF volumetry over a three weeks' period was high (CVW 1.3% for both; ICC 0.99 for both). At both visits, the second measurement revealed a significantly higher volume compared to the first measurement with a mean increase of 7.3 ml ± 14.1 (0.33% ± 0.58%) for legBD and 30.1 ml ± 48.5 ml (0.52% ± 0.79%) for limbBF volume. A significant linear correlation between absolute and relative leg volume differences and the difference of exact day time of measurement between the two study visits was found (P < .001). A therefore determined time-correction formula permitted further improvement of CVW. Conclusions Leg volume changes can be reliably assessed by optoelectronic leg volumetry at a single time point and over a 3 weeks' time period. However, volumetry results are biased by orthostatic and daytime-related volume changes. The bias for day-time related volume changes can be minimized by a time-correction formula.