Assessment of publication bias in dental specialty journals

OBJECTIVE: The purpose of this study was to investigate the presence of publication bias (acceptance of articles indicating statistically significant results). METHODS: The journals possessing the highest impact factor (2008 data) in each dental specialty were included in the study. The content of the 6 most recent issues of each journal was hand searched and research articles were classified into 4 type categories: cross-sectional, case-control, cohort, and interventional (nonrandomized clinical trials and randomized controlled trials). In total, 396 articles were included in the analysis. Descriptive statistics and univariate and multivariate logistic regression was used to examine the association between article-reported statistical significance (dependent variable) and journal impact factor and article study type subject area (independent variables). RESULTS: A statistically significant acceptance rate of positive result was found, ranging from 75% to 90%, whereas the value of impact factor was not related to publication bias among leading dental journals. Compared with other research designs, clinical intervention studies (randomized or nonrandomized) presented the highest percentage of nonsignificant findings (20%); RCTs represented 6% of the examined investigations. CONCLUSIONS: Compared with the Journal of Clinical Periodontology, all other subspecialty journals, except the Journal of Oral and Maxillofacial Surgery, showed significantly decreased odds of publishing an RCT, which ranged from 60% to 93% (P < .05).

Reproducibility and day time bias correction of optoelectronic leg volumetry: a prospective cohort study

Background Leg edema is a common manifestation of various underlying pathologies. Reliable measurement tools are required to quantify edema and monitor therapeutic interventions. Aim of the present work was to investigate the reproducibility of optoelectronic leg volumetry over 3 weeks' time period and to eliminate daytime related within-individual variability. Methods Optoelectronic leg volumetry was performed in 63 hairdressers (mean age 45 ± 16 years, 85.7% female) in standing position twice within a minute for each leg and repeated after 3 weeks. Both lower leg (legBD) and whole limb (limbBF) volumetry were analysed. Reproducibility was expressed as analytical and within-individual coefficients of variance (CVA, CVW), and as intra-class correlation coefficients (ICC). Results A total of 492 leg volume measurements were analysed. Both legBD and limbBF volumetry were highly reproducible with CVA of 0.5% and 0.7%, respectively. Within-individual reproducibility of legBD and limbBF volumetry over a three weeks' period was high (CVW 1.3% for both; ICC 0.99 for both). At both visits, the second measurement revealed a significantly higher volume compared to the first measurement with a mean increase of 7.3 ml ± 14.1 (0.33% ± 0.58%) for legBD and 30.1 ml ± 48.5 ml (0.52% ± 0.79%) for limbBF volume. A significant linear correlation between absolute and relative leg volume differences and the difference of exact day time of measurement between the two study visits was found (P < .001). A therefore determined time-correction formula permitted further improvement of CVW. Conclusions Leg volume changes can be reliably assessed by optoelectronic leg volumetry at a single time point and over a 3 weeks' time period. However, volumetry results are biased by orthostatic and daytime-related volume changes. The bias for day-time related volume changes can be minimized by a time-correction formula.

Association between reported exposure to road traffic and respiratory symptoms in children: evidence of bias

BACKGROUND: Many studies showing effects of traffic-related air pollution on health rely on self-reported exposure, which may be inaccurate. We estimated the association between self-reported exposure to road traffic and respiratory symptoms in preschool children, and investigated whether the effect could have been caused by reporting bias. METHODS: In a random sample of 8700 preschool children in Leicestershire, UK, exposure to road traffic and respiratory symptoms were assessed by a postal questionnaire (response rate 80%). The association between traffic exposure and respiratory outcomes was assessed using unconditional logistic regression and conditional regression models (matching by postcode). RESULTS: Prevalence odds ratios (95% confidence intervals) for self-reported road traffic exposure, comparing the categories 'moderate' and 'dense', respectively, with 'little or no' were for current wheezing: 1.26 (1.13-1.42) and 1.30 (1.09-1.55); chronic rhinitis: 1.18 (1.05-1.31) and 1.31 (1.11-1.56); night cough: 1.17 (1.04-1.32) and 1.36 (1.14-1.62); and bronchodilator use: 1.20 (1.04-1.38) and 1.18 (0.95-1.46). Matched analysis only comparing symptomatic and asymptomatic children living at the same postcode (thus exposed to similar road traffic) showed similar ORs, suggesting that parents of children with respiratory symptoms reported more road traffic than parents of asymptomatic children. CONCLUSIONS: Our study suggests that reporting bias could explain some or even all the association between reported exposure to road traffic and disease. Over-reporting of exposure by only 10% of parents of symptomatic children would be sufficient to produce the effect sizes shown in this study. Future research should be based only on objective measurements of traffic exposure.

Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study

OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on collections of meta-analyses. DATA SOURCES: 146 meta-analyses including 1346 trials examining a wide range of interventions and outcomes. MAIN OUTCOME MEASURES: Ratios of odds ratios quantifying the degree of bias associated with inadequate or unclear allocation concealment, and lack of blinding, for trials with different types of intervention and outcome. A ratio of odds ratios <1 implies that inadequately concealed or non-blinded trials exaggerate intervention effect estimates. RESULTS: In trials with subjective outcomes effect estimates were exaggerated when there was inadequate or unclear allocation concealment (ratio of odds ratios 0.69 (95% CI 0.59 to 0.82)) or lack of blinding (0.75 (0.61 to 0.93)). In contrast, there was little evidence of bias in trials with objective outcomes: ratios of odds ratios 0.91 (0.80 to 1.03) for inadequate or unclear allocation concealment and 1.01 (0.92 to 1.10) for lack of blinding. There was little evidence for a difference between trials of drug and non-drug interventions. Except for trials with all cause mortality as the outcome, the magnitude of bias varied between meta-analyses. CONCLUSIONS: The average bias associated with defects in the conduct of randomised trials varies with the type of outcome. Systematic reviewers should routinely assess the risk of bias in the results of trials, and should report meta-analyses restricted to trials at low risk of bias either as the primary analysis or in conjunction with less restrictive analyses.

Systematic review of the empirical evidence of study publication bias and outcome reporting bias

BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias has been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. Until recently, outcome reporting bias has received less attention. METHODOLOGY/PRINCIPAL FINDINGS: We review and summarise the evidence from a series of cohort studies that have assessed study publication bias and outcome reporting bias in randomised controlled trials. Sixteen studies were eligible of which only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Eleven of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: Recent work provides direct empirical evidence for the existence of study publication bias and outcome reporting bias. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.

TH2 cytokines from malignant cells suppress TH1 responses and enforce a global TH2 bias in leukemic cutaneous T-cell lymphoma

PURPOSE In leukemic cutaneous T-cell lymphoma (L-CTCL), malignant T cells accumulate in the blood and give rise to widespread skin inflammation. Patients have intense pruritus, increased immunoglobulin E (IgE), and decreased T-helper (TH)-1 responses, and most die from infection. Depleting malignant T cells while preserving normal immunity is a clinical challenge. L-CTCL has been variably described as a malignancy of regulatory, TH2 and TH17 cells. EXPERIMENTAL DESIGN We analyzed phenotype and cytokine production in malignant and benign L-CTCL T cells, characterized the effects of malignant T cells on healthy T cells, and studied the immunomodulatory effects of treatment modalities in patients with L-CTCL. RESULTS Twelve out of 12 patients with L-CTCL overproduced TH2 cytokines. Remaining benign T cells were also strongly TH2 biased, suggesting a global TH2 skewing of the T-cell repertoire. Culture of benign T cells away from the malignant clone reduced TH2 and enhanced TH1 responses, but separate culture had no effect on malignant T cells. Coculture of healthy T cells with L-CTCL T cells reduced IFNγ production and neutralizing antibodies to interleukin (IL)-4 and IL-13 restored TH1 responses. In patients, enhanced TH1 responses were observed following a variety of treatment modalities that reduced malignant T-cell burden. CONCLUSIONS A global TH2 bias exists in both benign and malignant T cells in L-CTCL and may underlie the infectious susceptibility of patients. TH2 cytokines from malignant cells strongly inhibited TH1 responses. Our results suggest that therapies that inhibit TH2 cytokine activity, by virtue of their ability to improve TH1 responses, may have the potential to enhance both anticancer and antipathogen responses.

Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study

BACKGROUND Empirical research has illustrated an association between study size and relative treatment effects, but conclusions have been inconsistent about the association of study size with the risk of bias items. Small studies give generally imprecisely estimated treatment effects, and study variance can serve as a surrogate for study size. METHODS We conducted a network meta-epidemiological study analyzing 32 networks including 613 randomized controlled trials, and used Bayesian network meta-analysis and meta-regression models to evaluate the impact of trial characteristics and study variance on the results of network meta-analysis. We examined changes in relative effects and between-studies variation in network meta-regression models as a function of the variance of the observed effect size and indicators for the adequacy of each risk of bias item. Adjustment was performed both within and across networks, allowing for between-networks variability. RESULTS Imprecise studies with large variances tended to exaggerate the effects of the active or new intervention in the majority of networks, with a ratio of odds ratios of 1.83 (95% CI: 1.09,3.32). Inappropriate or unclear conduct of random sequence generation and allocation concealment, as well as lack of blinding of patients and outcome assessors, did not materially impact on the summary results. Imprecise studies also appeared to be more prone to inadequate conduct. CONCLUSIONS Compared to more precise studies, studies with large variance may give substantially different answers that alter the results of network meta-analyses for dichotomous outcomes.

Poor Reliability between Cochrane Reviewers and Blinded External Reviewers When Applying the Cochrane Risk of Bias Tool in Physical Therapy Trials

OBJECTIVES To test the inter-rater reliability of the RoB tool applied to Physical Therapy (PT) trials by comparing ratings from Cochrane review authors with those of blinded external reviewers. METHODS Randomized controlled trials (RCTs) in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analysis of PT interventions. RoB assessments were conducted independently by 2 reviewers blinded to the RoB ratings reported in the Cochrane reviews. Data on RoB assessments from Cochrane reviews and other characteristics of reviews and trials were extracted. Consensus assessments between the two reviewers were then compared with the RoB ratings from the Cochrane reviews. Agreement between Cochrane and blinded external reviewers was assessed using weighted kappa (κ). RESULTS In total, 109 trials included in 17 Cochrane reviews were assessed. Inter-rater reliability on the overall RoB assessment between Cochrane review authors and blinded external reviewers was poor (κ  =  0.02, 95%CI: -0.06, 0.06]). Inter-rater reliability on individual domains of the RoB tool was poor (median κ  = 0.19), ranging from κ  =  -0.04 ("Other bias") to κ  =  0.62 ("Sequence generation"). There was also no agreement (κ  =  -0.29, 95%CI: -0.81, 0.35]) in the overall RoB assessment at the meta-analysis level. CONCLUSIONS Risk of bias assessments of RCTs using the RoB tool are not consistent across different research groups. Poor agreement was not only demonstrated at the trial level but also at the meta-analysis level. Results have implications for decision making since different recommendations can be reached depending on the group analyzing the evidence. Improved guidelines to consistently apply the RoB tool and revisions to the tool for different health areas are needed.

'Alternate-goal bias' in antisaccades and the influence of expectation

Saccadic performance depends on the requirements of the current trial, but also may be influenced by other trials in the same experiment. This effect of trial context has been investigated most for saccadic error rate and reaction time but seldom for the positional accuracy of saccadic landing points. We investigated whether the direction of saccades towards one goal is affected by the location of a second goal used in other trials in the same experimental block. In our first experiment, landing points ('endpoints') of antisaccades but not prosaccades were shifted towards the location of the alternate goal. This spatial bias decreased with increasing angular separation between the current and alternative goals. In a second experiment, we explored whether expectancy about the goal location was responsible for the biasing of the saccadic endpoint. For this, we used a condition where the saccadic goal randomly changed from one trial to the next between locations on, above or below the horizontal meridian. We modulated the prior probability of the alternate-goal location by showing cues prior to stimulus onset. The results showed that expectation about the possible positions of the saccadic goal is sufficient to bias saccadic endpoints and can account for at least part of this phenomenon of 'alternate-goal bias'.

Avoidance and inhibition do not predict nonrespondent bias among patients with inflammatory bowel disease

It has been suggested that participant withdrawal from studies can bias estimates. However, this is only possible when withdrawers and nonwithdrawers differ in an important way. We tested the hypothesis that withdrawers are more likely than nonwithdrawers to be avoidant and negatively affected.

Vertical bias in neglect: A question of time?

Neglect is defined as the failure to attend and to orient to the contralesional side of space. A horizontal bias towards the right visual field is a classical finding in patients who suffered from a right-hemispheric stroke. The vertical dimension of spatial attention orienting has only sparsely been investigated so far. The aim of this study was to investigate the specificity of this vertical bias by means of a search task, which taps a more pronounced top-down attentional component. Eye movements and behavioural search performance were measured in thirteen patients with left-sided neglect after right hemispheric stroke and in thirteen age-matched controls. Concerning behavioural performance, patients found significantly less targets than healthy controls in both the upper and lower left quadrant. However, when targets were located in the lower left quadrant, patients needed more visual fixations (and therefore longer search time) to find them, suggesting a time-dependent vertical bias.

Methodology and models in erosion research: discussion and conclusions

This paper summarises the discussions which took place at the Workshop on Methodology in Erosion Research in Zürich, 2010, and aims, where possible, to offer guidance for the development and application of both in vitro and in situ models for erosion research. The prospects for clinical trials are also discussed. All models in erosion research require a number of choices regarding experimental conditions, study design and measurement techniques, and these general aspects are discussed first. Among in vitro models, simple (single- or multiple-exposure) models can be used for screening products regarding their erosive potential, while more elaborate pH cycling models can be used to simulate erosion in vivo. However, in vitro models provide limited information on intra-oral erosion. In situ models allow the effect of an erosive challenge to be evaluated under intra-oral conditions and are currently the method of choice for short-term testing of low-erosive products or preventive therapeutic products. In the future, clinical trials will allow longer-term testing. Possible methodologies for such trials are discussed.