Systematic review of the empirical evidence of study publication bias and outcome reporting bias

BACKGROUND: The increased use of meta-analysis in systematic reviews of healthcare interventions has highlighted several types of bias that can arise during the completion of a randomised controlled trial. Study publication bias has been recognised as a potential threat to the validity of meta-analysis and can make the readily available evidence unreliable for decision making. Until recently, outcome reporting bias has received less attention. METHODOLOGY/PRINCIPAL FINDINGS: We review and summarise the evidence from a series of cohort studies that have assessed study publication bias and outcome reporting bias in randomised controlled trials. Sixteen studies were eligible of which only two followed the cohort all the way through from protocol approval to information regarding publication of outcomes. Eleven of the studies investigated study publication bias and five investigated outcome reporting bias. Three studies have found that statistically significant outcomes had a higher odds of being fully reported compared to non-significant outcomes (range of odds ratios: 2.2 to 4.7). In comparing trial publications to protocols, we found that 40-62% of studies had at least one primary outcome that was changed, introduced, or omitted. We decided not to undertake meta-analysis due to the differences between studies. CONCLUSIONS: Recent work provides direct empirical evidence for the existence of study publication bias and outcome reporting bias. There is strong evidence of an association between significant results and publication; studies that report positive or significant results are more likely to be published and outcomes that are statistically significant have higher odds of being fully reported. Publications have been found to be inconsistent with their protocols. Researchers need to be aware of the problems of both types of bias and efforts should be concentrated on improving the reporting of trials.

Bringing results to fruition through publication: An analysis of a peer-reviewed, open access and context-focused journal's editorial practice

When it comes to helping to shape sustainable development, research is most useful when it bridges the science–implementation/management gap and when it brings development specialists and researchers into a dialogue (Hurni et al. 2004); can a peer-reviewed journal contribute to this aim? In the classical system for validation and dissemination of scientific knowledge, journals focus on knowledge exchange within the academic community and do not specifically address a ‘life-world audience’. Within a North-South context, another knowledge divide is added: the peer review process excludes a large proportion of scientists from the South from participating in the production of scientific knowledge (Karlsson et al. 2007). Mountain Research and Development (MRD) is a journal whose mission is based on an editorial strategy to build the bridge between research and development and ensure that authors from the global South have access to knowledge production, ultimately with a view to supporting sustainable development in mountains. In doing so, MRD faces a number of challenges that we would like to discuss with the td-net community, after having presented our experience and strategy as editors of this journal. MRD was launched in 1981 by mountain researchers who wanted mountains to be included in the 1992 Rio process. In the late 1990s, MRD realized that the journal needed to go beyond addressing only the scientific community. It therefore launched a new section addressing a broader audience in 2000, with the aim of disseminating insights into, and recommendations for, the implementation of sustainable development in mountains. In 2006, we conducted a survey among MRD’s authors, reviewers, and readers (Wymann et al. 2007): respondents confirmed that MRD had succeeded in bridging the gap between research and development. But we realized that MRD could become an even more efficient tool for sustainability if development knowledge were validated: in 2009, we began submitting ‘development’ papers (‘transformation knowledge’) to external peer review of a kind different from the scientific-only peer review (for ‘systems knowledge’). At the same time, the journal became open access in order to increase the permeability between science and society, and ensure greater access for readers and authors in the South. We are currently rethinking our review process for development papers, with a view to creating more space for communication between science and society, and enhancing the co-production of knowledge (Roux 2008). Hopefully, these efforts will also contribute to the urgent debate on the ‘publication culture’ needed in transdisciplinary research (Kueffer et al. 2007).

Peer Review Processes for Transdisciplinary Articles: A Reflection on Journal's Practices

Publishing is an essential means of validation and communication of research. This is no different in transdisciplinary research, where publishing also aims at contributing to the development of society through sharing of knowledge. In the scientific world, authors need to disseminate and validate results, reflect on issues, and participate in debates. On the other hand, institutions and individuals are assessed according to their publication record – as probably the most influential of all current evaluation criteria. Occupying the space between article production and counting impact factors, journal editors and reviewers play an important role in defining and using rules to assess and improve the work submitted to them. Publishing transdisciplinary research poses specific challenges, in particular with regard to peer-review processes, as it addresses different knowledge communities with different value systems and purposes.

Impact factor statistics and publication practice: What can we learn? (Editorial)

Peer review procedures and citation statistics are important yet often neglected components of the scientific publication process. Here I discuss fundamental consequences of such quality measures for the scientific community and propose three remedial actions: (1) use of a ''Combined Impact Estimate'' as a measure of citation statistics, (2) adoption of an open reviewing policy and (3) acceleration of the publication process in order to raise the reputation of the entire discipline (in our case: behavioural science). Authors, reviewers and editors are invited to contribute to the improvement of publication practice.

The effect of periodontal therapy on the survival rate and incidence of complications of multirooted teeth with furcation involvement after an observation period of at least 5 years: a systematic review

OBJECTIVE: To systematically review the survival rate and incidence of complications of furcation-involved multirooted teeth following periodontal therapy after at least 5 years. MATERIAL AND METHODS: Electronic and manual searches were performed up to and including January 2008. Publication selection, data extraction and validity assessment were performed independently by three reviewers. RESULTS: Twenty-two publications met the inclusion criteria. Because of the heterogeneity of the data, a meta-analysis could not be performed. The survival rate of molars treated non-surgically was >90% after 5-9 years. The corresponding values for the different surgical procedures were: Surgical therapy: 43.1% to 96%, observation period: 5-53 years. Tunnelling procedures: 42.9% to 92.9%, observation period: 5-8 years. Surgical resective procedures including amputation(s) and hemisections: 62% to 100%, observation period: 5-13 years. Guided tissue regeneration (GTR): 83.3% to 100%, observation period: 5-12 years. The most frequent complications included caries in the furcation area after tunnelling procedures and root fractures after root-resective procedures. CONCLUSIONS: Good long-term survival rates (up to 100%) of multirooted teeth with furcation involvement were obtained following various therapeutic approaches. Initial furcation involvement (Degree I) could be successfully managed by non-surgical mechanical debridement. Vertical root fractures and endodontic failures were the most frequent complications observed following resective procedures.

In vivo bisphenol-a release from dental pit and fissure sealants: a systematic review

OBJECTIVE To search the literature and assess the short- and long-term release of bisphenol-A (BPA) in human tissues after treatment with dental sealants. DATA Two review authors performed data extraction independently and in duplicate using data collection forms. Disagreements were resolved by discussion with an arbiter. SOURCES Electronic database searches of published and unpublished literature were performed. The following electronic databases with no language and publication date restrictions were searched: MEDLINE (via Ovid and Pubmed), EMBASE (via ovid), Cochrane Trials Register and CENTRAL. The reference lists of all eligible studies were hand-searched. STUDY SELECTION In the absence of RCTs, six interventional and two observational studies, examining in vivo BPA release in human salivary, blood and urinary samples, were included. Due to the heterogeneity in methodology and reporting, the main synthesis of the results was qualitative. The quantitative synthesis based on the weighted Z-test could only include two studies. BPA levels identified in saliva ranged from traces below the method's detection limit to 30 μg/ml. In urine, BPA quantities spanned from 0.17 mg/g to 45.4 mg/g. BPA was not traced in any blood sample at any point of time in the relevant studies. The quantitative analysis showed evidence of BPA release one hour after sealant placement compared to the amount traced before restoration (Stouffer's z trend: <0.001). CONCLUSIONS The available evidence on this topic derived from studies that represent a moderate level of evidence. Nevertheless, the available evidence supports that BPA is released in saliva after sealant placement. CLINICAL SIGNIFICANCE From the qualititative and quantitative synthesis of studies, it is reasonable to conclude that BPA is released after placement of some dental pit and fissure sealants in the oral cavity. The biggest quantities are detected in saliva immediately after or one hour after their placement.

Bisphenol-A and residual monomer leaching from orthodontic adhesive resins and polycarbonate brackets: a systematic review

INTRODUCTION The objective of this systematic review was to assess the short- and long-term release of components of orthodontic adhesives and polycarbonate brackets in the oral environment. METHODS Electronic database searches of published and unpublished literature were performed. The following electronic databases with no language and publication date restrictions were searched: MEDLINE (via Ovid and PubMed), EMBASE (via Ovid), Cochrane Oral Health Group's Trials Register, and CENTRAL. Unpublished literature was searched on ClinicalTrials.gov, the National Research Register, and Pro-Quest Dissertation Abstracts and Thesis database. The reference lists of all eligible studies were checked for additional studies. Two review authors performed data extraction independently and in duplicate using data collection forms. Disagreements were resolved by discussion or the involvement of an arbiter. RESULTS No randomized controlled trial was identified. In the absence of randomized controlled trials, observational studies were included. Eleven studies met the inclusion criteria. All were observational studies conducted in vivo or in vitro. The bisphenol-A release from orthodontic bonding resins was found to be between 0.85 and 20.88 ng per milliliter in vivo, and from traces to 65.67 ppm in vitro. Polycarbonate brackets released amounts of 22.24 μg per gram in ethanol solution and 697 μg per gram after 40 months in water. Bis-GMA and TEGDMA leaching in vitro reached levels of 64 and 174 mg per 10 μL, respectively. Because of the heterogeneity in methodologies and reporting, only qualitative synthesis was performed. CONCLUSIONS The available evidence on this topic derived from observational in-vivo and in-vitro studies that represent a moderate level of evidence. The variety of setups and the different units allied to the diversity of reporting among studies did not allow calculation of pooled estimates.

Initiation and continuation of randomized trials after the publication of a trial stopped early for benefit asking the same study question: STOPIT-3 study design

BACKGROUND Randomized control trials (RCTs) stopped early for benefit (truncated RCTs) are increasingly common and, on average, overestimate the relative magnitude of benefit by approximately 30%. Investigators stop trials early when they consider it is no longer ethical to enroll patients in a control group. The goal of this systematic review is to determine how investigators of ongoing or planned RCTs respond to the publication of a truncated RCT addressing a similar question. METHODS/DESIGN We will conduct systematic reviews to update the searches of 210 truncated RCTs to identify similar trials ongoing at the time of publication, or started subsequently, to the truncated trials ('subsequent RCTs'). Reviewers will determine in duplicate the similarity between the truncated and subsequent trials. We will analyze the epidemiology, distribution, and predictors of subsequent RCTs. We will also contact authors of subsequent trials to determine reasons for beginning, continuing, or prematurely discontinuing their own trials, and the extent to which they rely on the estimates from truncated trials. DISCUSSION To the extent that investigators begin or continue subsequent trials they implicitly disagree with the decision to stop the truncated RCT because of an ethical mandate to administer the experimental treatment. The results of this study will help guide future decisions about when to stop RCTs early for benefit.

Effects of erythropoiesis-stimulating agents on fatigue- and anaemia-related symptoms in cancer patients: systematic review and meta-analyses of published and unpublished data.

Background:Erythropoiesis-stimulating agents (ESAs) reduce the need for red blood cell transfusions; however, they increase the risk of thromboembolic events and mortality. The impact of ESAs on quality of life (QoL) is controversial and led to different recommendations of medical societies and authorities in the USA and Europe. We aimed to critically evaluate and quantify the effects of ESAs on QoL in cancer patients.Methods:We included data from randomised controlled trials (RCTs) on the effects of ESAs on QoL in cancer patients. Randomised controlled trials were identified by searching electronic data bases and other sources up to January 2011. To reduce publication and outcome reporting biases, we included unreported results from clinical study reports. We conducted meta-analyses on fatigue- and anaemia-related symptoms measured with the Functional Assessment of Cancer Therapy-Fatigue (FACT-F) and FACT-Anaemia (FACT-An) subscales (primary outcomes) or other validated instruments.Results:We identified 58 eligible RCTs. Clinical study reports were available for 27% (4 out of 15) of the investigator-initiated trials and 95% (41 out of 43) of the industry-initiated trials. We excluded 21 RTCs as we could not use their QoL data for meta-analyses, either because of incomplete reporting (17 RCTs) or because of premature closure of the trial (4 RCTs). We included 37 RCTs with 10 581 patients; 21 RCTs were placebo controlled. Chemotherapy was given in 27 of the 37 RCTs. The median baseline haemoglobin (Hb) level was 10.1 g dl(-1); in 8 studies ESAs were stopped at Hb levels below 13 g dl(-1) and in 27 above 13 g dl(-1). For FACT-F, the mean difference (MD) was 2.41 (95% confidence interval (95% CI) 1.39-3.43; P<0.0001; 23 studies, n=6108) in all cancer patients and 2.81 (95% CI 1.73-3.90; P<0.0001; 19 RCTs, n=4697) in patients receiving chemotherapy, which was below the threshold (⩾3) for a clinically important difference (CID). Erythropoiesis-stimulating agents had a positive effect on anaemia-related symptoms (MD 4.09; 95% CI 2.37-5.80; P=0.001; 14 studies, n=2765) in all cancer patients and 4.50 (95% CI 2.55-6.45; P<0.0001; 11 RCTs, n=2436) in patients receiving chemotherapy, which was above the threshold (⩾4) for a CID. Of note, this effect persisted when we restricted the analysis to placebo-controlled RCTs in patients receiving chemotherapy. There was some evidence that the MDs for FACT-F were above the threshold for a CID in RCTs including cancer patients receiving chemotherapy with Hb levels below 12 g dl(-1) at baseline and in RCTs stopping ESAs at Hb levels above 13 g dl(-1). However, these findings for FACT-F were not confirmed when we restricted the analysis to placebo-controlled RCTs in patients receiving chemotherapy.Conclusions:In cancer patients, particularly those receiving chemotherapy, we found that ESAs provide a small but clinically important improvement in anaemia-related symptoms (FACT-An). For fatigue-related symptoms (FACT-F), the overall effect did not reach the threshold for a CID.British Journal of Cancer advance online publication, 17 April 2014; doi:10.1038/bjc.2014.171 www.bjcancer.com.

A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology

This year marks the 20th anniversary of functional near-infrared spectroscopy and imaging (fNIRS/fNIRI). As the vast majority of commercial instruments developed until now are based on continuous wave technology, the aim of this publication is to review the current state of instrumentation and methodology of continuous wave fNIRI. For this purpose we provide an overview of the commercially available instruments and address instrumental aspects such as light sources, detectors and sensor arrangements. Methodological aspects, algorithms to calculate the concentrations of oxy- and deoxyhemoglobin and approaches for data analysis are also reviewed. From the single-location measurements of the early years, instrumentation has progressed to imaging initially in two dimensions (topography) and then three (tomography). The methods of analysis have also changed tremendously, from the simple modified Beer-Lambert law to sophisticated image reconstruction and data analysis methods used today. Due to these advances, fNIRI has become a modality that is widely used in neuroscience research and several manufacturers provide commercial instrumentation. It seems likely that fNIRI will become a clinical tool in the foreseeable future, which will enable diagnosis in single subjects.

Summary of the recommendations of the EFNS/MDS-ES review on therapeutic management of Parkinson's disease.

OBJECTIVE To summarize the 2010 EFNS/MDS-ES evidence-based treatment recommendations for the management of Parkinson's disease (PD). This summary includes the treatment recommendations for early and late PD. METHODS For the 2010 publication, a literature search was undertaken for articles published up to September 2009. For this summary, an additional literature search was undertaken up to December 2010. Classification of scientific evidence and the rating of recommendations were made according to the EFNS guidance. In cases where there was insufficient scientific evidence, a consensus statement ('good practice point') is made. RESULTS AND CONCLUSIONS For each clinical indication, a list of therapeutic interventions is provided, including classification of evidence.

Cone beam computed tomography in implant dentistry: a systematic review focusing on guidelines, indications, and radiation dose risks.

PURPOSE The aim of the paper is to identify, review, analyze, and summarize available evidence in three areas on the use of cross-sectional imaging, specifically maxillofacial cone beam computed tomography (CBCT) in pre- and postoperative dental implant therapy: (1) Available clinical use guidelines, (2) indications and contraindications for use, and (3) assessment of associated radiation dose risk. MATERIALS AND METHODS Three focused questions were developed to address the aims. A systematic literature review was performed using a PICO-based search strategy based on MeSH key words specific to each focused question of English-language publications indexed in the MEDLINE database retrospectively from October 31, 2012. These results were supplemented by a hand search and gray literature search. RESULTS Twelve publications were identified providing guidelines for the use of cross-sectional radiography, particularly CBCT imaging, for the pre- and/or postoperative assessment of potential dental implant sites. The publications discovered by the PICO strategy (43 articles), hand (12), and gray literature searches (1) for the second focus question regarding indications and contraindications for CBCT use in implant dentistry were either cohort or case-controlled studies. For the third question on the assessment of associated radiation dose risk, a total of 22 articles were included. Publication characteristics and themes were summarized in tabular format. CONCLUSIONS The reported indications for CBCT use in implant dentistry vary from preoperative analysis regarding specific anatomic considerations, site development using grafts, and computer-assisted treatment planning to postoperative evaluation focusing on complications due to damage of neurovascular structures. Effective doses for different CBCT devices exhibit a wide range with the lowest dose being almost 100 times less than the highest dose. Significant dose reduction can be achieved by adjusting operating parameters, including exposure factors and reducing the field of view (FOV) to the actual region of interest.

A systematic review and meta-analysis of factors associated with anthelmintic resistance in sheep.

BACKGROUND Anthelmintic drugs have been widely used in sheep as a cost-effective means for gastro-intestinal nematode (GIN) control. However, growing anthelmintic resistance (AHR) has created a compelling need to identify evidence-based management recommendations that reduce the risk of further development and impact of AHR. OBJECTIVE To identify, critically assess, and synthesize available data from primary research on factors associated with AHR in sheep. METHODS Publications reporting original observational or experimental research on selected factors associated with AHR in sheep GINs and published after 1974, were identified through two processes. Three electronic databases (PubMed, Agricola, CAB) and Web of Science (a collection of databases) were searched for potentially relevant publications. Additional publications were identified through consultation with experts, manual search of references of included publications and conference proceedings, and information solicited from small ruminant practitioner list-serves. Two independent investigators screened abstracts for relevance. Relevant publications were assessed for risk of systematic bias. Where sufficient data were available, random-effects Meta-Analyses (MAs) were performed to estimate the pooled Odds Ratio (OR) and 95% Confidence Intervals (CIs) of AHR for factors reported in ≥2 publications. RESULTS Of the 1712 abstracts screened for eligibility, 131 were deemed relevant for full publication review. Thirty publications describing 25 individual studies (15 observational studies, 7 challenge trials, and 3 controlled trials) were included in the qualitative synthesis and assessed for systematic bias. Unclear (i.e. not reported, or unable to assess) or high risk of selection bias and confounding bias was found in 93% (14/15) and 60% (9/15) of the observational studies, respectively, while unclear risk of selection bias was identified in all of the trials. Ten independent studies were included in the quantitative synthesis, and MAs were performed for five factors. Only high frequency of treatment was a significant risk factor (OR=4.39; 95% CI=1.59, 12.14), while the remaining 4 variables were marginally significant: mixed-species grazing (OR=1.63; 95% CI=0.66, 4.07); flock size (OR=1.02; 95% CI=0.97, 1.07); use of long-acting drug formulations (OR=2.85; 95% CI=0.79, 10.24); and drench-and-shift pasture management (OR=4.08; 95% CI=0.75, 22.16). CONCLUSIONS While there is abundant literature on the topic of AHR in sheep GINs, few studies have explicitly investigated the association between putative risk or protective factors and AHR. Consequently, several of the current recommendations on parasite management are not evidence-based. Moreover, many of the studies included in this review had a high or unclear risk of systematic bias, highlighting the need to improve study design and/or reporting of future research carried out in this field.

„Extra locos sepulturae“ – Review about finds of newborns inside Roman settlements in present-day Switzerland

Finds of remains of newborns inside Roman settlements are a widespread phenomenon in the Imperium Romanum, including presentday Switzerland. Since the publication of the last review article (Berger 1993) numerous new finds have been made. Therefore it seems important to summarize archaeological and anthropological parameters again, and to re-assess them collectively. During a literature review a total of 262 cases were collected. Similarities as well as differences in the funerary practices become evident. A combination of inhumation, single deposit/grave, and absence of grave goods is the least common denominator in the funerary treatment of individuals who died around the time of birth. However, methods of classical physical anthropology are limited. Histological and biochemical methods are promising and may allow further statements in the future, e.g. with regard to the differentiation between live and still births. In order to evaluate possible correlations between archaeological and anthropological parameters, findings from settlements and cemeteries that are documented in situ as well as a sustainable theoretical framework are required.