Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries

BACKGROUND: The synthesis of published research in systematic reviews is essential when providing evidence to inform clinical and health policy decision-making. However, the validity of systematic reviews is threatened if journal publications represent a biased selection of all studies that have been conducted (dissemination bias). To investigate the extent of dissemination bias we conducted a systematic review that determined the proportion of studies published as peer-reviewed journal articles and investigated factors associated with full publication in cohorts of studies (i) approved by research ethics committees (RECs) or (ii) included in trial registries. METHODS AND FINDINGS: Four bibliographic databases were searched for methodological research projects (MRPs) without limitations for publication year, language or study location. The searches were supplemented by handsearching the references of included MRPs. We estimated the proportion of studies published using prediction intervals (PI) and a random effects meta-analysis. Pooled odds ratios (OR) were used to express associations between study characteristics and journal publication. Seventeen MRPs (23 publications) evaluated cohorts of studies approved by RECs; the proportion of published studies had a PI between 22% and 72% and the weighted pooled proportion when combining estimates would be 46.2% (95% CI 40.2%-52.4%, I2 = 94.4%). Twenty-two MRPs (22 publications) evaluated cohorts of studies included in trial registries; the PI of the proportion published ranged from 13% to 90% and the weighted pooled proportion would be 54.2% (95% CI 42.0%-65.9%, I2 = 98.9%). REC-approved studies with statistically significant results (compared with those without statistically significant results) were more likely to be published (pooled OR 2.8; 95% CI 2.2-3.5). Phase-III trials were also more likely to be published than phase II trials (pooled OR 2.0; 95% CI 1.6-2.5). The probability of publication within two years after study completion ranged from 7% to 30%. CONCLUSIONS: A substantial part of the studies approved by RECs or included in trial registries remains unpublished. Due to the large heterogeneity a prediction of the publication probability for a future study is very uncertain. Non-publication of research is not a random process, e.g., it is associated with the direction of study findings. Our findings suggest that the dissemination of research findings is biased.

Retrospective research: What are the ethical and legal requirements?

Retrospective research is conducted on already available data and/or biologic material. Whether such research requires that patients specifically consent to the use of "their" data continues to stir controversy. From a legal and ethical point of view, it depends on several factors. The main criteria to be considered are whether the data or the sample is anonymous, whether the researcher is the one who collected it and whether the patient was told of the possible research use. In Switzerland, several laws delineate the procedure to be followed. The definition of "anonymous" is open to some interpretation. In addition, it is debatable whether consent waivers that are legally admissible for data extend to research involving human biological samples. In a few years, a new Swiss federal law on human research could clarify the regulatory landscape. Meanwhile, hospital-internal guidelines may impose stricter conditions than required by federal or cantonal law. Conversely, Swiss and European ethical texts may suggest greater flexibility and call for a looser interpretation of existing laws. The present article provides an overview of the issues for physicians, scientists, ethics committee members and policy makers involved in retrospective research in Switzerland. It aims at provoking more open discussions of the regulatory problems and possible future legal and ethical solutions.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Prevalence of ragweed allergy in rural Geneva - a pilot study.

OBJECTIVE: The prevalence of ragweed allergy is increasing worldwide. Ragweed distribution and abundance is spreading in Europe in a wide area ranging from the Rhone valley in France to Hungary and Ukraine, where the rate of the prevalence can peak at as high as 12%. Low-grade ragweed colonisation was seen in Geneva and Ticino, less than two decades ago. There were fears that allergies to ragweed would increase Switzerland. The intent of this study was to assess the rate of prevalence of sensitisation and allergy to ragweed in the population living in the first rural Swiss setting where ragweed had been identified in 1996, and to evaluate indirectly the efficacy of elimination and containment strategies. MATERIAL AND METHODS: In 2009, 35 adults in a rural village in the Canton of Geneva were recruited. Data were collected by means of questionnaires and skin-prick tests were done on each participant. The study was approved by the local Ethics Committee. RESULTS: Based on questionnaires, 48.6% had rhinitis (95% confidence interval [CI] 32.9-64.4; n = 17/35) and 17.1% asthma (95% CI 8.1-32.6; n = 6/35). Atopy was diagnosed in 26.4% (95% CI 12.9-44.4) of the sample (n = 9/34). Ragweed sensitisation was found in 2.9% (95% CI 0.7-19.7; n = 1/34), mugwort sensitisation in 2.9% (95% CI 0.1-14.9; n = 1/35), alder sensitisation in 17.1% (95% CI 6.6-33.6; n = 6/35), ash sensitisation in 12.5% (95% CI 3.5-29.0; n = 4/32) and grass sensitisation in 22.9% (95% CI 10.4-40.1; n = 8/35). Ragweed (95% CI 0.1-14.9; n = 1/34) and mugwort allergies (95% CI 0.1-14.9; n = 1/35) were both found in 2.9% of the population. CONCLUSION: This study showed a surprisingly low incidence of ragweed sensitisation and allergy, of 2.9% and 2.9%, respectively, 20 years after the first ragweed detection in Geneva. The feared rise in ragweed allergy seems not to have happened in Switzerland, compared with other ragweed colonised countries. These results strongly support early field strategies against ragweed.