Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries

BACKGROUND: The synthesis of published research in systematic reviews is essential when providing evidence to inform clinical and health policy decision-making. However, the validity of systematic reviews is threatened if journal publications represent a biased selection of all studies that have been conducted (dissemination bias). To investigate the extent of dissemination bias we conducted a systematic review that determined the proportion of studies published as peer-reviewed journal articles and investigated factors associated with full publication in cohorts of studies (i) approved by research ethics committees (RECs) or (ii) included in trial registries. METHODS AND FINDINGS: Four bibliographic databases were searched for methodological research projects (MRPs) without limitations for publication year, language or study location. The searches were supplemented by handsearching the references of included MRPs. We estimated the proportion of studies published using prediction intervals (PI) and a random effects meta-analysis. Pooled odds ratios (OR) were used to express associations between study characteristics and journal publication. Seventeen MRPs (23 publications) evaluated cohorts of studies approved by RECs; the proportion of published studies had a PI between 22% and 72% and the weighted pooled proportion when combining estimates would be 46.2% (95% CI 40.2%-52.4%, I2 = 94.4%). Twenty-two MRPs (22 publications) evaluated cohorts of studies included in trial registries; the PI of the proportion published ranged from 13% to 90% and the weighted pooled proportion would be 54.2% (95% CI 42.0%-65.9%, I2 = 98.9%). REC-approved studies with statistically significant results (compared with those without statistically significant results) were more likely to be published (pooled OR 2.8; 95% CI 2.2-3.5). Phase-III trials were also more likely to be published than phase II trials (pooled OR 2.0; 95% CI 1.6-2.5). The probability of publication within two years after study completion ranged from 7% to 30%. CONCLUSIONS: A substantial part of the studies approved by RECs or included in trial registries remains unpublished. Due to the large heterogeneity a prediction of the publication probability for a future study is very uncertain. Non-publication of research is not a random process, e.g., it is associated with the direction of study findings. Our findings suggest that the dissemination of research findings is biased.

The Swiss regulatory framework for pædiatric health research

Medical research on minors entails both risks and benefits. Under Swiss law, clinical trials on children, including nontherapeutic drug trials, are permissible. However, ethics committees must systematically verify that all clinical studies have a favorable risk-benefit profile. Additional safeguards are designed to ensure that children are not unnecessarily involved in research and that proper consent is always obtained. Federal Swiss law is undergoing revision to extend these protections beyond clinical trials to a broad array of health research. The Swiss drug agency also seeks to improve the incentives for pharmaceutical firms to develop new paediatric drugs and relevant paediatric drug labels.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Retrospective research: What are the ethical and legal requirements?

Retrospective research is conducted on already available data and/or biologic material. Whether such research requires that patients specifically consent to the use of "their" data continues to stir controversy. From a legal and ethical point of view, it depends on several factors. The main criteria to be considered are whether the data or the sample is anonymous, whether the researcher is the one who collected it and whether the patient was told of the possible research use. In Switzerland, several laws delineate the procedure to be followed. The definition of "anonymous" is open to some interpretation. In addition, it is debatable whether consent waivers that are legally admissible for data extend to research involving human biological samples. In a few years, a new Swiss federal law on human research could clarify the regulatory landscape. Meanwhile, hospital-internal guidelines may impose stricter conditions than required by federal or cantonal law. Conversely, Swiss and European ethical texts may suggest greater flexibility and call for a looser interpretation of existing laws. The present article provides an overview of the issues for physicians, scientists, ethics committee members and policy makers involved in retrospective research in Switzerland. It aims at provoking more open discussions of the regulatory problems and possible future legal and ethical solutions.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES: To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING: We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS: Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION: Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Business research, self-fulfilling prophecy, and the inherent responsibility of scholars.

Business research and teaching institutions play an important role in shaping the way businesses perceive their relations to the broader society and its moral expectations. Hence, as ethical scandals recently arose in the business world, questions related to the civic responsibilities of business scholars and to the role business schools play in society have gained wider interest. In this article, I argue that these ethical shortcomings are at least partly resulting from the mainstream business model with its taken-for granted basic assumptions such as specialization or the value-neutrality of business research. Redefining the roles and civic responsibilities of business scholars for business practice implies therefore a thorough analysis of these assumptions if not their redefinition. The takenforgrantedness of the mainstream business model is questioned by the transformation of the societal context in which business activities are embedded. Its value-neutrality in turn is challenged by self-fulfilling prophecy effects, which highlight the normative influence of business schools. In order to critically discuss some basic assumptions of mainstream business theory, I propose to draw parallels with the corporate citizenship concept and the stakeholder theory. Their integrated approach of the relation between business practice and the broader society provides interesting insights for the social reembedding of business research and teaching.