Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee

BACKGROUND: Not all clinical trials are published, which may distort the evidence that is available in the literature. We studied the publication rate of a cohort of clinical trials and identified factors associated with publication and nonpublication of results. METHODS: We analysed the protocols of randomized clinical trials of drug interventions submitted to the research ethics committee of University Hospital (Inselspital) Bern, Switzerland from 1988 to 1998. We identified full articles published up to 2006 by searching the Cochrane CENTRAL database (issue 02/2006) and by contacting investigators. We analyzed factors associated with the publication of trials using descriptive statistics and logistic regression models. RESULTS: 451 study protocols and 375 corresponding articles were analyzed. 233 protocols resulted in at least one publication, a publication rate of 52%. A total of 366 (81%) trials were commercially funded, 47 (10%) had non-commercial funding. 346 trials (77%) were multi-centre studies and 272 of these (79%) were international collaborations. In the adjusted logistic regression model non-commercial funding (Odds Ratio [OR] 2.42, 95% CI 1.14-5.17), multi-centre status (OR 2.09, 95% CI 1.03-4.24), international collaboration (OR 1.87, 95% CI 0.99-3.55) and a sample size above the median of 236 participants (OR 2.04, 95% CI 1.23-3.39) were associated with full publication. CONCLUSIONS: In this cohort of applications to an ethics committee in Switzerland, only about half of clinical drug trials were published. Large multi-centre trials with non-commercial funding were more likely to be published than other trials, but most trials were funded by industry.

Clinical research projects at a German medical faculty: follow-up from ethical approval to publication and citation by others

BACKGROUND: Only data of published study results are available to the scientific community for further use such as informing future research and synthesis of available evidence. If study results are reported selectively, reporting bias and distortion of summarised estimates of effect or harm of treatments can occur. The publication and citation of results of clinical research conducted in Germany was studied. METHODS: The protocols of clinical research projects submitted to the research ethics committee of the University of Freiburg (Germany) in 2000 were analysed. Published full articles in several databases were searched and investigators contacted. Data on study and publication characteristics were extracted from protocols and corresponding publications. RESULTS: 299 study protocols were included. The most frequent study design was randomised controlled trial (141; 47%), followed by uncontrolled studies (61; 20%), laboratory studies (30; 10%) and non-randomised studies (29; 10%). 182 (61%) were multicentre studies including 97 (53%) international collaborations. 152 of 299 (51%) had commercial (co-)funding and 46 (15%) non-commercial funding. 109 of the 225 completed protocols corresponded to at least one full publication (total 210 articles); the publication rate was 48%. 168 of 210 identified publications (80%) were cited in articles indexed in the ISI Web of Science. The median was 11 citations per publication (range 0-1151). CONCLUSIONS: Results of German clinical research projects conducted are largely underreported. Barriers to successful publication need to be identified and appropriate measures taken. Close monitoring of projects until publication and adequate support provided to investigators may help remedy the prevailing underreporting of research.

New Sites, New Challenges? Ethical and Methodological Questions in the Context of Research on Migration Exclusion

The challenges of research ethics and methodologies have been reflected on extensively, but – aside from the context of feminist methodologies – less so in relation to research on particular migration sites such as in transit, detention centres, at the borders or within migration administration. First attempts in this direction have been made (Düvell et al. 2010, Fresia et al. 2005, Riedner 2014, van Liempt/Bilger2009), however, more reflection and theorization is needed, considering the contested nature of these temporal and volatile sites. In this workshop, we thus aim at examining methodological as well as ethical questions that arise during field work: We attempt to reflect the power relations involved in the research process, the ethics of research design, the dissemination of research results, the question of gaining access to and – whenever necessary – staying in contact with our research subjects. How can we negotiate informed consent with subjects whose life is currently marked by transit and insecurity concerning their own future, and who are in an uncertain situation in which substantial information (legal, social, cultural etc.) is likely to be missing? How do we deal with the dilemma of possibly contributing to knowledge production that might facilitate removals and deportations in the future, considering that the reception of the results is not in the hands of the researchers? How do we deal with the anticipated as well as unexpected impacts of our research on social and political practice? Regarding fieldwork in state institutions, how do we negotiate the multiple loyalties we often find ourselves faced with as social researchers, both with the excluded migrants and with the authorities implementing the exclusions – two groupings considered to be opposite to each other (Lavanchy 2013)? Which different roles do researchers need to take on? The aim of our workshop is first and foremost to exchange experiences on fieldwork with others doing qualitative research on related topics and to consider its possible implications – including affective dimensions – for all participants involved in the research process: the migrants, the security staff of detention centres, its social workers, border police and bureaucrats and, last but not least, the researchers themselves. Furthermore, we generally wish to reflect upon the question of how best to conduct research in this contested field, applying an interdisciplinary perspective.

Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study)

Background Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. Methods/Design Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs. We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. Discussion Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Effect of comprehensive cardiac rehabilitation after heart valve surgery (CopenHeartVR): study protocol for a randomised clinical trial

Background Heart valve diseases are common with an estimated prevalence of 2.5% in the Western world. The number is rising due to an ageing population. Once symptomatic, heart valve diseases are potentially lethal, and heavily influence daily living and quality of life. Surgical treatment, either valve replacement or repair, remains the treatment of choice. However, post surgery, the transition to daily living may become a physical, mental and social challenge. We hypothesise that a comprehensive cardiac rehabilitation programme can improve physical capacity and self-assessed mental health and reduce hospitalisation and healthcare costs after heart valve surgery. Methods A randomised clinical trial, CopenHeartVR, aims to investigate whether cardiac rehabilitation in addition to usual care is superior to treatment as usual after heart valve surgery. The trial will randomly allocate 210 patients, 1:1 intervention to control group, using central randomisation, and blinded outcome assessment and statistical analyses. The intervention consists of 12 weeks of physical exercise, and a psycho-educational intervention comprising five consultations. Primary outcome is peak oxygen uptake (VO2 peak) measured by cardiopulmonary exercise testing with ventilatory gas analysis. Secondary outcome is self-assessed mental health measured by the standardised questionnaire Short Form 36. Also, long-term healthcare utilisation and mortality as well as biochemistry, echocardiography and cost-benefit will be assessed. A mixed-method design is used to evaluate qualitative and quantitative findings encompassing a survey-based study before the trial and a qualitative pre- and post-intervention study. Discussion The study is approved by the local regional Research Ethics Committee (H-1-2011-157), and the Danish Data Protection Agency (j.nr. 2007-58-0015).

Prevalence, characteristics, and publication of discontinued randomized trials.

IMPORTANCE The discontinuation of randomized clinical trials (RCTs) raises ethical concerns and often wastes scarce research resources. The epidemiology of discontinued RCTs, however, remains unclear. OBJECTIVES To determine the prevalence, characteristics, and publication history of discontinued RCTs and to investigate factors associated with RCT discontinuation due to poor recruitment and with nonpublication. DESIGN AND SETTING Retrospective cohort of RCTs based on archived protocols approved by 6 research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics and planned recruitment from included protocols. Last follow-up of RCTs was April 27, 2013. MAIN OUTCOMES AND MEASURES Completion status, reported reasons for discontinuation, and publication status of RCTs as determined by correspondence with the research ethics committees, literature searches, and investigator surveys. RESULTS After a median follow-up of 11.6 years (range, 8.8-12.6 years), 253 of 1017 included RCTs were discontinued (24.9% [95% CI, 22.3%-27.6%]). Only 96 of 253 discontinuations (37.9% [95% CI, 32.0%-44.3%]) were reported to ethics committees. The most frequent reason for discontinuation was poor recruitment (101/1017; 9.9% [95% CI, 8.2%-12.0%]). In multivariable analysis, industry sponsorship vs investigator sponsorship (8.4% vs 26.5%; odds ratio [OR], 0.25 [95% CI, 0.15-0.43]; P < .001) and a larger planned sample size in increments of 100 (-0.7%; OR, 0.96 [95% CI, 0.92-1.00]; P = .04) were associated with lower rates of discontinuation due to poor recruitment. Discontinued trials were more likely to remain unpublished than completed trials (55.1% vs 33.6%; OR, 3.19 [95% CI, 2.29-4.43]; P < .001). CONCLUSIONS AND RELEVANCE In this sample of trials based on RCT protocols from 6 research ethics committees, discontinuation was common, with poor recruitment being the most frequently reported reason. Greater efforts are needed to ensure the reporting of trial discontinuation to research ethics committees and the publication of results of discontinued trials.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications.

OBJECTIVE To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Ethical procedures and patient consent differ in Europe.

BACKGROUND Research ethics approvals, procedures and requirements for institutional research ethics committees vary considerably by country and by type of organisation. OBJECTIVE To evaluate the requirements and procedures of research ethics committees, details of patient information and informed consent based on a multicentre European trial. DESIGN Survey of European hospitals participating in the prospective observational study on chronic postsurgical pain (euCPSP) using electronic questionnaires. SETTING Twenty-four hospitals in 11 European countries. PARTICIPANTS From the 24 hospitals, 23 local investigators responded; 23 answers were analysed. OUTCOME MEASURES Comparison of research ethics procedures and committee requirements from the perspective of clinical researchers. Comparison of the institutions' procedures regarding patient information and consent. Description of further details such as costs and the duration of the approval process. RESULTS The approval process lasted from less than 2 weeks up to more than 2 months with financial fees varying between 0 and 575 &OV0556;. In 20 hospitals, a patient information sheet of variable length (half page up to two pages) was provided. Requirements for patients' informed consent differed. Written informed consent was mandatory at 12, oral at 10 and no form of consent at one hospital. Details such as enough time for consideration, possibility for withdrawal and risks/benefits of participation were provided in 25 to 30% of the institutions. CONCLUSION There is a considerable variation in the administrative requirements for approval procedures by research ethics committees in Europe. This results in variation of the extent of information and consent procedures for the patients involved. TRIAL REGISTRATION euCPSP in Clinicaltrials.gov identifier: NCT01467102; PAIN-OUT in Clinicaltrials.gov identifier: NCT02083835.

An analysis of protocols and publications suggested that most discontinuations of clinical trials were not based on preplanned interim analyses or stopping rules.

OBJECTIVES To investigate the frequency of interim analyses, stopping rules, and data safety and monitoring boards (DSMBs) in protocols of randomized controlled trials (RCTs); to examine these features across different reasons for trial discontinuation; and to identify discrepancies in reporting between protocols and publications. STUDY DESIGN AND SETTING We used data from a cohort of RCT protocols approved between 2000 and 2003 by six research ethics committees in Switzerland, Germany, and Canada. RESULTS Of 894 RCT protocols, 289 prespecified interim analyses (32.3%), 153 stopping rules (17.1%), and 257 DSMBs (28.7%). Overall, 249 of 894 RCTs (27.9%) were prematurely discontinued; mostly due to reasons such as poor recruitment, administrative reasons, or unexpected harm. Forty-six of 249 RCTs (18.4%) were discontinued due to early benefit or futility; of those, 37 (80.4%) were stopped outside a formal interim analysis or stopping rule. Of 515 published RCTs, there were discrepancies between protocols and publications for interim analyses (21.1%), stopping rules (14.4%), and DSMBs (19.6%). CONCLUSION Two-thirds of RCT protocols did not consider interim analyses, stopping rules, or DSMBs. Most RCTs discontinued for early benefit or futility were stopped without a prespecified mechanism. When assessing trial manuscripts, journals should require access to the protocol.

Planning and reporting of quality-of-life outcomes in cancer trials.

BACKGROUND Information about the impact of cancer treatments on patients' quality of life (QoL) is of paramount importance to patients and treating oncologists. Cancer trials that do not specify QoL as an outcome or fail to report collected QoL data, omit crucial information for decision making. To estimate the magnitude of these problems, we investigated how frequently QoL outcomes were specified in protocols of cancer trials and subsequently reported. DESIGN Retrospective cohort study of RCT protocols approved by six research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We compared protocols to corresponding publications, which were identified through literature searches and investigator surveys. RESULTS Of the 173 cancer trials, 90 (52%) specified QoL outcomes in their protocol, 2 (1%) as primary and 88 (51%) as secondary outcome. Of the 173 trials, 35 (20%) reported QoL outcomes in a corresponding publication (4 modified from the protocol), 18 (10%) were published but failed to report QoL outcomes in the primary or a secondary publication, and 37 (21%) were not published at all. Of the 83 (48%) trials that did not specify QoL outcomes in their protocol, none subsequently reported QoL outcomes. Failure to report pre-specified QoL outcomes was not associated with industry sponsorship (versus non-industry), sample size, and multicentre (versus single centre) status but possibly with trial discontinuation. CONCLUSIONS About half of cancer trials specified QoL outcomes in their protocols. However, only 20% reported any QoL data in associated publications. Highly relevant information for decision making is often unavailable to patients, oncologists, and health policymakers.

Ethics in science: enhancing the democratisation of knowledge production in transdisciplinary research partnerships for sustainable development

Better access to knowledge and knowledge production has to be reconsidered as key to successful individual and social mitigation and adaptation strategies for global change. Indeed, concepts of sustainable development imply a transformation of science towards fostering democratisation of knowledge production and the development of knowledge societies as a strategic goal. This means to open the process of scientific knowledge production while simultaneously empowering people to implement their own visions for sustainable development. Advocates of sustainability science support this transformation. In transdisciplinary practice, they advance equity and accountability in the access to and production of knowledge at the science–society interface. UNESCO points to advancements, yet Northern dominance persists in knowledge production as well as in technology design and transfer. Further, transdisciplinary practice remains experimental and hampered by inadequate and asymmetrically equipped institutions in the North and South and related epistemological and operational obscurity. To help identify clear, practicable transdisciplinary approaches, I recommend examining the institutional route – i.e., the learning and adaptation process – followed in concrete cases. The transdisciplinary Eastern and Southern Africa Partnership Programme (1998–2013) is a case ripe for such examination. Understanding transdisciplinarity as an integrative approach, I highlight ESAPP’s three key principles for a more democratised knowledge production for sustainable development: (1) integration of scientific and “non-scientific” knowledge systems; (2) integration of social actors and institutions; and (3) integrative learning processes. The analysis reveals ESAPP’s achievements in contributing to more democratic knowledge production and South ownership in the realm of sustainable development.

Sport psychology: Needs and perspectives for research, education and application

Sport psychology has shown an increasing development in the past 25 years. A first focus is laid on the growth of research output as indicated by the number of publications. A more detailed analysis shows that some mainstream topics are very dominant in the international research literature whereas other themes are completely lacking. Possible biases are discussed as well as consequences for the body of knowledge in sport psychology. The need for a sound training in sport psychology is discussed in relation with the progress in sport psychology research. Different concepts of education in sport psychology with their respective background are compared and their impact on the development of sport psychology is discussed. The field of application, mainly in top level sport, is presented with a focus on professional standards and deontological codes. Conclusions are drawn with the aim to open new perspectives for research, education, and application of sport psychology.