Myth creation in textbook writing : the case of randomised controlled trials in medical research

Textbooks, across all disciplines, are prone to contain errors; grammatical, editorial, factual, or judgemental. The following is an account of one of the possible effects of such errors; how an error becomes entrenched and even exaggerated as later textbooks fail to correct the original error. The example considered here concerns the origins of one of the most basic and important tools of to­ day's medical research, the randomised controlled trial. It is the result of a systematic study of 26 British, French and German history of medicine textbooks since 1996.

The role of postoperative prophylactic antibiotics in the treatment of facial fractures: a randomized, double-blind, placebo-controlled pilot clinical study. Part 2: mandibular fractures in 59 patients

The aim of this study was to evaluate the difference between a 5-day and a 1-day postoperative course of antibiotic on the incidence of infection after mandibular fractures involving the alveolus. Sixty-two patients with fractures of the mandible involving the dentoalveolar region were randomly assigned to 2 groups, both of which were given amoxicillin/clavulanic acid 1.2 g intravenously every 8 h from admission until 24 h postoperatively. The 5-day group were then given amoxicillin/clavulanic acid 625 mg orally every 8 h for another 4 days. The 1-day group was given an oral placebo at the same intervals. Follow-up appointments were 1, 2, 4, 6, 12 weeks and 6 months postoperatively. Development of an infection was the primary end point. Fifty-nine of the 62 patients completed this study. Six of the 30 patients in the 5-day group (20%) and 6 out of the 29 in the 1-day group (21%) developed local wound infections. Three of the 6 in the 1-day group developed purulent discharge and swelling. One patient in the 5-day group developed a rash on the trunk. There were no significant differences in the incidence of infection or side effects between the groups. In fractures of the mandible involving the alveolus, a 1-day postoperative course of antibiotic is as effective in preventing infective complications as a 5-day regimen.

Cardiac Shock Wave Therapy for Chronic Refractory Angina Pectoris. A Prospective Placebo-Controlled Randomized Trial

Background: Cardiac shock wave therapy (CSWT) delivered to the myocardium increases capillary density and regional myocardial blood flow in animal experiments. In addition, nonenzymatic nitric oxide production and the upregulation of vascular growth factor's mRNA by CSWT have been described. The aim of the study was therefore to test its potential to relieve symptoms in patients with chronic stable angina pectoris. Methods: Twenty-one patients (mean age 68.2 ± 8.3 years, 19 males) with chronic refractory angina pectoris and evidence of inducible myocardial ischemia during MIBI-SPECT imaging, were randomized into a treatment (n = 11) and a placebo arm (n = 10). The region of exercise-induced ischemia was treated with echocardiographic guidance during nine sessions over a period of 3 months. One session of CSWT consisted of 200 shots/spot (9--12 spots/session) with an energy intensity of 0.09 mJ/mm2. In the control group acoustic simulation was performed without energy application. Medication was kept unchanged during the whole treatment period. Results: In the treatment group, symptoms improved in 9/11 patients, and the ischemic threshold, determined by cardiopulmonary exercise stress testing, increased from 80 ± 28 to 95 ± 28 W (P= 0.036). In the placebo arm, only 2/10 patients reported an improvement and the ischemic threshold remained unchanged (98 ± 23 to 107 ± 23 W; P= 0.141). The items “physical functioning” (P= 0.043), “general health perception” (P= 0.046), and “vitality” (P= 0.035) of the SF-36 questionnaire significantly improved in the treatment arm, whereas in the placebo arm, no significant change was noted. Neither arrhythmias, troponin rise nor complications were observed during treatment. Conclusions: This placebo controlled trial shows a significant improvement in symptoms, quality of life parameters and ischemic threshold during exercise in patients with chronic refractory angina pectoris treated with CSWT. Thus, CSWT represents a new option for the treatment of patients with refractory AP.

Dopaminergic modulation of the reward system in schizophrenia: A placebo-controlled dopamine depletion fMRI study

Background The brain reward circuitry innervated by dopamine is critically disturbed in schizophrenia. This study aims to investigate the role of dopamine-related brain activity during prediction of monetary reward and loss in first episode schizophrenia patients. Methods We measured blood–oxygen-level dependent (BOLD) activity in 10 patients with schizophrenia (SCH) and 12 healthy controls during dopamine depletion with α-methylparatyrosine (AMPT) and during a placebo condition (PLA). Results AMPT reduced the activation of striatal and cortical brain regions in SCH. In SCH vs. controls reduced activation was found in the AMPT condition in several regions during anticipation of reward and loss, including areas of the striatum and frontal cortex. In SCH vs. controls reduced activation of the superior temporal gyrus and posterior cingulate was observed in PLA during anticipation of rewarding stimuli. PLA patients had reduced activation in the ventral striatum, frontal and cingulate cortex in anticipation of loss. The findings of reduced dopamine-related brain activity during AMPT were verified by reduced levels of dopamine in urine, homovanillic-acid in plasma and increased prolactin levels. Conclusions Our results indicate that dopamine depletion affects functioning of the cortico-striatal reward circuitry in SCH. The findings also suggest that neuronal functions associated with dopamine neurotransmission and attribution of salience to reward predicting stimuli are altered in schizophrenia.

The role of postoperative prophylactic antibiotics in the treatment of facial fractures: a randomised, double-blind, placebo-controlled pilot clinical study. Part 3: Le Fort and zygomatic fractures in 94 patients

The aim of this study was to evaluate the difference between the effect of a 5-day and a 1-day postoperative course of antibiotics on the incidence of infection after midfacial fractures. A total of 98 patients with displaced Le Fort or zygomatic fractures that required operation were randomly assigned into 2 groups, both of which were given amoxicillin/clavulanic acid 1.2g intravenously every 8h from the time of admission until 24h postoperatively. The 5-day group was then given amoxicillin/clavulanic acid 625mg orally 8-hourly for another 4 days. The 1-day group was given placebo orally at the same time points. Patients were followed up 1, 2, 4, 6, and 12 weeks, and 6 months, postoperatively. The development of an infection of the wound was the primary end point. Ninety-four of the 98 patients completed the study. Two of the 45 patients in the 5-day group (4%) and 2/49 in the 1-day group (4%) developed postoperative wound infections. One in each group had a purulent infection, while the others had only wound breakdown. Two patients of the 5-day group and one in the 1-day group developed rashes on the trunk. There were no significant differences in the incidence of infection or side effects between the groups. In midfacial fractures a 1-day course of antibiotics postoperatively is as effective in preventing infective complications as a 5-day regimen.

Intrauterine instillation of diluted seminal plasma at oocyte pick-up does not increase the IVF pregnancy rate: a double-blind, placebo controlled, randomized study.

STUDY QUESTION Does intrauterine application of diluted seminal plasma (SP) at the time of ovum pick-up improve the pregnancy rate by ≥14% in IVF treatment? SUMMARY ANSWER Intrauterine instillation of diluted SP at the time of ovum pick-up is unlikely to increase the pregnancy rate by ≥14% in IVF. WHAT IS KNOWN ALREADY SP modulates endometrial function, and sexual intercourse around the time of embryo transfer has been suggested to increase the likelihood of pregnancy. A previous randomized double-blind pilot study demonstrated a strong trend towards increased pregnancy rates following the intracervical application of undiluted SP. As this study was not conclusive and as the finding could have been confounded by sexual intercourse, the intrauterine application of diluted SP was investigated in the present trial. STUDY DESIGN, SIZE, DURATION A single-centre, prospective, double-blind, placebo-controlled, randomized, superiority trial on women undergoing IVF was conducted from April 2007 until February 2012 at the University Department of Gynaecological Endocrinology and Reproductive Medicine, Heidelberg, Germany. PARTICIPANTS/MATERIALS, SETTING, METHODS The study was powered to detect an 14% increase in the clinical pregnancy rate and two sequential tests were planned using the Pocock spending function. At the first interim analysis, 279 women had been randomly assigned to intrauterine diluted SP (20% SP in saline from the patients' partner) (n = 138) or placebo (n = 141) at the time of ovum pick-up. MAIN RESULTS AND THE ROLE OF CHANCE The clinical pregnancy rate per randomized patient was 37/138 (26.8%) in the SP group and 41/141 (29.1%) in the placebo group (difference: -2.3%, 95% confidence interval of the difference: -12.7 to +8.2%; P = 0.69). The live birth rate per randomized patient was 28/138 (20.3%) in the SP group and 33/141 (23.4%) in the placebo group (difference: -3.1%, 95% confidence interval of the difference: -12.7 to +6.6%; P = 0.56). It was decided to terminate the trial due to futility at the first interim analysis, at a conditional power of 62%. LIMITATIONS, REASONS FOR CAUTION The confidence interval of the difference remains wide, thus clinically relevant differences cannot reliably be excluded based on this single study. WIDER IMPLICATIONS OF THE FINDINGS The results of this study cast doubt on the validity of the concept that SP increases endometrial receptivity and thus implantation in humans. STUDY FUNDING/COMPETING INTEREST(S) Funding was provided by the department's own research facilities. TRIAL REGISTRATION NUMBER DRKS00004615.

The Alexander Technique and musicians: a systematic review of controlled trials

BACKGROUND: Musculoskeletal disorders, stress and performance anxiety are common in musicians. Therefore, some use the Alexander Technique (AT), a psycho-physical method that helps to release unnecessary muscle tension and re-educates non-beneficial movement patterns through intentional inhibition of unwanted habitual behaviours. According to a recent review AT sessions may be effective for chronic back pain. This review aimed to evaluate the evidence for the effectiveness of AT sessions on musicians' performance, anxiety, respiratory function and posture. METHODS: The following electronic databases were searched up to February 2014 for relevant publications: PUBMED, Google Scholar, CINAHL, EMBASE, AMED, PsycINFO and RILM. The search criteria were "Alexander Technique" AND "music*". References were searched, and experts and societies of AT or musicians' medicine contacted for further publications. RESULTS: 237 citations were assessed. 12 studies were included for further analysis, 5 of which were randomised controlled trials (RCTs), 5 controlled but not randomised (CTs), and 2 mixed methods studies. Main outcome measures in RCTs and CTs were music performance, respiratory function, performance anxiety, body use and posture. Music performance was judged by external experts and found to be improved by AT in 1 of 3 RCTs; in 1 RCT comparing neurofeedback (NF) to AT, only NF caused improvements. Respiratory function was investigated in 2 RCTs, but not improved by AT training. Performance anxiety was mostly assessed by questionnaires and decreased by AT in 2 of 2 RCTs and in 2 of 2 CTs. CONCLUSIONS: A variety of outcome measures have been used to investigate the effectiveness of AT sessions in musicians. Evidence from RCTs and CTs suggests that AT sessions may improve performance anxiety in musicians. Effects on music performance, respiratory function and posture yet remain inconclusive. Future trials with well-established study designs are warranted to further and more reliably explore the potential of AT in the interest of musicians.

The reporting quality of randomized controlled trials in orthodontics.

OBJECTIVES Accurate trial reporting facilitates evaluation and better use of study results. The objective of this article is to investigate the quality of reporting of randomized controlled trials (RCTs) in leading orthodontic journals, and to explore potential predictors of improved reporting. METHODS The 50 most recent issues of 4 leading orthodontic journals until November 2013 were electronically searched. Reporting quality assessment was conducted using the modified CONSORT statement checklist. The relationship between potential predictors and the modified CONSORT score was assessed using linear regression modeling. RESULTS 128 RCTs were identified with a mean modified CONSORT score of 68.97% (SD = 11.09). The Journal of Orthodontics (JO) ranked first in terms of completeness of reporting (modified CONSORT score 76.21%, SD = 10.1), followed by American Journal of Orthodontics and Dentofacial Orthopedics (AJODO) (73.05%, SD = 10.1). Journal of publication (AJODO: β = 10.08, 95% CI: 5.78, 14.38; JO: β = 16.82, 95% CI: 11.70, 21.94; EJO: β = 7.21, 95% CI: 2.69, 11.72 compared to Angle), year of publication (β = 0.98, 95% CI: 0.28, 1.67 for each additional year), region of authorship (Europe: β = 5.19, 95% CI: 1.30, 9.09 compared to Asia/other), statistical significance (significant: β = 3.10, 95% CI: 0.11, 6.10 compared to non-significant) and methodologist involvement (involvement: β = 5.60, 95% CI: 1.66, 9.54 compared to non-involvement) were all significant predictors of improved modified CONSORT scores in the multivariable model. Additionally, median overall Jadad score was 2 (IQR = 2) across journals, with JO (median = 3, IQR = 1) and AJODO (median = 3, IQR = 2) presenting the highest score values. CONCLUSION The reporting quality of RCTs published in leading orthodontic journals is considered suboptimal in various CONSORT areas. This may have a bearing in trial result interpretation and use in clinical decision making and evidence- based orthodontic treatment interventions.

Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology.

AIM Abstracts of randomized clinical trials are extremely important as trial appraisal is often based on the information included here. The objective of this study was to assess the quality of the reporting of RCT abstracts in journals of Oral Implantology. MATERIAL AND METHODS Six leading Implantology journals were screened for RCTs between years 2008 and 2012. A 21-item modified CONSORT for abstracts checklist was used to examine the completeness of abstract reporting. Descriptive statistics and linear regression modeling were employed for data analysis. RESULTS One hundred and sixty three RCT abstracts were included in this study. The majority of the RCTs were published in the Clinical Oral Implants Research (42.9%). The mean overall reporting quality score was 58.6% (95% CI: 57.6-59.7). The highest score was noted in the European Journal of Oral Implantology (63.8%; 95% CI: 61.8-65.8). Multivariate analysis demonstrated that abstract quality score was related to publication journal and number of research centers involved. Most abstracts adequately reported interventions (89.0%), objectives (77.9%) and conclusions (74.8%) while failed to report randomization procedures, allocation concealment, effect estimate, confidence intervals, and funding. Registration of RCTs was not reported in any of the abstracts. CONCLUSIONS The reporting quality in abstracts of RCTs published in Oral Implantology journals needs to be improved. Editors and authors should be encouraged to endorse the CONSORT for abstracts guidelines in order to achieve optimal quality in abstract reporting.

Sample size in orthodontic randomized controlled trials: are numbers justified?

Sample size calculations are advocated by the Consolidated Standards of Reporting Trials (CONSORT) group to justify sample sizes in randomized controlled trials (RCTs). This study aimed to analyse the reporting of sample size calculations in trials published as RCTs in orthodontic speciality journals. The performance of sample size calculations was assessed and calculations verified where possible. Related aspects, including number of authors; parallel, split-mouth, or other design; single- or multi-centre study; region of publication; type of data analysis (intention-to-treat or per-protocol basis); and number of participants recruited and lost to follow-up, were considered. Of 139 RCTs identified, complete sample size calculations were reported in 41 studies (29.5 per cent). Parallel designs were typically adopted (n = 113; 81 per cent), with 80 per cent (n = 111) involving two arms and 16 per cent having three arms. Data analysis was conducted on an intention-to-treat (ITT) basis in a small minority of studies (n = 18; 13 per cent). According to the calculations presented, overall, a median of 46 participants were required to demonstrate sufficient power to highlight meaningful differences (typically at a power of 80 per cent). The median number of participants recruited was 60, with a median of 4 participants being lost to follow-up. Our finding indicates good agreement between projected numbers required and those verified (median discrepancy: 5.3 per cent), although only a minority of trials (29.5 per cent) could be examined. Although sample size calculations are often reported in trials published as RCTs in orthodontic speciality journals, presentation is suboptimal and in need of significant improvement.

A novel blood-sparing agent in cardiac surgery? First in-patient experience with the synthetic serine protease inhibitor MDCO-2010: a phase II, randomized, double-blind, placebo-controlled study in patients undergoing coronary artery bypass grafting with cardiopulmonary bypass

BACKGROUND Antifibrinolytics have been used for 2 decades to reduce bleeding in cardiac surgery. MDCO-2010 is a novel, synthetic, serine protease inhibitor. We describe the first experience with this drug in patients. METHODS In this phase II, double-blind, placebo-controlled study, 32 patients undergoing isolated primary coronary artery bypass grafting with cardiopulmonary bypass were randomly assigned to 1 of 5 increasing dosage groups of MDCO-2010. The primary aim was to evaluate pharmacokinetics (PK) with assessment of plasmatic concentrations of the drug, short-term safety, and tolerance of MDCO-2010. Secondary end points were influence on coagulation, chest tube drainage, and transfusion requirements. RESULTS PK analysis showed linear dosage-proportional correlation between MDCO-2010 infusion rate and PK parameters. Blood loss was significantly reduced in the 3 highest dosage groups compared with control (P = 0.002, 0.004 and 0.011, respectively). The incidence of allogeneic blood product transfusions was lower with MDCO-2010 4/24 (17%) vs 4/8 (50%) in the control group. MDCO-2010 exhibited dosage-dependent antifibrinolytic effects through suppression of D-dimer generation and inhibition of tissue plasminogen activator-induced lysis in ROTEM analysis as well as anticoagulant effects demonstrated by prolongation of activated clotting time and activated partial thromboplastin time. No systematic differences in markers of end organ function were observed among treatment groups. Three patients in the MDCO-2010 groups experienced serious adverse events. One patient experienced intraoperative thrombosis of venous grafts considered possibly related to the study drug. No reexploration for mediastinal bleeding was required, and there were no deaths. CONCLUSIONS This first-in-patient study demonstrated dosage-proportional PK for MDCO-2010 and reduction of chest tube drainage and transfusions in patients undergoing primary coronary artery bypass grafting. Antifibrinolytic and anticoagulant effects were demonstrated using various markers of coagulation. MDCO-2010 was well tolerated and showed an acceptable initial safety profile. Larger multi-institutional studies are warranted to further investigate the safety and efficacy of this compound.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications.

OBJECTIVE To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study.

OBJECTIVE: To investigate the prevalence of discontinuation and nonpublication of surgical versus medical randomized controlled trials (RCTs) and to explore risk factors for discontinuation and nonpublication of surgical RCTs. BACKGROUND: Trial discontinuation has significant scientific, ethical, and economic implications. To date, the prevalence of discontinuation of surgical RCTs is unknown. METHODS: All RCT protocols approved between 2000 and 2003 by 6 ethics committees in Canada, Germany, and Switzerland were screened. Baseline characteristics were collected and, if published, full reports retrieved. Risk factors for early discontinuation for slow recruitment and nonpublication were explored using multivariable logistic regression analyses. RESULTS: In total, 863 RCT protocols involving adult patients were identified, 127 in surgery (15%) and 736 in medicine (85%). Surgical trials were discontinued for any reason more often than medical trials [43% vs 27%, risk difference 16% (95% confidence interval [CI]: 5%-26%); P = 0.001] and more often discontinued for slow recruitment [18% vs 11%, risk difference 8% (95% CI: 0.1%-16%); P = 0.020]. The percentage of trials not published as full journal article was similar in surgical and medical trials (44% vs 40%, risk difference 4% (95% CI: -5% to 14%); P = 0.373). Discontinuation of surgical trials was a strong risk factor for nonpublication (odds ratio = 4.18, 95% CI: 1.45-12.06; P = 0.008). CONCLUSIONS: Discontinuation and nonpublication rates were substantial in surgical RCTs and trial discontinuation was strongly associated with nonpublication. These findings need to be taken into account when interpreting surgical literature. Surgical trialists should consider feasibility studies before embarking on full-scale trials.