Reporting quality of abstracts of randomized controlled trials published in dental specialty journals

OBJECTIVES A widespread assessment of the reporting of RCT abstracts published in dental journals is lacking. Our aim was to investigate the quality of reporting of abstracts published in leading dental specialty journals using, as a guide, the CONSORT for abstracts checklist. METHODS Electronic and supplementary hand searching were undertaken to identify RCTs published in seven dental specialty journals. The quality of abstract reporting was evaluated using a modified checklist based on the CONSORT for abstracts checklist. Descriptive statistics followed by univariate and multivariate analyses were conducted. RESULTS 228 RCT abstracts were identified. Reporting of interventions, objectives and conclusions within abstracts were adequate. Inadequately reported items included: title, participants, outcomes, random number generation, numbers randomized and effect size estimate. Randomization restrictions, allocation concealment, blinding, numbers analyzed, confidence intervals, intention-to-treat analysis, harms, registration and funding were rarely described. CONCLUSIONS The mean overall reporting quality score was suboptimal at 62.5% (95% CI: 61.9, 63.0). Significantly better abstract reporting was noted in certain specialty journals and in multicenter trials.

Is paromomycin an effective and safe treatment against cutaneous leishmaniasis? A meta-analysis of 14 randomized controlled trials.

BACKGROUND: High cost, poor compliance, and systemic toxicity have limited the use of pentavalent antimony compounds (SbV), the treatment of choice for cutaneous leishmaniasis (CL). Paromomycin (PR) has been developed as an alternative to SbV, but existing data are conflicting. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed, Scopus, and Cochrane Central Register of Controlled Trials, without language restriction, through August 2007, to identify randomized controlled trials that compared the efficacy or safety between PR and placebo or SbV. Primary outcome was clinical cure, defined as complete healing, disappearance, or reepithelialization of all lesions. Data were extracted independently by two investigators, and pooled using a random-effects model. Fourteen trials including 1,221 patients were included. In placebo-controlled trials, topical PR appeared to have therapeutic activity against the old world and new world CL, with increased local reactions, when used with methylbenzethonium chloride (MBCL) compared to when used alone (risk ratio [RR] for clinical cure, 2.58 versus 1.01: RR for local reactions, 1.60 versus 1.07). In SbV-controlled trials, the efficacy of topical PR was not significantly different from that of intralesional SbV in the old world CL (RR, 0.70; 95% confidence interval, 0.26-1.89), whereas topical PR was inferior to parenteral SbV in treating the new world CL (0.67; 0.54-0.82). No significant difference in efficacy was found between parenteral PR and parenteral SbV in the new world CL (0.88; 0.56-1.38). Systemic side effects were fewer with topical or parenteral PR than parenteral SbV. CONCLUSIONS/SIGNIFICANCE: Topical PR with MBCL could be a therapeutic alternative to SbV in selected cases of the old world CL. Development of new formulations with better efficacy and tolerability remains to be an area of future research.

2 years versus 1 year of adjuvant trastuzumab for HER2-positive breast cancer (HERA): an open-label, randomised controlled trial

BACKGROUND Trastuzumab has established efficacy against breast cancer with overexpression or amplification of the HER2 oncogene. The standard of care is 1 year of adjuvant trastuzumab, but the optimum duration of treatment is unknown. We compared 2 years of treatment with trastuzumab with 1 year of treatment, and updated the comparison of 1 year of trastuzumab versus observation at a median follow-up of 8 years, for patients enrolled in the HERceptin Adjuvant (HERA) trial. METHODS The HERA trial is an international, multicentre, randomised, open-label, phase 3 trial comparing treatment with trastuzumab for 1 and 2 years with observation after standard neoadjuvant chemotherapy, adjuvant chemotherapy, or both in 5102 patients with HER2-positive early breast cancer. The primary endpoint was disease-free survival. The comparison of 2 years versus 1 year of trastuzumab treatment involved a landmark analysis of 3105 patients who were disease-free 12 months after randomisation to one of the trastuzumab groups, and was planned after observing at least 725 disease-free survival events. The updated intention-to-treat comparison of 1 year trastuzumab treatment versus observation alone in 3399 patients at a median follow-up of 8 years (range 0-10) is also reported. This study is registered with ClinicalTrials.gov, number NCT00045032. FINDINGS We recorded 367 events of disease-free survival in 1552 patients in the 1 year group and 367 events in 1553 patients in the 2 year group (hazard ratio [HR] 0·99, 95% CI 0·85-1·14, p=0·86). Grade 3-4 adverse events and decreases in left ventricular ejection fraction during treatment were reported more frequently in the 2 year treatment group than in the 1 year group (342 [20·4%] vs 275 [16·3%] grade 3-4 adverse events, and 120 [7·2%] vs 69 [4·1%] decreases in left ventricular ejection fraction, respectively). HRs for a comparison of 1 year of trastuzumab treatment versus observation were 0·76 (95% CI 0·67-0·86, p<0·0001) for disease-free survival and 0·76 (0·65-0·88, p=0·0005) for overall survival, despite crossover of 884 (52%) patients from the observation group to trastuzumab therapy. INTERPRETATION 2 years of adjuvant trastuzumab is not more effective than is 1 year of treatment for patients with HER2-positive early breast cancer. 1 year of treatment provides a significant disease-free and overall survival benefit compared with observation and remains the standard of care. FUNDING F Hoffmann-La Roche (Roche).

The reporting quality of randomized controlled trials in orthodontics.

OBJECTIVES Accurate trial reporting facilitates evaluation and better use of study results. The objective of this article is to investigate the quality of reporting of randomized controlled trials (RCTs) in leading orthodontic journals, and to explore potential predictors of improved reporting. METHODS The 50 most recent issues of 4 leading orthodontic journals until November 2013 were electronically searched. Reporting quality assessment was conducted using the modified CONSORT statement checklist. The relationship between potential predictors and the modified CONSORT score was assessed using linear regression modeling. RESULTS 128 RCTs were identified with a mean modified CONSORT score of 68.97% (SD = 11.09). The Journal of Orthodontics (JO) ranked first in terms of completeness of reporting (modified CONSORT score 76.21%, SD = 10.1), followed by American Journal of Orthodontics and Dentofacial Orthopedics (AJODO) (73.05%, SD = 10.1). Journal of publication (AJODO: β = 10.08, 95% CI: 5.78, 14.38; JO: β = 16.82, 95% CI: 11.70, 21.94; EJO: β = 7.21, 95% CI: 2.69, 11.72 compared to Angle), year of publication (β = 0.98, 95% CI: 0.28, 1.67 for each additional year), region of authorship (Europe: β = 5.19, 95% CI: 1.30, 9.09 compared to Asia/other), statistical significance (significant: β = 3.10, 95% CI: 0.11, 6.10 compared to non-significant) and methodologist involvement (involvement: β = 5.60, 95% CI: 1.66, 9.54 compared to non-involvement) were all significant predictors of improved modified CONSORT scores in the multivariable model. Additionally, median overall Jadad score was 2 (IQR = 2) across journals, with JO (median = 3, IQR = 1) and AJODO (median = 3, IQR = 2) presenting the highest score values. CONCLUSION The reporting quality of RCTs published in leading orthodontic journals is considered suboptimal in various CONSORT areas. This may have a bearing in trial result interpretation and use in clinical decision making and evidence- based orthodontic treatment interventions.

Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology.

AIM Abstracts of randomized clinical trials are extremely important as trial appraisal is often based on the information included here. The objective of this study was to assess the quality of the reporting of RCT abstracts in journals of Oral Implantology. MATERIAL AND METHODS Six leading Implantology journals were screened for RCTs between years 2008 and 2012. A 21-item modified CONSORT for abstracts checklist was used to examine the completeness of abstract reporting. Descriptive statistics and linear regression modeling were employed for data analysis. RESULTS One hundred and sixty three RCT abstracts were included in this study. The majority of the RCTs were published in the Clinical Oral Implants Research (42.9%). The mean overall reporting quality score was 58.6% (95% CI: 57.6-59.7). The highest score was noted in the European Journal of Oral Implantology (63.8%; 95% CI: 61.8-65.8). Multivariate analysis demonstrated that abstract quality score was related to publication journal and number of research centers involved. Most abstracts adequately reported interventions (89.0%), objectives (77.9%) and conclusions (74.8%) while failed to report randomization procedures, allocation concealment, effect estimate, confidence intervals, and funding. Registration of RCTs was not reported in any of the abstracts. CONCLUSIONS The reporting quality in abstracts of RCTs published in Oral Implantology journals needs to be improved. Editors and authors should be encouraged to endorse the CONSORT for abstracts guidelines in order to achieve optimal quality in abstract reporting.

The timing of significant arch dimensional changes with fixed orthodontic appliances: data from a multicenter randomised controlled trial.

OBJECTIVES To identify the timing of significant arch dimensional increases during orthodontic alignment involving round and rectangular nickel-titanium (NiTi) wires and rectangular stainless steel (SS). A secondary aim was to compare the timing of changes occurring with conventional and self-ligating fixed appliance systems. METHODS In this non-primary publication, additional data from a multicenter randomised trial initially involving 96 patients, aged 16 years and above, were analysed. The main pre-specified outcome measures were the magnitude and timing of maxillary intercanine, interpremolar, and intermolar dimensions. Each participant underwent alignment with a standard Damon (Ormco, Orange, CA) wire sequence for a minimum of 34 weeks. Blinding of clinicians and patients was not possible; however, outcome assessors and data analysts were kept blind to the appliance type during data analysis. RESULTS Complete data were obtained from 71 subjects. Significant arch dimensional changes were observed relatively early in treatment. In particular, changes in maxillary inter-first and second premolar dimensions occurred after alignment with an 0.014in. NiTi wire (P<0.05). No statistical differences in transverse dimensions were found between rectangular NiTi and working SS wires for each transverse dimension (P>0.05). Bracket type had no significant effect on the timing of the transverse dimensional changes. CONCLUSIONS Arch dimensional changes were found to occur relatively early in treatment, irrespective of the appliance type. Nickel-titanium wires may have a more profound effect on transverse dimensions than previously believed. CLINICAL SIGNIFICANCE On the basis of this research orthodontic expansion may occur relatively early in treatment. Nickel-titanium wires may have a more profound effect on transverse dimensions than previously believed.

Sample size in orthodontic randomized controlled trials: are numbers justified?

Sample size calculations are advocated by the Consolidated Standards of Reporting Trials (CONSORT) group to justify sample sizes in randomized controlled trials (RCTs). This study aimed to analyse the reporting of sample size calculations in trials published as RCTs in orthodontic speciality journals. The performance of sample size calculations was assessed and calculations verified where possible. Related aspects, including number of authors; parallel, split-mouth, or other design; single- or multi-centre study; region of publication; type of data analysis (intention-to-treat or per-protocol basis); and number of participants recruited and lost to follow-up, were considered. Of 139 RCTs identified, complete sample size calculations were reported in 41 studies (29.5 per cent). Parallel designs were typically adopted (n = 113; 81 per cent), with 80 per cent (n = 111) involving two arms and 16 per cent having three arms. Data analysis was conducted on an intention-to-treat (ITT) basis in a small minority of studies (n = 18; 13 per cent). According to the calculations presented, overall, a median of 46 participants were required to demonstrate sufficient power to highlight meaningful differences (typically at a power of 80 per cent). The median number of participants recruited was 60, with a median of 4 participants being lost to follow-up. Our finding indicates good agreement between projected numbers required and those verified (median discrepancy: 5.3 per cent), although only a minority of trials (29.5 per cent) could be examined. Although sample size calculations are often reported in trials published as RCTs in orthodontic speciality journals, presentation is suboptimal and in need of significant improvement.

Timing of bacterial carriage sampling in vaccine trials: A modelling study.

BACKGROUND Pathogenic bacteria are often asymptomatically carried in the nasopharynx. Bacterial carriage can be reduced by vaccination and has been used as an alternative endpoint to clinical disease in randomised controlled trials (RCTs). Vaccine efficacy (VE) is usually calculated as 1 minus a measure of effect. Estimates of vaccine efficacy from cross-sectional carriage data collected in RCTs are usually based on prevalence odds ratios (PORs) and prevalence ratios (PRs), but it is unclear when these should be measured. METHODS We developed dynamic compartmental transmission models simulating RCTs of a vaccine against a carried pathogen to investigate how VE can best be estimated from cross-sectional carriage data, at which time carriage should optimally be assessed, and to which factors this timing is most sensitive. In the models, vaccine could change carriage acquisition and clearance rates (leaky vaccine); values for these effects were explicitly defined (facq, 1/fdur). POR and PR were calculated from model outputs. Models differed in infection source: other participants or external sources unaffected by the trial. Simulations using multiple vaccine doses were compared to empirical data. RESULTS The combined VE against acquisition and duration calculated using POR (VEˆacq.dur, (1-POR)×100) best estimates the true VE (VEacq.dur, (1-facq×fdur)×100) for leaky vaccines in most scenarios. The mean duration of carriage was the most important factor determining the time until VEˆacq.dur first approximates VEacq.dur: if the mean duration of carriage is 1-1.5 months, up to 4 months are needed; if the mean duration is 2-3 months, up to 8 months are needed. Minor differences were seen between models with different infection sources. In RCTs with shorter intervals between vaccine doses it takes longer after the last dose until VEˆacq.dur approximates VEacq.dur. CONCLUSION The timing of sample collection should be considered when interpreting vaccine efficacy against bacterial carriage measured in RCTs.

Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study.

OBJECTIVE: To investigate the prevalence of discontinuation and nonpublication of surgical versus medical randomized controlled trials (RCTs) and to explore risk factors for discontinuation and nonpublication of surgical RCTs. BACKGROUND: Trial discontinuation has significant scientific, ethical, and economic implications. To date, the prevalence of discontinuation of surgical RCTs is unknown. METHODS: All RCT protocols approved between 2000 and 2003 by 6 ethics committees in Canada, Germany, and Switzerland were screened. Baseline characteristics were collected and, if published, full reports retrieved. Risk factors for early discontinuation for slow recruitment and nonpublication were explored using multivariable logistic regression analyses. RESULTS: In total, 863 RCT protocols involving adult patients were identified, 127 in surgery (15%) and 736 in medicine (85%). Surgical trials were discontinued for any reason more often than medical trials [43% vs 27%, risk difference 16% (95% confidence interval [CI]: 5%-26%); P = 0.001] and more often discontinued for slow recruitment [18% vs 11%, risk difference 8% (95% CI: 0.1%-16%); P = 0.020]. The percentage of trials not published as full journal article was similar in surgical and medical trials (44% vs 40%, risk difference 4% (95% CI: -5% to 14%); P = 0.373). Discontinuation of surgical trials was a strong risk factor for nonpublication (odds ratio = 4.18, 95% CI: 1.45-12.06; P = 0.008). CONCLUSIONS: Discontinuation and nonpublication rates were substantial in surgical RCTs and trial discontinuation was strongly associated with nonpublication. These findings need to be taken into account when interpreting surgical literature. Surgical trialists should consider feasibility studies before embarking on full-scale trials.

The Prevention of Delirium and Complications Associated with Surgical Treatments (PODCAST) study: protocol for an international multicentre randomised controlled trial

INTRODUCTION Postoperative delirium is one of the most common complications of major surgery, affecting 10-70% of surgical patients 60 years and older. Delirium is an acute change in cognition that manifests as poor attention and illogical thinking and is associated with longer intensive care unit (ICU) and hospital stay, long-lasting cognitive deterioration and increased mortality. Ketamine has been used as an anaesthetic drug for over 50 years and has an established safety record. Recent research suggests that, in addition to preventing acute postoperative pain, a subanaesthetic dose of intraoperative ketamine could decrease the incidence of postoperative delirium as well as other neurological and psychiatric outcomes. However, these proposed benefits of ketamine have not been tested in a large clinical trial. METHODS The Prevention of Delirium and Complications Associated with Surgical Treatments (PODCAST) study is an international, multicentre, randomised controlled trial. 600 cardiac and major non-cardiac surgery patients will be randomised to receive ketamine (0.5 or 1 mg/kg) or placebo following anaesthetic induction and prior to surgical incision. For the primary outcome, blinded observers will assess delirium on the day of surgery (postoperative day 0) and twice daily from postoperative days 1-3 using the Confusion Assessment Method or the Confusion Assessment Method for the ICU. For the secondary outcomes, blinded observers will estimate pain using the Behavioral Pain Scale or the Behavioral Pain Scale for Non-Intubated Patients and patient self-report. ETHICS AND DISSEMINATION The PODCAST trial has been approved by the ethics boards of five participating institutions; approval is ongoing at other sites. Recruitment began in February 2014 and will continue until the end of 2016. Dissemination plans include presentations at scientific conferences, scientific publications, stakeholder engagement and popular media. REGISTRATION DETAILS The study is registered at clinicaltrials.gov, NCT01690988 (last updated March 2014). The PODCAST trial is being conducted under the auspices of the Neurological Outcomes Network for Surgery (NEURONS). TRIAL REGISTRATION NUMBER NCT01690988 (last updated December 2013).

Blind intubation of anaesthetised children with supraglottic airway devices AmbuAura-i and Air-Q cannot be recommended: A randomised controlled trial.

BACKGROUND Paediatric supraglottic airway devices AmbuAura-i and Air-Q were designed as conduits for tracheal intubation. Although fibreoptic-guided intubation has proved successful, blind intubation as a rescue technique has never been evaluated. OBJECTIVE Evaluation of blind intubation through AmbuAura-i and Air-Q. On the basis of fibreoptic view data, we hypothesised that the success rate with the AmbuAura-i would be higher than with the Air-Q. DESIGN A prospective, randomised controlled trial with institutional review board (IRB) approval and written informed consent. SETTING University Childrens' Hospital; September 2012 to July 2014. PATIENTS Eighty children, American Society of Anesthesiologists (ASA) class I to III, weight 5 to 50 kg. INTERVENTIONS Tracheal intubation was performed through the randomised device with the tip of a fibrescope placed inside and proximal to the tip of the tracheal tube. This permitted sight of tube advancement, but without fibreoptic guidance (visualised blind intubation). MAIN OUTCOME MEASURES Primary outcome was successfully visualised blind intubation; secondary outcomes included supraglottic airway device success, insertion times, airway leak pressure, fibreoptic view and adverse events. RESULTS Personal data did not differ between groups. In contrast to our hypothesis, blind intubation was possible in 15% with the Air-Q and in 3% with the AmbuAura-i [95% confidence interval (95% CI) 6 to 31 vs. 0 to 13%; P = 0.057]. First attempt supraglottic airway device insertion success rates were 95% (Air-Q) and 100% (AmbuAura-i; 95% CI 83 to 99 vs. 91 to 100; P = 0.49). Median leak pressures were 18 cmH2O (Air-Q) and 17 cmH2O [AmbuAura-i; interquartile range (IQR) 14 to 18 vs. 14 to 19 cmH2O; P = 0.66]. Air-Q insertion was slower (27 vs. 19 s, P < 0.001). There was no difference in fibreoptic view, or adverse events (P > 0.05). In one child (Air-Q size 1.5, tube size 3.5), the tube dislocated during device removal. CONCLUSION Ventilation with both devices is reliable, but success of blind intubation is unacceptably low and cannot be recommended for elective or rescue purposes. If intubation through a paediatric supraglottic airway device is desired, we suggest that fibreoptic guidance is used. TRIAL REGISTRATION Clinicaltrials.gov identifier: NCT01692522.

What is the influence of randomisation sequence generation and allocation concealment on treatment effects of physical therapy trials? A meta-epidemiological study.

OBJECTIVE To determine if adequacy of randomisation and allocation concealment is associated with changes in effect sizes (ES) when comparing physical therapy (PT) trials with and without these methodological characteristics. DESIGN Meta-epidemiological study. PARTICIPANTS A random sample of randomised controlled trials (RCTs) included in meta-analyses in the PT discipline were identified. INTERVENTION Data extraction including assessments of random sequence generation and allocation concealment was conducted independently by two reviewers. To determine the association between sequence generation, and allocation concealment and ES, a two-level analysis was conducted using a meta-meta-analytic approach. PRIMARY AND SECONDARY OUTCOME MEASURES association between random sequence generation and allocation concealment and ES in PT trials. RESULTS 393 trials included in 43 meta-analyses, analysing 44 622 patients contributed to this study. Adequate random sequence generation and appropriate allocation concealment were accomplished in only 39.7% and 11.5% of PT trials, respectively. Although trials with inappropriate allocation concealment tended to have an overestimate treatment effect when compared with trials with adequate concealment of allocation, the difference was non-statistically significant (ES=0.12; 95% CI -0.06 to 0.30). When pooling our results with those of Nuesch et al, we obtained a pooled statistically significant value (ES=0.14; 95% CI 0.02 to 0.26). There was no difference in ES in trials with appropriate or inappropriate random sequence generation (ES=0.02; 95% CI -0.12 to 0.15). CONCLUSIONS Our results suggest that when evaluating risk of bias of primary RCTs in PT area, systematic reviewers and clinicians implementing research into practice should pay attention to these biases since they could exaggerate treatment effects. Systematic reviewers should perform sensitivity analysis including trials with low risk of bias in these domains as primary analysis and/or in combination with less restrictive analyses. Authors and editors should make sure that allocation concealment and random sequence generation are properly reported in trial reports.