Reporting quality of abstracts of randomized controlled trials published in dental specialty journals

OBJECTIVES A widespread assessment of the reporting of RCT abstracts published in dental journals is lacking. Our aim was to investigate the quality of reporting of abstracts published in leading dental specialty journals using, as a guide, the CONSORT for abstracts checklist. METHODS Electronic and supplementary hand searching were undertaken to identify RCTs published in seven dental specialty journals. The quality of abstract reporting was evaluated using a modified checklist based on the CONSORT for abstracts checklist. Descriptive statistics followed by univariate and multivariate analyses were conducted. RESULTS 228 RCT abstracts were identified. Reporting of interventions, objectives and conclusions within abstracts were adequate. Inadequately reported items included: title, participants, outcomes, random number generation, numbers randomized and effect size estimate. Randomization restrictions, allocation concealment, blinding, numbers analyzed, confidence intervals, intention-to-treat analysis, harms, registration and funding were rarely described. CONCLUSIONS The mean overall reporting quality score was suboptimal at 62.5% (95% CI: 61.9, 63.0). Significantly better abstract reporting was noted in certain specialty journals and in multicenter trials.

Myth creation in textbook writing : the case of randomised controlled trials in medical research

Textbooks, across all disciplines, are prone to contain errors; grammatical, editorial, factual, or judgemental. The following is an account of one of the possible effects of such errors; how an error becomes entrenched and even exaggerated as later textbooks fail to correct the original error. The example considered here concerns the origins of one of the most basic and important tools of to­ day's medical research, the randomised controlled trial. It is the result of a systematic study of 26 British, French and German history of medicine textbooks since 1996.

Is paromomycin an effective and safe treatment against cutaneous leishmaniasis? A meta-analysis of 14 randomized controlled trials.

BACKGROUND: High cost, poor compliance, and systemic toxicity have limited the use of pentavalent antimony compounds (SbV), the treatment of choice for cutaneous leishmaniasis (CL). Paromomycin (PR) has been developed as an alternative to SbV, but existing data are conflicting. METHODOLOGY/PRINCIPAL FINDINGS: We searched PubMed, Scopus, and Cochrane Central Register of Controlled Trials, without language restriction, through August 2007, to identify randomized controlled trials that compared the efficacy or safety between PR and placebo or SbV. Primary outcome was clinical cure, defined as complete healing, disappearance, or reepithelialization of all lesions. Data were extracted independently by two investigators, and pooled using a random-effects model. Fourteen trials including 1,221 patients were included. In placebo-controlled trials, topical PR appeared to have therapeutic activity against the old world and new world CL, with increased local reactions, when used with methylbenzethonium chloride (MBCL) compared to when used alone (risk ratio [RR] for clinical cure, 2.58 versus 1.01: RR for local reactions, 1.60 versus 1.07). In SbV-controlled trials, the efficacy of topical PR was not significantly different from that of intralesional SbV in the old world CL (RR, 0.70; 95% confidence interval, 0.26-1.89), whereas topical PR was inferior to parenteral SbV in treating the new world CL (0.67; 0.54-0.82). No significant difference in efficacy was found between parenteral PR and parenteral SbV in the new world CL (0.88; 0.56-1.38). Systemic side effects were fewer with topical or parenteral PR than parenteral SbV. CONCLUSIONS/SIGNIFICANCE: Topical PR with MBCL could be a therapeutic alternative to SbV in selected cases of the old world CL. Development of new formulations with better efficacy and tolerability remains to be an area of future research.

The Alexander Technique and musicians: a systematic review of controlled trials

BACKGROUND: Musculoskeletal disorders, stress and performance anxiety are common in musicians. Therefore, some use the Alexander Technique (AT), a psycho-physical method that helps to release unnecessary muscle tension and re-educates non-beneficial movement patterns through intentional inhibition of unwanted habitual behaviours. According to a recent review AT sessions may be effective for chronic back pain. This review aimed to evaluate the evidence for the effectiveness of AT sessions on musicians' performance, anxiety, respiratory function and posture. METHODS: The following electronic databases were searched up to February 2014 for relevant publications: PUBMED, Google Scholar, CINAHL, EMBASE, AMED, PsycINFO and RILM. The search criteria were "Alexander Technique" AND "music*". References were searched, and experts and societies of AT or musicians' medicine contacted for further publications. RESULTS: 237 citations were assessed. 12 studies were included for further analysis, 5 of which were randomised controlled trials (RCTs), 5 controlled but not randomised (CTs), and 2 mixed methods studies. Main outcome measures in RCTs and CTs were music performance, respiratory function, performance anxiety, body use and posture. Music performance was judged by external experts and found to be improved by AT in 1 of 3 RCTs; in 1 RCT comparing neurofeedback (NF) to AT, only NF caused improvements. Respiratory function was investigated in 2 RCTs, but not improved by AT training. Performance anxiety was mostly assessed by questionnaires and decreased by AT in 2 of 2 RCTs and in 2 of 2 CTs. CONCLUSIONS: A variety of outcome measures have been used to investigate the effectiveness of AT sessions in musicians. Evidence from RCTs and CTs suggests that AT sessions may improve performance anxiety in musicians. Effects on music performance, respiratory function and posture yet remain inconclusive. Future trials with well-established study designs are warranted to further and more reliably explore the potential of AT in the interest of musicians.

The reporting quality of randomized controlled trials in orthodontics.

OBJECTIVES Accurate trial reporting facilitates evaluation and better use of study results. The objective of this article is to investigate the quality of reporting of randomized controlled trials (RCTs) in leading orthodontic journals, and to explore potential predictors of improved reporting. METHODS The 50 most recent issues of 4 leading orthodontic journals until November 2013 were electronically searched. Reporting quality assessment was conducted using the modified CONSORT statement checklist. The relationship between potential predictors and the modified CONSORT score was assessed using linear regression modeling. RESULTS 128 RCTs were identified with a mean modified CONSORT score of 68.97% (SD = 11.09). The Journal of Orthodontics (JO) ranked first in terms of completeness of reporting (modified CONSORT score 76.21%, SD = 10.1), followed by American Journal of Orthodontics and Dentofacial Orthopedics (AJODO) (73.05%, SD = 10.1). Journal of publication (AJODO: β = 10.08, 95% CI: 5.78, 14.38; JO: β = 16.82, 95% CI: 11.70, 21.94; EJO: β = 7.21, 95% CI: 2.69, 11.72 compared to Angle), year of publication (β = 0.98, 95% CI: 0.28, 1.67 for each additional year), region of authorship (Europe: β = 5.19, 95% CI: 1.30, 9.09 compared to Asia/other), statistical significance (significant: β = 3.10, 95% CI: 0.11, 6.10 compared to non-significant) and methodologist involvement (involvement: β = 5.60, 95% CI: 1.66, 9.54 compared to non-involvement) were all significant predictors of improved modified CONSORT scores in the multivariable model. Additionally, median overall Jadad score was 2 (IQR = 2) across journals, with JO (median = 3, IQR = 1) and AJODO (median = 3, IQR = 2) presenting the highest score values. CONCLUSION The reporting quality of RCTs published in leading orthodontic journals is considered suboptimal in various CONSORT areas. This may have a bearing in trial result interpretation and use in clinical decision making and evidence- based orthodontic treatment interventions.

Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology.

AIM Abstracts of randomized clinical trials are extremely important as trial appraisal is often based on the information included here. The objective of this study was to assess the quality of the reporting of RCT abstracts in journals of Oral Implantology. MATERIAL AND METHODS Six leading Implantology journals were screened for RCTs between years 2008 and 2012. A 21-item modified CONSORT for abstracts checklist was used to examine the completeness of abstract reporting. Descriptive statistics and linear regression modeling were employed for data analysis. RESULTS One hundred and sixty three RCT abstracts were included in this study. The majority of the RCTs were published in the Clinical Oral Implants Research (42.9%). The mean overall reporting quality score was 58.6% (95% CI: 57.6-59.7). The highest score was noted in the European Journal of Oral Implantology (63.8%; 95% CI: 61.8-65.8). Multivariate analysis demonstrated that abstract quality score was related to publication journal and number of research centers involved. Most abstracts adequately reported interventions (89.0%), objectives (77.9%) and conclusions (74.8%) while failed to report randomization procedures, allocation concealment, effect estimate, confidence intervals, and funding. Registration of RCTs was not reported in any of the abstracts. CONCLUSIONS The reporting quality in abstracts of RCTs published in Oral Implantology journals needs to be improved. Editors and authors should be encouraged to endorse the CONSORT for abstracts guidelines in order to achieve optimal quality in abstract reporting.

Sample size in orthodontic randomized controlled trials: are numbers justified?

Sample size calculations are advocated by the Consolidated Standards of Reporting Trials (CONSORT) group to justify sample sizes in randomized controlled trials (RCTs). This study aimed to analyse the reporting of sample size calculations in trials published as RCTs in orthodontic speciality journals. The performance of sample size calculations was assessed and calculations verified where possible. Related aspects, including number of authors; parallel, split-mouth, or other design; single- or multi-centre study; region of publication; type of data analysis (intention-to-treat or per-protocol basis); and number of participants recruited and lost to follow-up, were considered. Of 139 RCTs identified, complete sample size calculations were reported in 41 studies (29.5 per cent). Parallel designs were typically adopted (n = 113; 81 per cent), with 80 per cent (n = 111) involving two arms and 16 per cent having three arms. Data analysis was conducted on an intention-to-treat (ITT) basis in a small minority of studies (n = 18; 13 per cent). According to the calculations presented, overall, a median of 46 participants were required to demonstrate sufficient power to highlight meaningful differences (typically at a power of 80 per cent). The median number of participants recruited was 60, with a median of 4 participants being lost to follow-up. Our finding indicates good agreement between projected numbers required and those verified (median discrepancy: 5.3 per cent), although only a minority of trials (29.5 per cent) could be examined. Although sample size calculations are often reported in trials published as RCTs in orthodontic speciality journals, presentation is suboptimal and in need of significant improvement.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications.

OBJECTIVE To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study.

OBJECTIVE: To investigate the prevalence of discontinuation and nonpublication of surgical versus medical randomized controlled trials (RCTs) and to explore risk factors for discontinuation and nonpublication of surgical RCTs. BACKGROUND: Trial discontinuation has significant scientific, ethical, and economic implications. To date, the prevalence of discontinuation of surgical RCTs is unknown. METHODS: All RCT protocols approved between 2000 and 2003 by 6 ethics committees in Canada, Germany, and Switzerland were screened. Baseline characteristics were collected and, if published, full reports retrieved. Risk factors for early discontinuation for slow recruitment and nonpublication were explored using multivariable logistic regression analyses. RESULTS: In total, 863 RCT protocols involving adult patients were identified, 127 in surgery (15%) and 736 in medicine (85%). Surgical trials were discontinued for any reason more often than medical trials [43% vs 27%, risk difference 16% (95% confidence interval [CI]: 5%-26%); P = 0.001] and more often discontinued for slow recruitment [18% vs 11%, risk difference 8% (95% CI: 0.1%-16%); P = 0.020]. The percentage of trials not published as full journal article was similar in surgical and medical trials (44% vs 40%, risk difference 4% (95% CI: -5% to 14%); P = 0.373). Discontinuation of surgical trials was a strong risk factor for nonpublication (odds ratio = 4.18, 95% CI: 1.45-12.06; P = 0.008). CONCLUSIONS: Discontinuation and nonpublication rates were substantial in surgical RCTs and trial discontinuation was strongly associated with nonpublication. These findings need to be taken into account when interpreting surgical literature. Surgical trialists should consider feasibility studies before embarking on full-scale trials.

Reporting quality of randomised controlled trials published in prosthodontic and implantology journals

The purpose of this study was to examine the reporting quality of randomised controlled trials (RCTs) published in prosthodontic and implantology journals. Thirty issues of nine journals in prosthodontics and implant dentistry were searched for RCTs, covering the years 2005-2012: The Journal of Prosthetic Dentistry, Journal of Oral Rehabilitation, The International Journal of Prosthodontics, The International Journal of Periodontics & Restorative Dentistry, Clinical Oral Implants Research, Clinical Implant Dentistry & Related Research, The International Journal of Oral & Maxillofacial Implants, Implant Dentistry and Journal of Dentistry. The reporting quality was assessed using a modified Consolidated Standards of Reporting Trials (CONSORT) statement checklist. Data were analysed using descriptive statistics followed by univariable and multivariable examination of statistical associations (α = 0·05). A total of 147 RCTs were identified with a mean CONSORT score of 69·4 (s.d. = 9·7). Significant differences were found among journals with the Journal of Oral Rehabilitation achieving the highest score (80·6, s.d. = 5·5) followed by Clinical Oral Implants Research (73·7, s.d. = 8·3). Involvement of a statistician/methodologist was significantly associated with increased CONSORT scores. Overall, the reporting quality of RCTs in major prosthodontic and implantology journals requires improvement. This is of paramount importance considering that optimal reporting of RCTs is an important prerequisite for clinical decision-making.

Clinical effectiveness of cognitive behavioral therapy for depression in routine care: A propensity score based comparison between randomized controlled trials and clinical practice

Background: The efficacy of cognitive behavioral therapy (CBT) for the treatment of depressive disorders has been demonstrated in many randomized controlled trials (RCTs). This study investigated whether for CBT similar effects can be expected under routine care conditions when the patients are comparable to those examined in RCTs. Method: N=574 CBT patients from an outpatient clinic were stepwise matched to the patients undergoing CBT in the National Institute of Mental Health Treatment of Depression Collaborative Research Program (TDCRP). First, the exclusion criteria of the RCT were applied to the naturalistic sample of the outpatient clinic. Second, propensity score matching (PSM) was used to adjust the remaining naturalistic sample on the basis of baseline covariate distributions. Matched samples were then compared regarding treatment effects using effect sizes, average treatment effect on the treated (ATT) and recovery rates. Results: CBT in the adjusted naturalistic subsample was as effective as in the RCT. However, treatments lasted significantly longer under routine care conditions. Limitations: The samples included only a limited amount of common predictor variables and stemmed from different countries. There might be additional covariates, which could potentially further improve the matching between the samples. Conclusions: CBT for depression in clinical practice might be equally effective as manual-based treatments in RCTs when they are applied to comparable patients. The fact that similar effects under routine conditions were reached with more sessions, however, points to the potential to optimize treatments in clinical practice with respect to their efficiency.

A systematic review of community-based colorectal cancer screening randomized controlled trials with multi-ethnic groups

Background. The CDC estimates that 40% of adults 50 years of age or older do not receive time-appropriate colorectal cancer screening. Sixty percent of colorectal cancer deaths could be prevented by regular screening of adults 50 years of age and older. Yet, in 2000 only 42.5% of adults age 50 or older in the U.S. had received recommended screening. Disparities by health care, nativity status, socioeconomic status, and race/ethnicity are evident. Disparities in minority, underserved populations prevent us from attaining Goal 2 of Healthy People 2010 to “eliminate health disparities.” This review focuses on community-based screening research among underserved populations that includes multiple ethnic groups for appropriate disparities analysis. There is a gap in the colorectal cancer screening literature describing the effectiveness of community-based randomized controlled trials. ^ Objective. To critically review the literature describing community-based colorectal cancer screening strategies that are randomized controlled trials, and that include multiple racial/ethnic groups. ^ Methods. The review includes a preliminary disparities analysis to assess whether interventions were appropriately targeted in communities to those groups experiencing the greatest health disparities. Review articles are from an original search using Ovid Medline and a cross-matching search in Pubmed, both from January 2001 to June 2009. The Ovid Medline literature review is divided into eight exclusionary stages, seven electronic, and the last stage consisting of final manual review. ^ Results. The final studies (n=15) are categorized into four categories: Patient mailings (n=3), Telephone outreach (n=3), Electronic/multimedia (n=4), and Counseling/community education (n=5). Of 15 studies, 11 (73%) demonstrated that screening rates increased for the intervention group compared to controls, including all studies (100%) from the Patient mailings and Telephone outreach groups, 4 of 5 (80%) Counseling/community education studies, and 1 of 4 (25%) Electronic/multimedia interventions. ^ Conclusions. Patient choice and tailoring education and/or messages to individuals have proven to be two important factors in improving colorectal cancer screening adherence rates. Technological strategies have not been overly successful with underserved populations in community-based trials. Based on limited findings to date, future community-based colorectal cancer screening trials should include diverse populations who are experiencing incidence, survival, mortality and screening disparities. ^