Assessment of publication bias in dental specialty journals

OBJECTIVE: The purpose of this study was to investigate the presence of publication bias (acceptance of articles indicating statistically significant results). METHODS: The journals possessing the highest impact factor (2008 data) in each dental specialty were included in the study. The content of the 6 most recent issues of each journal was hand searched and research articles were classified into 4 type categories: cross-sectional, case-control, cohort, and interventional (nonrandomized clinical trials and randomized controlled trials). In total, 396 articles were included in the analysis. Descriptive statistics and univariate and multivariate logistic regression was used to examine the association between article-reported statistical significance (dependent variable) and journal impact factor and article study type subject area (independent variables). RESULTS: A statistically significant acceptance rate of positive result was found, ranging from 75% to 90%, whereas the value of impact factor was not related to publication bias among leading dental journals. Compared with other research designs, clinical intervention studies (randomized or nonrandomized) presented the highest percentage of nonsignificant findings (20%); RCTs represented 6% of the examined investigations. CONCLUSIONS: Compared with the Journal of Clinical Periodontology, all other subspecialty journals, except the Journal of Oral and Maxillofacial Surgery, showed significantly decreased odds of publishing an RCT, which ranged from 60% to 93% (P < .05).

Reporting of research quality characteristics of studies published in 6 major clinical dental specialty journals

The objective of this article was to record reporting characteristics related to study quality of research published in major specialty dental journals with the highest impact factor (Journal of Endodontics, Journal of Oral and Maxillofacial Surgery, American Journal of Orthodontics and Dentofacial Orthopedics; Pediatric Dentistry, Journal of Clinical Periodontology, and International Journal of Prosthetic Dentistry). The included articles were classified into the following 3 broad subject categories: (1) cross-sectional (snap-shot), (2) observational, and (3) interventional. Multinomial logistic regression was conducted for effect estimation using the journal as the response and randomization, sample calculation, confounding discussed, multivariate analysis, effect measurement, and confidence intervals as the explanatory variables. The results showed that cross-sectional studies were the dominant design (55%), whereas observational investigations accounted for 13%, and interventions/clinical trials for 32%. Reporting on quality characteristics was low for all variables: random allocation (15%), sample size calculation (7%), confounding issues/possible confounders (38%), effect measurements (16%), and multivariate analysis (21%). Eighty-four percent of the published articles reported a statistically significant main finding and only 13% presented confidence intervals. The Journal of Clinical Periodontology showed the highest probability of including quality characteristics in reporting results among all dental journals.

Parochialism or self-consciousness? Internationality in medical history journals 1997-2006

Research councils, universities and funding agencies are increasingly asking for tools to measure the quality of research in the humanities. One of their preferred methods is a ranking of journals according to their supposed level of internationality. Our quantitative survey of seventeen major journals of medical history reveals the futility of such an approach. Most journals have a strong national character with a dominance of native language, authors and topics. The most common case is a paper written by a local author in his own language on a national subject regarding the nineteenth or twentieth century. American and British journals are taken notice of internationally but they only rarely mention articles from other history of medicine journals. Continental European journals show a more international review of literature, but are in their turn not noticed globally. Increasing specialisation and fragmentation has changed the role of general medical history journals. They run the risk of losing their function as international platforms of discourse on general and theoretical issues and major trends in historiography, to international collections of papers. Journal editors should therefore force their authors to write a more international report, and authors should be encouraged to submit papers of international interest and from a more general, transnational and methodological point of view.

Reporting quality of abstracts of randomized controlled trials published in leading orthodontic journals from 2006 to 2011

Optimal reporting of randomized trials and abstracts enhances transparency and facilitates assessment and identification of trials. The purpose of this study was to investigate the quality of reporting of abstracts of randomized controlled trials published in orthodontic journals.

Mislabeling controlled clinical trials (CCTs) as "randomized clinical trials (RCTs)" in dental specialty journals

This study aimed to investigate whether studies published in dental journals with the highest impact factor, representing the 5 major dental specialties and titled as randomized clinical trials (RCTs) are truly RCTs. A second objective was to explore the association of journal type and other publication characteristics on correct classification.

Reporting of randomized controlled trials in Hodgkin lymphoma in biomedical journals

BACKGROUND: Randomized controlled trials (RCTs) are the best tool to evaluate the effectiveness of clinical interventions. The Consolidated Standards for Reporting Trials (CONSORT) statement was introduced in 1996 to improve reporting of RCTs. We aimed to determine the extent of ambiguity and reporting quality as assessed by adherence to the CONSORT statement in published reports of RCTs involving patients with Hodgkin lymphoma from 1966 through 2002. METHODS: We analyzed 242 published full-text reports of RCTs in patients with Hodgkin lymphoma. Quality of reporting was assessed using a 14-item questionnaire based on the CONSORT checklist. Reporting was studied in two pre-CONSORT periods (1966-1988 and 1989-1995) and one post-CONSORT period (1996-2002). RESULTS: Only six of the 14 items were addressed in 75% or more of the studies in all three time periods. Most items that are necessary to assess the methodologic quality of a study were reported by fewer than 20% of the studies. Improvements over time were seen for some items, including the description of statistics methods used, reporting of primary research outcomes, performance of power calculations, method of randomization and concealment allocation, and having performed intention-to-treat analysis. CONCLUSIONS: Despite recent improvements, reporting levels of CONSORT items in RCTs involving patients with Hodgkin lymphoma remain unsatisfactory. Further concerted action by journal editors, learned societies, and medical schools is necessary to make authors even more aware of the need to improve the reporting RCTs in medical journals to allow assessment of validity of published clinical research.

Bibliographic study showed improving methodology of meta-analyses published in leading journals 1993-2002

OBJECTIVE: To assess the methodology of meta-analyses published in leading general and specialist medical journals over a 10-year period. STUDY DESIGN AND SETTING: Volumes 1993-2002 of four general medicine journals and four specialist journals were searched by hand for meta-analyses including at least five controlled trials. Characteristics were assessed using a standardized questionnaire. RESULTS: A total of 272 meta-analyses, which included a median of 11 trials (range 5-195), were assessed. Most (81%) were published in general medicine journals. The median (range) number of databases searched increased from 1 (1-9) in 1993/1994 to 3.5 (1-21) in 2001/2002, P<0.0001. The proportion of meta-analyses including searches by hand (10% in 1993/1994, 25% in 2001/2002, P=0.005), searches of the grey literature (29%, 51%, P=0.010 by chi-square test), and of trial registers (10%, 32%, P=0.025) also increased. Assessments of the quality of trials also became more common (45%, 70%, P=0.008), including whether allocation of patients to treatment groups had been concealed (24%, 60%, P=0.001). The methodological and reporting quality was consistently higher in general medicine compared to specialist journals. CONCLUSION: Many meta-analyses published in leading journals have important methodological limitations. The situation has improved in recent years but considerable room for further improvements remains.

Reporting quality of systematic review abstracts in leading oral implantology journals

OBJECTIVES Abstracts of systematic reviews are of critical importance, as consumers of research often do not access the full text. This study aimed to assess the reporting quality of systematic review (SR) abstracts in leading oral implantology journals. METHODS Six specialty journals were screened for SRs between 2008 and 2012. A 16-item checklist, based on the PRISMA statement, was used to examine the completeness of abstract reporting. RESULTS Ninety-three SR abstracts were included in this study. The majority were published in Clinical Oral Implants Research (43%). The mean overall reporting quality score was 72.5% (95% CI: 70.8-74.2). Most abstracts were structured (97.9%), adequately reporting objectives (97.9%) and conclusions (93.6%). Conversely, inadequate reporting of methods of the study, background (79.6%), appraisal (65.6%), and data synthesis (65.6%) were observed. Registration of reviews was not reported in any of the included abstracts. Multivariate analysis revealed no difference in reporting quality with respect to continent, number of authors, or meta-analysis conduct. CONCLUSIONS The results of this study suggest that the reporting quality of systematic review abstracts in implantology journals requires further improvement. CLINICAL SIGNIFICANCE Better reporting of SR abstracts is particularly important in ensuring the reliability of research findings, ultimately promoting the practice of evidence-based dentistry. Optimal reporting of SR abstracts should be encouraged, preferably by endorsing the PRISMA for abstracts guidelines.

Reporting completeness of abstracts of systematic reviews published in leading dental specialty journals

The aim of this study was to investigate the reporting completeness of systematic review (SR) abstracts in leading dental specialty journals. Electronic and supplementary hand searching were undertaken to identify SRs published in seven dental specialty journals and in the Cochrane Database of Systematic Reviews. Abstract reporting completeness was evaluated using a checklist derived from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (prisma) guidelines. Descriptive statistics followed by univariate and multivariate analyses were conducted. Two-hundred and eighteen SR abstracts were identified. Reporting of interventions (94%), objectives (96%), data sources (81%), eligibility criteria (77%), and conclusions (97%) was adequate in the majority of reviews. However, inadequate reporting of participants (18%), results (42%), effect size (14%), level of significance (60%), and trial registration (100%) was commonplace. The mean overall reporting score was 79.1% (95% CI, 77.6-80.6). Only journal of publication was a significant predictor of overall reporting, with inferior results for all journals relative to Cochrane reviews, with scores ranging from -4.3% (95% CI, -8.74 to 0.08) to -35.6% (95% CI, -42.0 to -24.3) for the International Journal of Prosthodontics and the British Journal of Oral and Maxillofacial Surgery, respectively. Improved reporting of dental SR abstracts is needed and should be encouraged, as these abstracts may underpin influential clinical decisions.

Reporting quality of abstracts of randomized controlled trials published in dental specialty journals

OBJECTIVES A widespread assessment of the reporting of RCT abstracts published in dental journals is lacking. Our aim was to investigate the quality of reporting of abstracts published in leading dental specialty journals using, as a guide, the CONSORT for abstracts checklist. METHODS Electronic and supplementary hand searching were undertaken to identify RCTs published in seven dental specialty journals. The quality of abstract reporting was evaluated using a modified checklist based on the CONSORT for abstracts checklist. Descriptive statistics followed by univariate and multivariate analyses were conducted. RESULTS 228 RCT abstracts were identified. Reporting of interventions, objectives and conclusions within abstracts were adequate. Inadequately reported items included: title, participants, outcomes, random number generation, numbers randomized and effect size estimate. Randomization restrictions, allocation concealment, blinding, numbers analyzed, confidence intervals, intention-to-treat analysis, harms, registration and funding were rarely described. CONCLUSIONS The mean overall reporting quality score was suboptimal at 62.5% (95% CI: 61.9, 63.0). Significantly better abstract reporting was noted in certain specialty journals and in multicenter trials.

Are clustering effects accounted for in statistical analysis in leading dental specialty journals?

OBJECTIVES In dental research multiple site observations within patients or taken at various time intervals are commonplace. These clustered observations are not independent; statistical analysis should be amended accordingly. This study aimed to assess whether adjustment for clustering effects during statistical analysis was undertaken in five specialty dental journals. METHODS Thirty recent consecutive issues of Orthodontics (OJ), Periodontology (PJ), Endodontology (EJ), Maxillofacial (MJ) and Paediatric Dentristry (PDJ) journals were hand searched. Articles requiring adjustment accounting for clustering effects were identified and statistical techniques used were scrutinized. RESULTS Of 559 studies considered to have inherent clustering effects, adjustment for this was made in the statistical analysis in 223 (39.1%). Studies published in the Periodontology specialty accounted for clustering effects in the statistical analysis more often than articles published in other journals (OJ vs. PJ: OR=0.21, 95% CI: 0.12, 0.37, p<0.001; MJ vs. PJ: OR=0.02, 95% CI: 0.00, 0.07, p<0.001; PDJ vs. PJ: OR=0.14, 95% CI: 0.07, 0.28, p<0.001; EJ vs. PJ: OR=0.11, 95% CI: 0.06, 0.22, p<0.001). A positive correlation was found between increasing prevalence of clustering effects in individual specialty journals and correct statistical handling of clustering (r=0.89). CONCLUSIONS The majority of studies in 5 dental specialty journals (60.9%) examined failed to account for clustering effects in statistical analysis where indicated, raising the possibility of inappropriate decreases in p-values and the risk of inappropriate inferences.

Cochrane and non-Cochrane systematic reviews in leading orthodontic journals: a quality paradigm?

The aims of this study were to assess and compare the methodological quality of Cochrane and non-Cochrane systematic reviews (SRs) published in leading orthodontic journals and the Cochrane Database of Systematic Reviews (CDSR) using AMSTAR and to compare the prevalence of meta-analysis in both review types. A literature search was undertaken to identify SRs that consisted of hand-searching five major orthodontic journals [American Journal of Orthodontics and Dentofacial Orthopedics, Angle Orthodontist, European Journal of Orthodontics, Journal of Orthodontics and Orthodontics and Craniofacial Research (February 2002 to July 2011)] and the Cochrane Database of Systematic Reviews from January 2000 to July 2011. Methodological quality of the included reviews was gauged using the AMSTAR tool involving 11 key methodological criteria with a score of 0 or 1 given for each criterion. A cumulative grade was given for the paper overall (0-11); an overall score of 4 or less represented poor methodological quality, 5-8 was considered fair and 9 or greater was deemed to be good. In total, 109 SRs were identified in the five major journals and on the CDSR. Of these, 26 (23.9%) were in the CDSR. The mean overall AMSTAR score was 6.2 with 21.1% of reviews satisfying 9 or more of the 11 criteria; a similar prevalence of poor reviews (22%) was also noted. Multiple linear regression indicated that reviews published in the CDSR (P < 0.01); and involving meta-analysis (β = 0.50, 95% confidence interval 0.72, 2.07, P < 0.001) showed greater concordance with AMSTAR.

High Incorrect Use of the Standard Error of the Mean (SEM) in Original Articles in Three Cardiovascular Journals Evaluated for 2012.

RATIONALE In biomedical journals authors sometimes use the standard error of the mean (SEM) for data description, which has been called inappropriate or incorrect. OBJECTIVE To assess the frequency of incorrect use of SEM in articles in three selected cardiovascular journals. METHODS AND RESULTS All original journal articles published in 2012 in Cardiovascular Research, Circulation: Heart Failure and Circulation Research were assessed by two assessors for inappropriate use of SEM when providing descriptive information of empirical data. We also assessed whether the authors state in the methods section that the SEM will be used for data description. Of 441 articles included in this survey, 64% (282 articles) contained at least one instance of incorrect use of the SEM, with two journals having a prevalence above 70% and "Circulation: Heart Failure" having the lowest value (27%). In 81% of articles with incorrect use of SEM, the authors had explicitly stated that they use the SEM for data description and in 89% SEM bars were also used instead of 95% confidence intervals. Basic science studies had a 7.4-fold higher level of inappropriate SEM use (74%) than clinical studies (10%). LIMITATIONS The selection of the three cardiovascular journals was based on a subjective initial impression of observing inappropriate SEM use. The observed results are not representative for all cardiovascular journals. CONCLUSION In three selected cardiovascular journals we found a high level of inappropriate SEM use and explicit methods statements to use it for data description, especially in basic science studies. To improve on this situation, these and other journals should provide clear instructions to authors on how to report descriptive information of empirical data.