Time relevance, citation of reporting guidelines, and breadth of literature search in systematic reviews in orthodontics

INTRODUCTION As the importance of systematic review (SR) conclusions relies upon the scientific rigor of methods and the currency of evidence, we aimed to investigate the currency of orthodontic SRs using as proxy the time from the initial search to publication. Additionally, SR information regarding reporting guidelines, registration, and literature searches were recorded when available. MATERIALS AND METHODS A systematic PubMed search was carried out using the Clinical Queries page to identify orthodontic SRs cited between 1 January 2008 and 7 November 2013. Data related to reporting guidelines, review registration, dates of review processing, literature search, and abstract reporting were retrieved and classified by journal type. Survival analysis was used to assess the time to reach predefined manuscript stages for orthodontic and non-orthodontic journals. RESULTS One hundred twenty seven of the originally identified 585 SRs were considered eligible. The median interval from search until publication was 13.2 months (interquartile range: IQR = 9.7 months) irrespective of the journal type. There was evidence (P = 0.05) that SRs published by non-orthodontic journals appeared in PubMed faster than in orthodontic journals (non-orthodontic: median = 6.5 months; IQR = 5.7 months; orthodontic: median = 10.2 months; IQR = 5.6 months) from submission to publication and from acceptance to publication (non-orthodontic: median = 1.5 months; IQR = 2.4 months; orthodontic: median = 6.0 months; IQR = 6.2 months; P < 0.001). More than half of these SRs did not cite adherence to any reporting guidelines, whereas all but five studies were not prospectively registered. Search of unpublished research was undertaken in approximately 21 per cent and 29 per cent of the SRs published in non-orthodontic and orthodontic periodicals, respectively. CONCLUSIONS This study indicates that SR users should be aware that median time for orthodontic SRs from search to publication is 13.2 months. SRs published in non-orthodontic journals are likely to be more current in terms of submission until time to publication and acceptance until time to publication compared with those published in orthodontic journals.

The evidence from systematic reviews and meta-analyses published in orthodontic literature. Where do we stand?

AIM To analyse meta-analyses included in systematic reviews (SRs) published in leading orthodontic journals and the Cochrane Database of Systematic Reviews (CDSR) focusing on orthodontic literature and to assess the quality of the existing evidence. MATERIALS AND METHODS Electronic searching was undertaken to identify SRs published in five major orthodontic journals and the CDSR between January 2000 and June 2014. Quality assessment of the overall body of evidence from meta-analyses was conducted using the Grading of Recommendations Assessment, Development and Evaluation working group (GRADE) tool. RESULTS One hundred and fifty-seven SRs were identified; meta-analysis was present in 43 of these (27.4 per cent). The highest proportion of SRs that included a meta-analysis was found in Orthodontics and Craniofacial Research (6/13; 46.1 per cent), followed by the CDSR (12/33; 36.4 per cent) and the American Journal of Orthodontics and Dentofacial Orthopaedics (15/44; 34.1 per cent). Class II treatment was the most commonly addressed topic within SRs in orthodontics (n = 18/157; 11.5 per cent). The number of trials combined to produce a summary estimate was small for most meta-analyses with a median of 4 (range: 2-52). Only 21 per cent (n = 9) of included meta-analyses were considered to have a high/moderate quality of evidence according to GRADE, while the majority were of low or very low quality (n = 34; 79.0 per cent). CONCLUSIONS Overall, approximately one quarter of orthodontic SRs included quantitative synthesis, with a median of four trials per meta-analysis. The overall quality of evidence from the selected orthodontic SRs was predominantly low to very low indicating the relative lack of high quality of evidence from SRs to inform clinical practice guidelines.