Cohort study of trials submitted to ethics committee identified discrepant reporting of outcomes in publications

OBJECTIVES To identify factors associated with discrepant outcome reporting in randomized drug trials. STUDY DESIGN AND SETTING Cohort study of protocols submitted to a Swiss ethics committee 1988-1998: 227 protocols and amendments were compared with 333 matching articles published during 1990-2008. Discrepant reporting was defined as addition, omission, or reclassification of outcomes. RESULTS Overall, 870 of 2,966 unique outcomes were reported discrepantly (29.3%). Among protocol-defined primary outcomes, 6.9% were not reported (19 of 274), whereas 10.4% of reported outcomes (30 of 288) were not defined in the protocol. Corresponding percentages for secondary outcomes were 19.0% (284 of 1,495) and 14.1% (334 of 2,375). Discrepant reporting was more likely if P values were <0.05 compared with P ≥ 0.05 [adjusted odds ratio (aOR): 1.38; 95% confidence interval (CI): 1.07, 1.78], more likely for efficacy compared with harm outcomes (aOR: 2.99; 95% CI: 2.08, 4.30) and more likely for composite than for single outcomes (aOR: 1.48; 95% CI: 1.00, 2.20). Cardiology (aOR: 2.34; 95% CI: 1.44, 3.79) and infectious diseases (aOR: 1.77; 95% CI: 1.01, 3.13) had more discrepancies compared with all specialties combined. CONCLUSION Discrepant reporting was associated with statistical significance of results, type of outcome, and specialty area. Trial protocols should be made freely available, and the publications should describe and justify any changes made to protocol-defined outcomes.

Reporting quality of systematic review abstracts in leading oral implantology journals

OBJECTIVES Abstracts of systematic reviews are of critical importance, as consumers of research often do not access the full text. This study aimed to assess the reporting quality of systematic review (SR) abstracts in leading oral implantology journals. METHODS Six specialty journals were screened for SRs between 2008 and 2012. A 16-item checklist, based on the PRISMA statement, was used to examine the completeness of abstract reporting. RESULTS Ninety-three SR abstracts were included in this study. The majority were published in Clinical Oral Implants Research (43%). The mean overall reporting quality score was 72.5% (95% CI: 70.8-74.2). Most abstracts were structured (97.9%), adequately reporting objectives (97.9%) and conclusions (93.6%). Conversely, inadequate reporting of methods of the study, background (79.6%), appraisal (65.6%), and data synthesis (65.6%) were observed. Registration of reviews was not reported in any of the included abstracts. Multivariate analysis revealed no difference in reporting quality with respect to continent, number of authors, or meta-analysis conduct. CONCLUSIONS The results of this study suggest that the reporting quality of systematic review abstracts in implantology journals requires further improvement. CLINICAL SIGNIFICANCE Better reporting of SR abstracts is particularly important in ensuring the reliability of research findings, ultimately promoting the practice of evidence-based dentistry. Optimal reporting of SR abstracts should be encouraged, preferably by endorsing the PRISMA for abstracts guidelines.

Reporting completeness of abstracts of systematic reviews published in leading dental specialty journals

The aim of this study was to investigate the reporting completeness of systematic review (SR) abstracts in leading dental specialty journals. Electronic and supplementary hand searching were undertaken to identify SRs published in seven dental specialty journals and in the Cochrane Database of Systematic Reviews. Abstract reporting completeness was evaluated using a checklist derived from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (prisma) guidelines. Descriptive statistics followed by univariate and multivariate analyses were conducted. Two-hundred and eighteen SR abstracts were identified. Reporting of interventions (94%), objectives (96%), data sources (81%), eligibility criteria (77%), and conclusions (97%) was adequate in the majority of reviews. However, inadequate reporting of participants (18%), results (42%), effect size (14%), level of significance (60%), and trial registration (100%) was commonplace. The mean overall reporting score was 79.1% (95% CI, 77.6-80.6). Only journal of publication was a significant predictor of overall reporting, with inferior results for all journals relative to Cochrane reviews, with scores ranging from -4.3% (95% CI, -8.74 to 0.08) to -35.6% (95% CI, -42.0 to -24.3) for the International Journal of Prosthodontics and the British Journal of Oral and Maxillofacial Surgery, respectively. Improved reporting of dental SR abstracts is needed and should be encouraged, as these abstracts may underpin influential clinical decisions.

Reporting quality of abstracts of randomized controlled trials published in dental specialty journals

OBJECTIVES A widespread assessment of the reporting of RCT abstracts published in dental journals is lacking. Our aim was to investigate the quality of reporting of abstracts published in leading dental specialty journals using, as a guide, the CONSORT for abstracts checklist. METHODS Electronic and supplementary hand searching were undertaken to identify RCTs published in seven dental specialty journals. The quality of abstract reporting was evaluated using a modified checklist based on the CONSORT for abstracts checklist. Descriptive statistics followed by univariate and multivariate analyses were conducted. RESULTS 228 RCT abstracts were identified. Reporting of interventions, objectives and conclusions within abstracts were adequate. Inadequately reported items included: title, participants, outcomes, random number generation, numbers randomized and effect size estimate. Randomization restrictions, allocation concealment, blinding, numbers analyzed, confidence intervals, intention-to-treat analysis, harms, registration and funding were rarely described. CONCLUSIONS The mean overall reporting quality score was suboptimal at 62.5% (95% CI: 61.9, 63.0). Significantly better abstract reporting was noted in certain specialty journals and in multicenter trials.

Cluster randomized clinical trials in orthodontics: design, analysis and reporting issues

Cluster randomized trials (CRTs) use as the unit of randomization clusters, which are usually defined as a collection of individuals sharing some common characteristics. Common examples of clusters include entire dental practices, hospitals, schools, school classes, villages, and towns. Additionally, several measurements (repeated measurements) taken on the same individual at different time points are also considered to be clusters. In dentistry, CRTs are applicable as patients may be treated as clusters containing several individual teeth. CRTs require certain methodological procedures during sample calculation, randomization, data analysis, and reporting, which are often ignored in dental research publications. In general, due to similarity of the observations within clusters, each individual within a cluster provides less information compared with an individual in a non-clustered trial. Therefore, clustered designs require larger sample sizes compared with non-clustered randomized designs, and special statistical analyses that account for the fact that observations within clusters are correlated. It is the purpose of this article to highlight with relevant examples the important methodological characteristics of cluster randomized designs as they may be applied in orthodontics and to explain the problems that may arise if clustered observations are erroneously treated and analysed as independent (non-clustered).

Cancer, meta-analysis and reporting biases: the case of erythropoiesis-stimulating agents.

Reporting and publication bias is a well-known problem in meta-analysis and healthcare research. In 2002 we conducted a meta-analysis on the effects of erythropoiesis-stimulating agents (ESAs) on overall survival in cancer patients, which suggested some evidence for improved survival in patients receiving ESAs compared with controls. However, a meta-analysis of individual patient data conducted several years later showed the opposite of our first meta-analysis, that is, evidence for increased on-study mortality and reduced overall survival in cancer patients receiving ESAs. We aimed to determine whether the results of our first meta-analysis could have been affected by publication and reporting biases and, if so, whether timely access to clinical study reports and individual patient data could have prevented this. We conducted a hypothetical meta-analysis for overall survival including all studies and study data that could have been available in 2002, at the time when we conducted our first meta-analysis. Compared with our original meta-analysis, which suggested an overall survival benefit for cancer patients receiving ESAs [hazard ratio (HR) 0.81, 95% confidence interval (CI) 0.67‒0.99], our hypothetical meta-analysis based on the results of all studies conducted at the time of the first analysis did not show evidence for a beneficial effect of ESAs on overall survival (HR 0.97, 95% CI 0.83‒1.12). Thus we have to conclude that our first meta-analysis showed misleading overall survival benefits due to publication and reporting biases, which could have been prevented by timely access to clinical study reports and individual patient data. Unrestricted access to clinical study protocols including amendments, clinical study reports and individual patient data is needed to ensure timely detection of both beneficial and harmful effects of healthcare interventions.

Empfehlungen zur Diagnostik und Therapie der behavioralen und psychologischen Symptome der Demenz (BPSD)

In patients with dementia, Behavioral and Psychological Symptoms of Dementia (BPSD) are frequent findings that accompany deficits caused by cognitive impairment and thus complicate diagnostics, therapy and care. BPSD are a burden both for affected individuals as well as care-givers, and represent a significant challenge for therapy of a patient population with high degree of multi-morbidity. The goal of this therapy-guideline issued by swiss professional associations is to present guidance regarding therapy of BPSD as attendant symptoms in dementia, based on evidence as well as clinical experience. Here it appears to be of particular importance to take into account professional experience, as at this point for most therapeutic options no sufficiently controlled clinical trials are available. A critical discussion of pharmaco-therapeutic intervention is necessary, as this patient-population is particularly vulnerable for medication side-effects. Finally, a particular emphasis is placed on incorporating and systematically reporting psycho-social and nursing options therapeutic intervention.

Current practice in neuropsychological outcome reporting after aneurysmal subarachnoid haemorrhage

BACKGROUND Neuropsychological deficits (NPD) are common in patients with aneurysmal subarachnoid haemorrhage (aSAH). NPD are one of the major limiting factors for patients with an otherwise acceptable prognosis for sustained quality of life. There are only a few studies reporting outcome after aSAH, which used a standardized neuropsychological test battery as a primary or secondary outcome measure. Aim of this study was to determine the current practice of reporting NPD following aSAH in clinical studies. METHODS A MEDLINE analysis was performed using the search term "subarachnoid haemorrhage outcome". The latest 1,000 articles were screened. We recorded study design, number of patients, and the presence of neuropsychological outcome report. Additionally, the time of testing after aSAH, the neuropsychological tests administered, as well as the percentage of patients with NPD were analyzed. RESULTS A total of 324 publications between 2009 and 2012 were selected for further review. Of those, 21 studies (6.5%) reported neuropsychological outcome, in 2,001 of 346,666 patients (0.6%). The assessment of NPD differed broadly using both subjective and objective cognitive evaluation, and a large variety of tests were used. CONCLUSION Neuropsychological outcome is underreported, and there is great variety in assessment in currently published clinical articles on aSAH. Prospective randomized trials treating aSAH may benefit from implementing more comprehensive and standardized neuropsychological outcome measures. This approach might identify otherwise unnoticed treatment effects in future interventional studies of aSAH patients.

Critical incidence reporting systems - an option in equine anaesthesia? Results from a panel meeting.

OBJECTIVE To provide a brief introduction into Critical Incident Reporting Systems (CIRS) as used in human medicine, and to report the discussion from a recent panel meeting discussion with 23 equine anaesthetists in preparation for a new CEPEF-4 (Confidential Enquiry into Perioperative Equine Fatalities) study. STUDY DESIGN Moderated group discussions, and review of literature. METHODS The first group discussion focused on the definition of 'preventable critical incidents' and/or 'near misses' in the context of equine anaesthesia. The second group discussion focused on categorizing critical incidents according to an established framework for analysing risk and safety in clinical medicine. RESULTS While critical incidents do occur in equine anaesthesia, no critical incident reporting system including systematic collection and analysis of critical incidents is in place. CONCLUSIONS AND CLINICAL RELEVANCE Critical incident reporting systems could be used to improve safety in equine anaesthesia - in addition to other study types such as mortality studies.

Strengthening the Reporting of Molecular Epidemiology for Infectious Diseases (STROME-ID): an extension of the STROBE statement

Molecular data are now widely used in epidemiological studies to investigate the transmission, distribution, biology, and diversity of pathogens. Our objective was to establish recommendations to support good scientific reporting of molecular epidemiological studies to encourage authors to consider specific threats to valid inference. The statement Strengthening the Reporting of Molecular Epidemiology for Infectious Diseases (STROME-ID) builds upon the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) initiative. The STROME-ID statement was developed by a working group of epidemiologists, statisticians, bioinformaticians, virologists, and microbiologists with expertise in control of infection and communicable diseases. The statement focuses on issues relating to the reporting of epidemiological studies of infectious diseases using molecular data that were not addressed by STROBE. STROME-ID addresses terminology, measures of genetic diversity within pathogen populations, laboratory methods, sample collection, use of molecular markers, molecular clocks, timeframe, multiple-strain infections, non-independence of infectious-disease data, missing data, ascertainment bias, consistency between molecular and epidemiological data, and ethical considerations with respect to infectious-disease research. In total, 20 items were added to the 22 item STROBE checklist. When used, the STROME-ID recommendations should advance the quality and transparency of scientific reporting, with clear benefits for evidence reviews and health-policy decision making.

Development, implementation, and evaluation of a structured reporting web tool for abdominal aortic aneurysms

BACKGROUND The majority of radiological reports are lacking a standard structure. Even within a specialized area of radiology, each report has its individual structure with regards to details and order, often containing too much of non-relevant information the referring physician is not interested in. For gathering relevant clinical key parameters in an efficient way or to support long-term therapy monitoring, structured reporting might be advantageous. OBJECTIVE Despite of new technologies in medical information systems, medical reporting is still not dynamic. To improve the quality of communication in radiology reports, a new structured reporting system was developed for abdominal aortic aneurysms (AAA), intended to enhance professional communication by providing the pertinent clinical information in a predefined standard. METHODS Actual state analysis was performed within the departments of radiology and vascular surgery by developing a Technology Acceptance Model. The SWOT (strengths, weaknesses, opportunities, and threats) analysis focused on optimization of the radiology reporting of patients with AAA. Definition of clinical parameters was achieved by interviewing experienced clinicians in radiology and vascular surgery. For evaluation, a focus group (4 radiologists) looked at the reports of 16 patients. The usability and reliability of the method was validated in a real-world test environment in the field of radiology. RESULTS A Web-based application for radiological "structured reporting" (SR) was successfully standardized for AAA. Its organization comprises three main categories: characteristics of pathology and adjacent anatomy, measurements, and additional findings. Using different graphical widgets (eg, drop-down menus) in each category facilitate predefined data entries. Measurement parameters shown in a diagram can be defined for clinical monitoring and be adducted for quick adjudications. Figures for optional use to guide and standardize the reporting are embedded. Analysis of variance shows decreased average time required with SR to obtain a radiological report compared to free-text reporting (P=.0001). Questionnaire responses confirm a high acceptance rate by the user. CONCLUSIONS The new SR system may support efficient radiological reporting for initial diagnosis and follow-up for AAA. Perceived advantages of our SR platform are ease of use, which may lead to more accurate decision support. The new system is open to communicate not only with clinical partners but also with Radiology Information and Hospital Information Systems.

Swiss national guideline for reimbursement of enzyme replacement therapy in late-onset Pompe disease.

Glycogen storage disease type II is a rare multi-systemic disorder characterised by an intracellular accumulation of glycogen due a mutation in the acid alpha glucosidase (GAA) gene. The level of residual enzyme activity, the genotype and other yet unknown factors account for the broad variation of the clinical phenotype. The classical infantile form is characterised by severe muscle hypotonia and cardiomyopathy leading to early death. The late-onset form presents as a limb girdle myopathy with or without pulmonary dysfunction. Enzyme replacement therapy (ERT) with recombinant human GAA (rhGAA) in infants is life saving. In contrast, therapeutic efficacy of rhGAA in the late-onset form is modest. High expenses of rhGAA, on-going infusions and poor pharmacokinetic efficacy raised a discussion of the cost effectiveness of ERT in late-onset Pompe disease in Switzerland. This discussion was triggered by a Swiss federal court ruling which confirmed the reluctance of a health care insurer not to reimburse treatment costs in a 67-year-old female suffering from Pompe disease. As a consequence of this judgement ERT was stopped by all insurance companies in late-onset Pompe patients in Switzerland regardless of their clinical condition. Subsequent negotiations lead to the release of a national guideline of the management of late-onset Pompe disease. Initiation and limitation of ERT is outlined in a national Pompe registry. Reimbursement criteria are defined and individual efficacy of ERT with rhGAA is continuously monitored.

The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting observational studies

Much biomedical research is observational. The reporting of such research is often inadequate, which hampers the assessment of its strengths and weaknesses and of a study's generalisability. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Initiative developed recommendations on what should be included in an accurate and complete report of an observational study. We defined the scope of the recommendations to cover three main study designs: cohort, case-control, and cross-sectional studies. We convened a 2-day workshop in September 2004, with methodologists, researchers, and journal editors to draft a checklist of items. This list was subsequently revised during several meetings of the coordinating group and in e-mail discussions with the larger group of STROBE contributors, taking into account empirical evidence and methodological considerations. The workshop and the subsequent iterative process of consultation and revision resulted in a checklist of 22 items (the STROBE Statement) that relate to the title, abstract, introduction, methods, results, and discussion sections of articles. 18 items are common to all three study designs and four are specific for cohort, case-control, or cross-sectional studies. A detailed Explanation and Elaboration document is published separately and is freely available on the Web sites of PLoS Medicine, Annals of Internal Medicine, and Epidemiology. We hope that the STROBE Statement will contribute to improving the quality of reporting of observational studies.