An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

Individual patient data meta-analysis of diagnostic and prognostic studies in obstetrics, gynaecology and reproductive medicine

BACKGROUND: In clinical practice a diagnosis is based on a combination of clinical history, physical examination and additional diagnostic tests. At present, studies on diagnostic research often report the accuracy of tests without taking into account the information already known from history and examination. Due to this lack of information, together with variations in design and quality of studies, conventional meta-analyses based on these studies will not show the accuracy of the tests in real practice. By using individual patient data (IPD) to perform meta-analyses, the accuracy of tests can be assessed in relation to other patient characteristics and allows the development or evaluation of diagnostic algorithms for individual patients. In this study we will examine these potential benefits in four clinical diagnostic problems in the field of gynaecology, obstetrics and reproductive medicine. METHODS/DESIGN: Based on earlier systematic reviews for each of the four clinical problems, studies are considered for inclusion. The first authors of the included studies will be invited to participate and share their original data. After assessment of validity and completeness the acquired datasets are merged. Based on these data, a series of analyses will be performed, including a systematic comparison of the results of the IPD meta-analysis with those of a conventional meta-analysis, development of multivariable models for clinical history alone and for the combination of history, physical examination and relevant diagnostic tests and development of clinical prediction rules for the individual patients. These will be made accessible for clinicians. DISCUSSION: The use of IPD meta-analysis will allow evaluating accuracy of diagnostic tests in relation to other relevant information. Ultimately, this could increase the efficiency of the diagnostic work-up, e.g. by reducing the need for invasive tests and/or improving the accuracy of the diagnostic workup. This study will assess whether these benefits of IPD meta-analysis over conventional meta-analysis can be exploited and will provide a framework for future IPD meta-analyses in diagnostic and prognostic research.

Quantitative Myocardial Contrast Echocardiography during Pharmacological Stress for Diagnosis of Coronary Artery Disease: A Systematic Review and Meta-analysis of Diagnostic Accuracy Studies

AIMS: We conducted a meta-analysis to evaluate the accuracy of quantitative stress myocardial contrast echocardiography (MCE) in coronary artery disease (CAD). METHODS AND RESULTS: Database search was performed through January 2008. We included studies evaluating accuracy of quantitative stress MCE for detection of CAD compared with coronary angiography or single-photon emission computed tomography (SPECT) and measuring reserve parameters of A, beta, and Abeta. Data from studies were verified and supplemented by the authors of each study. Using random effects meta-analysis, we estimated weighted mean difference (WMD), likelihood ratios (LRs), diagnostic odds ratios (DORs), and summary area under curve (AUC), all with 95% confidence interval (CI). Of 1443 studies, 13 including 627 patients (age range, 38-75 years) and comparing MCE with angiography (n = 10), SPECT (n = 1), or both (n = 2) were eligible. WMD (95% CI) were significantly less in CAD group than no-CAD group: 0.12 (0.06-0.18) (P < 0.001), 1.38 (1.28-1.52) (P < 0.001), and 1.47 (1.18-1.76) (P < 0.001) for A, beta, and Abeta reserves, respectively. Pooled LRs for positive test were 1.33 (1.13-1.57), 3.76 (2.43-5.80), and 3.64 (2.87-4.78) and LRs for negative test were 0.68 (0.55-0.83), 0.30 (0.24-0.38), and 0.27 (0.22-0.34) for A, beta, and Abeta reserves, respectively. Pooled DORs were 2.09 (1.42-3.07), 15.11 (7.90-28.91), and 14.73 (9.61-22.57) and AUCs were 0.637 (0.594-0.677), 0.851 (0.828-0.872), and 0.859 (0.842-0.750) for A, beta, and Abeta reserves, respectively. CONCLUSION: Evidence supports the use of quantitative MCE as a non-invasive test for detection of CAD. Standardizing MCE quantification analysis and adherence to reporting standards for diagnostic tests could enhance the quality of evidence in this field.

Reporting standards for studies of diagnostic test accuracy in dementia: The STARDdem Initiative.

OBJECTIVE To provide guidance on standards for reporting studies of diagnostic test accuracy for dementia disorders. METHODS An international consensus process on reporting standards in dementia and cognitive impairment (STARDdem) was established, focusing on studies presenting data from which sensitivity and specificity were reported or could be derived. A working group led the initiative through 4 rounds of consensus work, using a modified Delphi process and culminating in a face-to-face consensus meeting in October 2012. The aim of this process was to agree on how best to supplement the generic standards of the STARD statement to enhance their utility and encourage their use in dementia research. RESULTS More than 200 comments were received during the wider consultation rounds. The areas at most risk of inadequate reporting were identified and a set of dementia-specific recommendations to supplement the STARD guidance were developed, including better reporting of patient selection, the reference standard used, avoidance of circularity, and reporting of test-retest reliability. CONCLUSION STARDdem is an implementation of the STARD statement in which the original checklist is elaborated and supplemented with guidance pertinent to studies of cognitive disorders. Its adoption is expected to increase transparency, enable more effective evaluation of diagnostic tests in Alzheimer disease and dementia, contribute to greater adherence to methodologic standards, and advance the development of Alzheimer biomarkers.

PICADAR: a diagnostic predictive tool for primary ciliary dyskinesia.

Symptoms of primary ciliary dyskinesia (PCD) are nonspecific and guidance on whom to refer for testing is limited. Diagnostic tests for PCD are highly specialised, requiring expensive equipment and experienced PCD scientists. This study aims to develop a practical clinical diagnostic tool to identify patients requiring testing.Patients consecutively referred for testing were studied. Information readily obtained from patient history was correlated with diagnostic outcome. Using logistic regression, the predictive performance of the best model was tested by receiver operating characteristic curve analyses. The model was simplified into a practical tool (PICADAR) and externally validated in a second diagnostic centre.Of 641 referrals with a definitive diagnostic outcome, 75 (12%) were positive. PICADAR applies to patients with persistent wet cough and has seven predictive parameters: full-term gestation, neonatal chest symptoms, neonatal intensive care admittance, chronic rhinitis, ear symptoms, situs inversus and congenital cardiac defect. Sensitivity and specificity of the tool were 0.90 and 0.75 for a cut-off score of 5 points. Area under the curve for the internally and externally validated tool was 0.91 and 0.87, respectively.PICADAR represents a simple diagnostic clinical prediction rule with good accuracy and validity, ready for testing in respiratory centres referring to PCD centres.

Epidemiological characteristics and diagnostic approach in patients admitted to the emergency room for transient loos of consciousness: Group for Syncope Study in the Emergency Room (GESINUR) study

Aims: To assess the clinical presentation and acute management of patients with transient loss of consciousness (T-LOC) in the emergency department (ED). Methods and results: A multi-centre prospective observational study was carried out in 19 Spanish hospitals over 1 month. The patients included were 14 years old and were admitted to the ED because of an episode of T-LOC. Questionnaires and corresponding electrocardiograms (ECGs) were reviewed by a Steering Committee (SC) to unify diagnostic criteria, evaluate adherence to guidelines, and diagnose correctly the ECGs. We included 1419 patients (prevalence, 1.14%).ECG was performed in 1335 patients (94%) in the ED: 498 (37.3%) ECGs were classified as abnormal. The positive diagnostic yield ranged from 0% for the chest X-ray to 12% for the orthostatic test. In the ED, 1217 (86%) patients received a final diagnosis of syncope, whereas the remaining 202 (14%) were diagnosed of non-syncopal transient lossof consciousness (NST-LOC). After final review by the SC, 1080 patients (76%) were diagnosed of syncope, whereas 339 (24%) were diagnosed of NST-LOC (P , 0.001). Syncope was diagnosed correctly in 84% of patients. Only 25% of patients with T-LOC were admitted to hospitals. Conclusion Adherence to clinical guidelines for syncope management was low; many diagnostic tests were performed with low diagnostic yield. Important differences were observed between syncope diagnoses at the ED and by SC decision.

Lichtheimia Infection in a Lymphoma Patient: Case Report and a Brief Review of the Available Diagnostic Tools

We describe the case of a patient with a T-lymphoblastic lymphoma whose disseminated mucormycosis was diagnosed with delay, and we address the diagnostic and therapeutic decision-making process and review the diagnostic workup of patients with potential IFD. The diagnosis was delayed despite a suggestive radiological presentation of the patient's pulmonary lesion. The uncommon risk profile (T-lymphoblastic lymphoma, short neutropenic phases) wrongly led to a low level of suspicion. The diagnosis was also hampered by the lack of indirect markers for infections caused by Mucorales, the low sensitivity of both fungal culture and panfungal PCR, and the limited availability of species-specific PCR. A high level of suspicion of IFD is needed, and aggressive diagnostic procedures should be promptly initiated even in apparently low-risk patients with uncommon presentations. The extent of the analytical workup should be decided on a case-by-case base. Diagnostic tests such as the galactomannan and β-D-glucan test and/or PCR on biological material followed by sequencing should be chosen according to their availability and after evaluation of their specificity and sensitivity. In high-risk patients, preemptive therapy with a broad-spectrum mould-active antifungal agent should be started before definitive diagnostic findings become available.

Evaluation of diagnostic analysis and test equipment for small automotive repair establishments. A report to the Congress.

Mode of access: Internet.

Fuel economy improvement through diagnostic inspection. Technical report.

Mode of access: Internet.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Executive summary. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Volume 1 - technical report. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Volume 2 - appendix A: evaluation of the measurement performance of inspection equipment in the five demonstration projects and in selected repair agencies. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Volume 5 - appendix D: orientation seminars. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Volume 7 - appendix F: fuel economy evaluation. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Diagnostic motor vehicle inspection demonstration projects, program engineering support. Volume 9 - appendix H: vehicle designs that facilitate or hinder inspection and repair and interchangeability and interface capability of test equipment and vehicles. Final report.

National Highway Traffic Safety Administration, Washington, D.C.