Sample sizes of studies on diagnostic accuracy: literature survey

OBJECTIVES: To determine sample sizes in studies on diagnostic accuracy and the proportion of studies that report calculations of sample size. DESIGN: Literature survey. DATA SOURCES: All issues of eight leading journals published in 2002. METHODS: Sample sizes, number of subgroup analyses, and how often studies reported calculations of sample size were extracted. RESULTS: 43 of 8999 articles were non-screening studies on diagnostic accuracy. The median sample size was 118 (interquartile range 71-350) and the median prevalence of the target condition was 43% (27-61%). The median number of patients with the target condition--needed to calculate a test's sensitivity--was 49 (28-91). The median number of patients without the target condition--needed to determine a test's specificity--was 76 (27-209). Two of the 43 studies (5%) reported a priori calculations of sample size. Twenty articles (47%) reported results for patient subgroups. The number of subgroups ranged from two to 19 (median four). No studies reported that sample size was calculated on the basis of preplanned analyses of subgroups. CONCLUSION: Few studies on diagnostic accuracy report considerations of sample size. The number of participants in most studies on diagnostic accuracy is probably too small to analyse variability of measures of accuracy across patient subgroups.

Diagnostic accuracy of coronary in-stent restenosis using 64-slice computed tomography: comparison with invasive coronary angiography

OBJECTIVES: This study sought to evaluate the diagnostic accuracy of coronary binary in-stent restenosis (ISR) with angiography using 64-slice multislice computed tomography coronary angiography (CTCA) compared with invasive coronary angiography (ICA). BACKGROUND: A noninvasive detection of ISR would result in an easier and safer way to conduct patient follow-up. METHODS: We performed CTCA in 81 patients after stent implantation, and 125 stented lesions were scanned. Two sets of images were reconstructed with different types of convolution kernels. On CTCA, neointimal proliferation was visually evaluated according to luminal contrast attenuation inside the stent. Lesions were graded as follows: grade 1, none or slight neointimal proliferation; grade 2, neointimal proliferation with no significant stenosis (<50%); grade 3, neointimal proliferation with moderate stenosis (> or =50%); and grade 4, neointimal proliferation with severe stenosis (> or =75%). Grades 3 and 4 were considered binary ISR. The diagnostic accuracy of CTCA compared with ICA was evaluated. RESULTS: By ICA, 24 ISRs were diagnosed. Sensitivity, specificity, positive predictive value, and negative predictive value were 92%, 81%, 54%, and 98% for the overall population, whereas values were 91%, 93%, 77%, and 98% when excluding unassessable segments (15 segments, 12%). For assessable segments, CTCA correctly diagnosed 20 of the 22 ISRs detected by ICA. Six lesions without ISR were overestimated as ISR by CTCA. As the grade of neointimal proliferation by CTCA increases, the median value of percent diameter stenosis increased linearly. CONCLUSIONS: Binary ISR can be excluded with high probability by CTCA, with a moderate rate of false-positive results.

Diagnostic accuracy of 64-slice computed tomography for detecting angiographically significant coronary artery stenosis in an unselected consecutive patient population: comparison with conventional invasive angiography

BACKGROUND: Multislice computed tomography (MSCT) is a promising noninvasive method of detecting coronary artery disease (CAD). However, most data have been obtained in selected series of patients. The purpose of the present study was to investigate the accuracy of 64-slice MSCT (64 MSCT) in daily practice, without any patient selection. METHODS AND RESULTS: Using 64-slice MSCT coronary angiography (CTA), 69 consecutive patients, 39 (57%) of whom had previously undergone stent implantation, were evaluated. The mean heart rate during scan was 72 beats/min, scan time 13.6 s and the amount of contrast media 72 mL. The mean time span between invasive coronary angiography (ICAG) and CTA was 6 days. Significant stenosis was defined as a diameter reduction of > 50%. Of 966 segments, 884 (92%) were assessable. Compared with ICAG, the sensitivity of CTA to diagnose significant stenosis was 90%, specificity 94%, positive predictive value (PPV) 89% and negative predictive value (NPV) 95%. With regard to 58 stented lesions, the sensitivity, specificity, PPV and NPV were 93%, 96%, 87% and 98%, respectively. On the patient-based analysis, the sensitivity, specificity, PPV and NPV of CTA to detect CAD were 98%, 86%, 98% and 86%, respectively. Eighty-two (8%) segments were not assessable because of irregular rhythm, calcification or tachycardia. CONCLUSION: Sixty-four-MSCT has a high accuracy for the detection of significant CAD in an unselected patient population and therefore can be considered as a valuable noninvasive technique.

A unification of models for meta-analysis of diagnostic accuracy studies

Studies of diagnostic accuracy require more sophisticated methods for their meta-analysis than studies of therapeutic interventions. A number of different, and apparently divergent, methods for meta-analysis of diagnostic studies have been proposed, including two alternative approaches that are statistically rigorous and allow for between-study variability: the hierarchical summary receiver operating characteristic (ROC) model (Rutter and Gatsonis, 2001) and bivariate random-effects meta-analysis (van Houwelingen and others, 1993), (van Houwelingen and others, 2002), (Reitsma and others, 2005). We show that these two models are very closely related, and define the circumstances in which they are identical. We discuss the different forms of summary model output suggested by the two approaches, including summary ROC curves, summary points, confidence regions, and prediction regions.

Evaluation of magnetic resonance colonography at 3.0 Tesla regarding diagnostic accuracy and image quality

OBJECTIVES: To assess magnetic resonance (MR)-colonography (MRC) for detection of colorectal lesions using two different T1w three-dimensional (3D)-gradient-recalled echo (GRE)-sequences and integrated parallel data acquisition (iPAT) at a 3.0 Tesla MR-unit. MATERIALS AND METHODS: In this prospective study, 34 symptomatic patients underwent dark lumen MRC at a 3.0 Tesla unit before conventional colonoscopy (CC). After colon distension with tap water, 2 high-resolution T1w 3D-GRE [3-dimensional fast low angle shot (3D-FLASH), iPAT factor 2 and 3D-volumetric interpolated breathhold examination (VIBE), iPAT 3] sequences were acquired without and after bolus injection of gadolinium. Prospective evaluation of MRC was performed. Image quality of the different sequences was assessed qualitatively and quantitatively. The findings of the same day CC served as standard of reference. RESULTS: MRC identified all polyps >5 mm (16 of 16) in size and all carcinomas (4 of 4) correctly. Fifty percent of the small polyps Diagnostic quality was excellent in 94% (384 of 408 colonic segments) using the 3D-FLASH and in 92% (376 of 408) for the VIBE. The 3D-FLASH sequence showed a 3-fold increase in signal-to-noise ratio (8 +/- 3.3 standard deviation (SD) in lesions without contrast enhancement (CE); 24.3 +/- 7.8 SD after CE). For the 3D-VIBE sequence, signal-to-noise ratio doubled in the detected lesions (147 +/- 54 SD without and 292 +/- 168 SD after CE). Although image quality was ranked lower in the VIBE, the image quality score of both sequences showed no statistical significant difference (chi > 0.6). CONCLUSIONS: MRC using 3D-GRE-sequences and iPAT is feasible at 3.0 T-systems. The high-resolution 3D-FLASH was slightly preferred over the 3D-VIBE because of better image quality, although both used sequences showed no statistical significant difference.

Diagnostic accuracy of exercise electrocardiogram in patients with left anterior hemi-block

BACKGROUND: Left anterior hemiblock (LAHB) is the most frequent conduction abnormality, but its impact on the diagnostic accuracy of the exercise ECG has not been studied. The aim of our study was to determine the diagnostic accuracy of ST depression for predicting ischaemia in the presence of LAHB. PATIENTS: Consecutive patients with known or suspected coronary heart disease undergoing exercise ECG and 99mTc-sestamibi single photon emission computed tomography (SPECT) were included in the analysis. Patients with left bundle branch block, with changes in QRS morphology related to myocardial infarction, and patients who had undergone pharmacological stress testing were excluded. RESULTS: Of 1532 patients assessed, 567 patients qualified for the analysis. In 69 patients with LAHB, ECG stress testing had lower sensitivity (38% vs 86%) and lower negative predictive value (82% vs 92%) than in patients with normal baseline ECG. The reduction of sensitivity appeared to be similar in patients with isolated LAHB (n=43), in patients with right bundle branch block (n=39), and with bifascicular block (n=26). In contrast, the positive predictive value of the test was excellent. CONCLUSION: The diagnostic accuracy of the exercise ECG for prediction of ischaemia is reduced in patients with LAHB.

Clinical presentation of celiac disease and the diagnostic accuracy of serologic markers in children

There has been growing recognition of a changing clinical presentation of celiac disease (CD), with the manifestation of milder symptoms. Serologic testing is widely used to screen patients with suspected CD and populations at risk. The aim of this retrospective analysis was to evaluate the clinical presentation of CD in childhood, assess the diagnostic value of serologic tests, and investigate the impact of IgA deficiency on diagnostic accuracy. We evaluated 206 consecutive children with suspected CD on the basis of clinical symptoms and positive serology results. Ninety-four (46%) had biopsy-proven CD. The median age at diagnosis of CD was 6.8 years; 15% of the children were <2 years of age. There was a higher incidence of CD in girls (p = 0.003). Iron deficiency and intestinal complaints were more frequent in children with CD than those without CD (61% vs. 33%, p = 0.0001 and 71% vs. 55%, p = 0.02, respectively), while failure to thrive was less common (35% vs. 53%, p = 0.02). The sensitivity of IgA tissue transglutaminase (IgA-tTG) was 0.98 when including all children and 1.00 after excluding children with selective IgA deficiency. The specificity of IgA-tTG was 0.73 using the recommended cut-off value of 20 IU, and this improved to 0.94 when using a higher cut-off value of 100 IU. All children with CD and relative IgA deficiency (IgA levels that are measurable but below the age reference [n = 8]) had elevated IgA-tTG. In conclusion, CD is frequently diagnosed in school-age children with relatively mild symptoms. The absence of intestinal symptoms does not preclude the diagnosis of CD; many children with CD do not report intestinal symptoms. While the sensitivity of IgA-tTG is excellent, its specificity is insufficient for the diagnostic confirmation of a disease requiring life-long dietary restrictions. Children with negative IgA-tTG and decreased but measurable IgA values are unlikely to have CD.

An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

MR angiography of infrapopliteal arteries in patients with peripheral arterial occlusive disease by using Gadofosveset at 3.0 T: diagnostic accuracy compared with selective DSA

To prospectively compare the diagnostic accuracy of steady-state, high-spatial-resolution magnetic resonance (MR) angiography of the lower leg, performed with a blood pool contrast agent, with selective digital subtraction angiography (DSA) as the reference standard in patients with symptomatic peripheral arterial disease.

Quantitative Myocardial Contrast Echocardiography during Pharmacological Stress for Diagnosis of Coronary Artery Disease: A Systematic Review and Meta-analysis of Diagnostic Accuracy Studies

AIMS: We conducted a meta-analysis to evaluate the accuracy of quantitative stress myocardial contrast echocardiography (MCE) in coronary artery disease (CAD). METHODS AND RESULTS: Database search was performed through January 2008. We included studies evaluating accuracy of quantitative stress MCE for detection of CAD compared with coronary angiography or single-photon emission computed tomography (SPECT) and measuring reserve parameters of A, beta, and Abeta. Data from studies were verified and supplemented by the authors of each study. Using random effects meta-analysis, we estimated weighted mean difference (WMD), likelihood ratios (LRs), diagnostic odds ratios (DORs), and summary area under curve (AUC), all with 95% confidence interval (CI). Of 1443 studies, 13 including 627 patients (age range, 38-75 years) and comparing MCE with angiography (n = 10), SPECT (n = 1), or both (n = 2) were eligible. WMD (95% CI) were significantly less in CAD group than no-CAD group: 0.12 (0.06-0.18) (P < 0.001), 1.38 (1.28-1.52) (P < 0.001), and 1.47 (1.18-1.76) (P < 0.001) for A, beta, and Abeta reserves, respectively. Pooled LRs for positive test were 1.33 (1.13-1.57), 3.76 (2.43-5.80), and 3.64 (2.87-4.78) and LRs for negative test were 0.68 (0.55-0.83), 0.30 (0.24-0.38), and 0.27 (0.22-0.34) for A, beta, and Abeta reserves, respectively. Pooled DORs were 2.09 (1.42-3.07), 15.11 (7.90-28.91), and 14.73 (9.61-22.57) and AUCs were 0.637 (0.594-0.677), 0.851 (0.828-0.872), and 0.859 (0.842-0.750) for A, beta, and Abeta reserves, respectively. CONCLUSION: Evidence supports the use of quantitative MCE as a non-invasive test for detection of CAD. Standardizing MCE quantification analysis and adherence to reporting standards for diagnostic tests could enhance the quality of evidence in this field.

Diagnostic Accuracy of Copeptin in the Differential Diagnosis of the Polyuria-polydipsia Syndrome: A Prospective Multicenter Study

CONTEXT The polyuria-polydipsia syndrome comprises primary polydipsia (PP) and central and nephrogenic diabetes insipidus (DI). Correctly discriminating these entities is mandatory, given that inadequate treatment causes serious complications. The diagnostic "gold standard" is the water deprivation test with assessment of arginine vasopressin (AVP) activity. However, test interpretation and AVP measurement are challenging. OBJECTIVE The objective was to evaluate the accuracy of copeptin, a stable peptide stoichiometrically cosecreted with AVP, in the differential diagnosis of polyuria-polydipsia syndrome. DESIGN, SETTING, AND PATIENTS This was a prospective multicenter observational cohort study from four Swiss or German tertiary referral centers of adults >18 years old with the history of polyuria and polydipsia. MEASUREMENTS A standardized combined water deprivation/3% saline infusion test was performed and terminated when serum sodium exceeded 147 mmol/L. Circulating copeptin and AVP levels were measured regularly throughout the test. Final diagnosis was based on the water deprivation/saline infusion test results, clinical information, and the treatment response. RESULTS Fifty-five patients were enrolled (11 with complete central DI, 16 with partial central DI, 18 with PP, and 10 with nephrogenic DI). Without prior thirsting, a single baseline copeptin level >21.4 pmol/L differentiated nephrogenic DI from other etiologies with a 100% sensitivity and specificity, rendering a water deprivation testing unnecessary in such cases. A stimulated copeptin >4.9 pmol/L (at sodium levels >147 mmol/L) differentiated between patients with PP and patients with partial central DI with a 94.0% specificity and a 94.4% sensitivity. A stimulated AVP >1.8 pg/mL differentiated between the same categories with a 93.0% specificity and a 83.0% sensitivity. LIMITATION This study was limited by incorporation bias from including AVP levels as a diagnostic criterion. CONCLUSION Copeptin is a promising new tool in the differential diagnosis of the polyuria-polydipsia syndrome, and a valid surrogate marker for AVP. Primary Funding Sources: Swiss National Science Foundation, University of Basel.

Diagnostic Accuracy of Full-Body Linear X-Ray Scanning in Multiple Trauma Patients in Comparison to Computed Tomography

Purpose: The purpose of this study was to evaluate the diagnostic accuracy of full-body linear X-ray scanning (LS) in multiple trauma patients in comparison to 128-multislice computed tomography (MSCT). Materials and Methods: 106 multiple trauma patients (female: 33; male: 73) were retrospectively included in this study. All patients underwent LS of the whole body, including extremities, and MSCT covering the neck, thorax, abdomen, and pelvis. The diagnostic accuracy of LS for the detection of fractures of the truncal skeleton and pneumothoraces was evaluated in comparison to MSCT by two observers in consensus. Extremity fractures detected by LS were documented. Results: The overall sensitivity of LS was 49.2 %, the specificity was 93.3 %, the positive predictive value was 91 %, and the negative predictive value was 57.5 %. The overall sensitivity for vertebral fractures was 16.7 %, and the specificity was 100 %. The sensitivity was 48.7 % and the specificity 98.2 % for all other fractures. Pneumothoraces were detected in 12 patients by CT, but not by LS. 40 extremity fractures were detected by LS, of which 4 fractures were dislocated, and 2 were fully covered by MSCT. Conclusion: The diagnostic accuracy of LS is limited in the evaluation of acute trauma of the truncal skeleton. LS allows fast whole-body X-ray imaging, and may be valuable for detecting extremity fractures in trauma patients in addition to MSCT. Key Points: • The overall sensitivity of LS for truncal skeleton injuries in multiple-trauma patients was < 50 %.• The diagnostic reference standard MSCT is the preferred and reliable imaging modality.• LS may be valuable for quick detection of extremity fractures. Citation Format: • Jöres APW., Heverhagen JT, Bonél H et al. Diagnostic Accuracy of Full-Body Linear X-Ray Scanning in Multiple Trauma Patients in Comparison to Computed Tomography. Fortschr Röntgenstr 2016; 188: 163 - 171.

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative

Objective To improve the accuracy and completeness of reporting of studies of diagnostic accuracy, to allow readers to assess the potential for bias in a study, and to evaluate a study's generalisability. Methods The Standards for Reporting of Diagnostic Accuracy (STARD) steering committee searched the literature to identify publications on the appropriate conduct and reporting of diagnostic studies and extracted potential items into an extensive list. Researchers, editors, and members of professional organisations shortened this list during a two day consensus meeting, with the goal of developing a checklist and a generic flow diagram for studies of diagnostic accuracy. Results The search for published guidelines about diagnostic research yielded 33 previously published checklists, from which we extracted a list of 75 potential items. At the consensus meeting, participants shortened the list to a 25 item checklist, by using evidence, whenever available. A prototype of a flow diagram provides information about the method of patient recruitment, the order of test execution, and the numbers of patients undergoing the test under evaluation and the reference standard, or both. Conclusions Evaluation of research depends on complete and accurate reporting. If medical journals adopt the STARD checklist and flow diagram, the quality of reporting of studies of diagnostic accuracy should improve to the advantage of clinicians, researchers, reviewers, journals, and the public.

The STARD statement for reporting studies of diagnostic accuracy: Explanation and elaboration

The quality of reporting of studies of diagnostic accuracy is less than optimal. Complete and accurate reporting is necessary to enable readers to assess the potential for bias in the study and to evaluate the generalisability of the results. A group of scientists and editors has developed the STARD (Standards for Reporting of Diagnostic Accuracy) statement to improve the reporting the quality of reporting of studies of diagnostic accuracy. The statement consists of a checklist of 25 items and flow diagram that authors can use to ensure that all relevant information is present. This explanatory document aims to facilitate the use, understanding and dissemination of the checklist. The document contains a clarification of the meaning, rationale and optimal use of each item on the checklist, as well as a short summary of the available evidence on bias and applicability. The STARD statement, checklist, flowchart and this explanation and elaboration document should be useful resources to improve reporting of diagnostic accuracy studies. Complete and informative reporting can only lead to better decisions in healthcare.