Sample sizes of studies on diagnostic accuracy: literature survey

OBJECTIVES: To determine sample sizes in studies on diagnostic accuracy and the proportion of studies that report calculations of sample size. DESIGN: Literature survey. DATA SOURCES: All issues of eight leading journals published in 2002. METHODS: Sample sizes, number of subgroup analyses, and how often studies reported calculations of sample size were extracted. RESULTS: 43 of 8999 articles were non-screening studies on diagnostic accuracy. The median sample size was 118 (interquartile range 71-350) and the median prevalence of the target condition was 43% (27-61%). The median number of patients with the target condition--needed to calculate a test's sensitivity--was 49 (28-91). The median number of patients without the target condition--needed to determine a test's specificity--was 76 (27-209). Two of the 43 studies (5%) reported a priori calculations of sample size. Twenty articles (47%) reported results for patient subgroups. The number of subgroups ranged from two to 19 (median four). No studies reported that sample size was calculated on the basis of preplanned analyses of subgroups. CONCLUSION: Few studies on diagnostic accuracy report considerations of sample size. The number of participants in most studies on diagnostic accuracy is probably too small to analyse variability of measures of accuracy across patient subgroups.

Diagnostic accuracy of exercise electrocardiogram in patients with left anterior hemi-block

BACKGROUND: Left anterior hemiblock (LAHB) is the most frequent conduction abnormality, but its impact on the diagnostic accuracy of the exercise ECG has not been studied. The aim of our study was to determine the diagnostic accuracy of ST depression for predicting ischaemia in the presence of LAHB. PATIENTS: Consecutive patients with known or suspected coronary heart disease undergoing exercise ECG and 99mTc-sestamibi single photon emission computed tomography (SPECT) were included in the analysis. Patients with left bundle branch block, with changes in QRS morphology related to myocardial infarction, and patients who had undergone pharmacological stress testing were excluded. RESULTS: Of 1532 patients assessed, 567 patients qualified for the analysis. In 69 patients with LAHB, ECG stress testing had lower sensitivity (38% vs 86%) and lower negative predictive value (82% vs 92%) than in patients with normal baseline ECG. The reduction of sensitivity appeared to be similar in patients with isolated LAHB (n=43), in patients with right bundle branch block (n=39), and with bifascicular block (n=26). In contrast, the positive predictive value of the test was excellent. CONCLUSION: The diagnostic accuracy of the exercise ECG for prediction of ischaemia is reduced in patients with LAHB.

Quantitative Myocardial Contrast Echocardiography during Pharmacological Stress for Diagnosis of Coronary Artery Disease: A Systematic Review and Meta-analysis of Diagnostic Accuracy Studies

AIMS: We conducted a meta-analysis to evaluate the accuracy of quantitative stress myocardial contrast echocardiography (MCE) in coronary artery disease (CAD). METHODS AND RESULTS: Database search was performed through January 2008. We included studies evaluating accuracy of quantitative stress MCE for detection of CAD compared with coronary angiography or single-photon emission computed tomography (SPECT) and measuring reserve parameters of A, beta, and Abeta. Data from studies were verified and supplemented by the authors of each study. Using random effects meta-analysis, we estimated weighted mean difference (WMD), likelihood ratios (LRs), diagnostic odds ratios (DORs), and summary area under curve (AUC), all with 95% confidence interval (CI). Of 1443 studies, 13 including 627 patients (age range, 38-75 years) and comparing MCE with angiography (n = 10), SPECT (n = 1), or both (n = 2) were eligible. WMD (95% CI) were significantly less in CAD group than no-CAD group: 0.12 (0.06-0.18) (P < 0.001), 1.38 (1.28-1.52) (P < 0.001), and 1.47 (1.18-1.76) (P < 0.001) for A, beta, and Abeta reserves, respectively. Pooled LRs for positive test were 1.33 (1.13-1.57), 3.76 (2.43-5.80), and 3.64 (2.87-4.78) and LRs for negative test were 0.68 (0.55-0.83), 0.30 (0.24-0.38), and 0.27 (0.22-0.34) for A, beta, and Abeta reserves, respectively. Pooled DORs were 2.09 (1.42-3.07), 15.11 (7.90-28.91), and 14.73 (9.61-22.57) and AUCs were 0.637 (0.594-0.677), 0.851 (0.828-0.872), and 0.859 (0.842-0.750) for A, beta, and Abeta reserves, respectively. CONCLUSION: Evidence supports the use of quantitative MCE as a non-invasive test for detection of CAD. Standardizing MCE quantification analysis and adherence to reporting standards for diagnostic tests could enhance the quality of evidence in this field.

Diagnostic Accuracy of Copeptin in the Differential Diagnosis of the Polyuria-polydipsia Syndrome: A Prospective Multicenter Study

CONTEXT The polyuria-polydipsia syndrome comprises primary polydipsia (PP) and central and nephrogenic diabetes insipidus (DI). Correctly discriminating these entities is mandatory, given that inadequate treatment causes serious complications. The diagnostic "gold standard" is the water deprivation test with assessment of arginine vasopressin (AVP) activity. However, test interpretation and AVP measurement are challenging. OBJECTIVE The objective was to evaluate the accuracy of copeptin, a stable peptide stoichiometrically cosecreted with AVP, in the differential diagnosis of polyuria-polydipsia syndrome. DESIGN, SETTING, AND PATIENTS This was a prospective multicenter observational cohort study from four Swiss or German tertiary referral centers of adults >18 years old with the history of polyuria and polydipsia. MEASUREMENTS A standardized combined water deprivation/3% saline infusion test was performed and terminated when serum sodium exceeded 147 mmol/L. Circulating copeptin and AVP levels were measured regularly throughout the test. Final diagnosis was based on the water deprivation/saline infusion test results, clinical information, and the treatment response. RESULTS Fifty-five patients were enrolled (11 with complete central DI, 16 with partial central DI, 18 with PP, and 10 with nephrogenic DI). Without prior thirsting, a single baseline copeptin level >21.4 pmol/L differentiated nephrogenic DI from other etiologies with a 100% sensitivity and specificity, rendering a water deprivation testing unnecessary in such cases. A stimulated copeptin >4.9 pmol/L (at sodium levels >147 mmol/L) differentiated between patients with PP and patients with partial central DI with a 94.0% specificity and a 94.4% sensitivity. A stimulated AVP >1.8 pg/mL differentiated between the same categories with a 93.0% specificity and a 83.0% sensitivity. LIMITATION This study was limited by incorporation bias from including AVP levels as a diagnostic criterion. CONCLUSION Copeptin is a promising new tool in the differential diagnosis of the polyuria-polydipsia syndrome, and a valid surrogate marker for AVP. Primary Funding Sources: Swiss National Science Foundation, University of Basel.

Accuracy of diagnostic testing in primary ciliary dyskinesia.

Diagnosis of primary ciliary dyskinesia (PCD) lacks a "gold standard" test and is therefore based on combinations of tests including nasal nitric oxide (nNO), high-speed video microscopy analysis (HSVMA), genotyping and transmission electron microscopy (TEM). There are few published data on the accuracy of this approach.Using prospectively collected data from 654 consecutive patients referred for PCD diagnostics we calculated sensitivity and specificity for individual and combination testing strategies. Not all patients underwent all tests.HSVMA had excellent sensitivity and specificity (100% and 93%, respectively). TEM was 100% specific, but 21% of PCD patients had normal ultrastructure. nNO (30 nL·min(-1) cut-off) had good sensitivity and specificity (91% and 96%, respectively). Simultaneous testing using HSVMA and TEM was 100% sensitive and 92% specific.In conclusion, combination testing was found to be a highly accurate approach for diagnosing PCD. HSVMA alone has excellent accuracy, but requires significant expertise, and repeated sampling or cell culture is often needed. TEM alone is specific but misses 21% of cases. nNO (≤30 nL·min(-1)) contributes well to the diagnostic process. In isolation nNO screening at this cut-off would miss ∼10% of cases, but in combination with HSVMA could reduce unnecessary further testing. Standardisation of testing between centres is a future priority.

Diagnostic performance and accuracy of 3-D spoiled gradient-dual-echo MRI with water- and fat-signal separation in liver-fat quantification: comparison to liver biopsy

To prospectively evaluate a 3-dimensional spoiled gradient-dual-echo (3D SPGR-DE) magnetic resonance imaging (MRI) sequence for the qualitative and quantitative analysis of liver fat content (LFC) in patients with the suspicion of fatty liver disease using histopathology as the standard of reference.

Iterative Reconstruction Algorithm for Abdominal Multidetector CT at Different Tube Voltages: Assessment of Diagnostic Accuracy, Image Quality, and Radiation Dose in a Phantom Study

To assess the diagnostic accuracy, image quality, and radiation dose of an iterative reconstruction algorithm compared with a filtered back projection (FBP) algorithm for abdominal computed tomography (CT) at different tube voltages.

Diagnostic accuracy of pulmonary CT angiography at low tube voltage: intraindividual comparison of a normal-dose protocol at 120 kVp and a low-dose protocol at 80 kVp using reduced amount of contrast medium in a simulation study

The purpose of this study was to simulate pulmonary emboli (PE) and image quality at low tube energy and reduced contrast material volume in normal-dose pulmonary CT angiography (CTA) images and to analyze the diagnostic accuracy with normal- and low-dose pulmonary CTA.

Diagnostic accuracy of magnetic resonance imaging: a prospective evaluation of patients with suspected appendicitis (diamond)

To show the effect of standard magnetic resonance imaging (MRI) in patients with suspected appendicitis on negative laparotomy and perforation rate. Moreover, the economic impact on hospital resources was evaluated.

Diagnostic accuracy of plasma glial fibrillary acidic protein for differentiating intracerebral hemorrhage and cerebral ischemia in patients with symptoms of acute stroke

Glial fibrillary acidic protein (GFAP) is a biomarker candidate indicative of intracerebral hemorrhage (ICH) in patients with symptoms of acute stroke. GFAP is released rapidly in the presence of expanding intracerebral bleeding, whereas a more gradual release occurs in ischemic stroke. In this study the diagnostic accuracy of plasma GFAP was determined in a prospective multicenter approach.

Impact of the availability of an influenza virus rapid antigen test on diagnostic decision making in a pediatric emergency department

OBJECTIVES: Fever is one of the most commonly seen symptoms in the pediatric emergency department. The objective of this study was to observe how the rapid testing for influenza virus impacts on the management of children with fever. METHODS: We performed a review of our pediatric emergency department records during the 2008/2009 annual influenza season. The BinaxNow Influenza A+B test was performed on patients with the following criteria: age 1.0 to 16.0 years, fever greater than 38.5 °C, fever of less than 96 hours' duration after the onset of clinical illness, clinical signs compatible with acute influenza, and nontoxic appearance. Additional laboratory tests were performed at the treating physician's discretion. RESULTS: The influenza rapid antigen test was performed in 192 children. One hundred nine (57%) were influenza positive, with the largest fraction (101 patients) positive for influenza A. The age distribution did not differ between children with negative and positive test results (mean, 5.3 vs. 5.1 years, not statistically significant). A larger number of diagnostic tests were performed in the group of influenza-negative patients. Twice as many complete blood counts, C-reactive protein determinations, lumbar punctures, and urinalyses were ordered in the latter group. CONCLUSIONS: Rapid diagnosis of influenza in the pediatric emergency department affects the management of febrile children as the confirmation of influenza virus infection decreases additional diagnostic tests ordered.

Evaluation of colonoscopic allergen provocation as a diagnostic tool in dogs with proven food hypersensitivity reactions

OBJECTIVE: To evaluate the colonoscopic allergen provocation (COLAP) test as a new tool for the diagnosis of IgE-mediated food allergy. METHODS: Oral food challenges as well as COLAP testing were performed in a colony of nine research dogs with proven immediate-type food allergic reactions. In addition, COLAP was performed in five healthy dogs. RESULTS: When compared with the oral challenge test, COLAP accurately determined 18 of 23 (73 per cent) positive oral challenge reactions (73 per cent) in dogs with food allergies and was negative in the healthy dogs. CLINICAL SIGNIFICANCE: The accuracy of this new test may be higher than that for gastric sensitivity testing. Therefore, COLAP holds promise as a new test to confirm the diagnosis of suspect IgE-mediated food allergy in dogs.

Accuracy of magnetic resonance imaging for the diagnosis of multiple sclerosis: systematic review

OBJECTIVE: To determine the accuracy of magnetic resonance imaging criteria for the early diagnosis of multiple sclerosis in patients with suspected disease. DESIGN: Systematic review. DATA SOURCES: 12 electronic databases, citation searches, and reference lists of included studies. Review methods Studies on accuracy of diagnosis that compared magnetic resonance imaging, or diagnostic criteria incorporating such imaging, to a reference standard for the diagnosis of multiple sclerosis. RESULTS: 29 studies (18 cohort studies, 11 other designs) were included. On average, studies of other designs (mainly diagnostic case-control studies) produced higher estimated diagnostic odds ratios than did cohort studies. Among 15 studies of higher methodological quality (cohort design, clinical follow-up as reference standard), those with longer follow-up produced higher estimates of specificity and lower estimates of sensitivity. Only two such studies followed patients for more than 10 years. Even in the presence of many lesions (> 10 or > 8), magnetic resonance imaging could not accurately rule multiple sclerosis in (likelihood ratio of a positive test result 3.0 and 2.0, respectively). Similarly, the absence of lesions was of limited utility in ruling out a diagnosis of multiple sclerosis (likelihood ratio of a negative test result 0.1 and 0.5). CONCLUSIONS: Many evaluations of the accuracy of magnetic resonance imaging for the early detection of multiple sclerosis have produced inflated estimates of test performance owing to methodological weaknesses. Use of magnetic resonance imaging to confirm multiple sclerosis on the basis of a single attack of neurological dysfunction may lead to over-diagnosis and over-treatment.

Diagnostic accuracy of coronary in-stent restenosis using 64-slice computed tomography: comparison with invasive coronary angiography

OBJECTIVES: This study sought to evaluate the diagnostic accuracy of coronary binary in-stent restenosis (ISR) with angiography using 64-slice multislice computed tomography coronary angiography (CTCA) compared with invasive coronary angiography (ICA). BACKGROUND: A noninvasive detection of ISR would result in an easier and safer way to conduct patient follow-up. METHODS: We performed CTCA in 81 patients after stent implantation, and 125 stented lesions were scanned. Two sets of images were reconstructed with different types of convolution kernels. On CTCA, neointimal proliferation was visually evaluated according to luminal contrast attenuation inside the stent. Lesions were graded as follows: grade 1, none or slight neointimal proliferation; grade 2, neointimal proliferation with no significant stenosis (<50%); grade 3, neointimal proliferation with moderate stenosis (> or =50%); and grade 4, neointimal proliferation with severe stenosis (> or =75%). Grades 3 and 4 were considered binary ISR. The diagnostic accuracy of CTCA compared with ICA was evaluated. RESULTS: By ICA, 24 ISRs were diagnosed. Sensitivity, specificity, positive predictive value, and negative predictive value were 92%, 81%, 54%, and 98% for the overall population, whereas values were 91%, 93%, 77%, and 98% when excluding unassessable segments (15 segments, 12%). For assessable segments, CTCA correctly diagnosed 20 of the 22 ISRs detected by ICA. Six lesions without ISR were overestimated as ISR by CTCA. As the grade of neointimal proliferation by CTCA increases, the median value of percent diameter stenosis increased linearly. CONCLUSIONS: Binary ISR can be excluded with high probability by CTCA, with a moderate rate of false-positive results.