Sample sizes of studies on diagnostic accuracy: literature survey

OBJECTIVES: To determine sample sizes in studies on diagnostic accuracy and the proportion of studies that report calculations of sample size. DESIGN: Literature survey. DATA SOURCES: All issues of eight leading journals published in 2002. METHODS: Sample sizes, number of subgroup analyses, and how often studies reported calculations of sample size were extracted. RESULTS: 43 of 8999 articles were non-screening studies on diagnostic accuracy. The median sample size was 118 (interquartile range 71-350) and the median prevalence of the target condition was 43% (27-61%). The median number of patients with the target condition--needed to calculate a test's sensitivity--was 49 (28-91). The median number of patients without the target condition--needed to determine a test's specificity--was 76 (27-209). Two of the 43 studies (5%) reported a priori calculations of sample size. Twenty articles (47%) reported results for patient subgroups. The number of subgroups ranged from two to 19 (median four). No studies reported that sample size was calculated on the basis of preplanned analyses of subgroups. CONCLUSION: Few studies on diagnostic accuracy report considerations of sample size. The number of participants in most studies on diagnostic accuracy is probably too small to analyse variability of measures of accuracy across patient subgroups.

Diagnostic accuracy of exercise electrocardiogram in patients with left anterior hemi-block

BACKGROUND: Left anterior hemiblock (LAHB) is the most frequent conduction abnormality, but its impact on the diagnostic accuracy of the exercise ECG has not been studied. The aim of our study was to determine the diagnostic accuracy of ST depression for predicting ischaemia in the presence of LAHB. PATIENTS: Consecutive patients with known or suspected coronary heart disease undergoing exercise ECG and 99mTc-sestamibi single photon emission computed tomography (SPECT) were included in the analysis. Patients with left bundle branch block, with changes in QRS morphology related to myocardial infarction, and patients who had undergone pharmacological stress testing were excluded. RESULTS: Of 1532 patients assessed, 567 patients qualified for the analysis. In 69 patients with LAHB, ECG stress testing had lower sensitivity (38% vs 86%) and lower negative predictive value (82% vs 92%) than in patients with normal baseline ECG. The reduction of sensitivity appeared to be similar in patients with isolated LAHB (n=43), in patients with right bundle branch block (n=39), and with bifascicular block (n=26). In contrast, the positive predictive value of the test was excellent. CONCLUSION: The diagnostic accuracy of the exercise ECG for prediction of ischaemia is reduced in patients with LAHB.

Quantitative Myocardial Contrast Echocardiography during Pharmacological Stress for Diagnosis of Coronary Artery Disease: A Systematic Review and Meta-analysis of Diagnostic Accuracy Studies

AIMS: We conducted a meta-analysis to evaluate the accuracy of quantitative stress myocardial contrast echocardiography (MCE) in coronary artery disease (CAD). METHODS AND RESULTS: Database search was performed through January 2008. We included studies evaluating accuracy of quantitative stress MCE for detection of CAD compared with coronary angiography or single-photon emission computed tomography (SPECT) and measuring reserve parameters of A, beta, and Abeta. Data from studies were verified and supplemented by the authors of each study. Using random effects meta-analysis, we estimated weighted mean difference (WMD), likelihood ratios (LRs), diagnostic odds ratios (DORs), and summary area under curve (AUC), all with 95% confidence interval (CI). Of 1443 studies, 13 including 627 patients (age range, 38-75 years) and comparing MCE with angiography (n = 10), SPECT (n = 1), or both (n = 2) were eligible. WMD (95% CI) were significantly less in CAD group than no-CAD group: 0.12 (0.06-0.18) (P < 0.001), 1.38 (1.28-1.52) (P < 0.001), and 1.47 (1.18-1.76) (P < 0.001) for A, beta, and Abeta reserves, respectively. Pooled LRs for positive test were 1.33 (1.13-1.57), 3.76 (2.43-5.80), and 3.64 (2.87-4.78) and LRs for negative test were 0.68 (0.55-0.83), 0.30 (0.24-0.38), and 0.27 (0.22-0.34) for A, beta, and Abeta reserves, respectively. Pooled DORs were 2.09 (1.42-3.07), 15.11 (7.90-28.91), and 14.73 (9.61-22.57) and AUCs were 0.637 (0.594-0.677), 0.851 (0.828-0.872), and 0.859 (0.842-0.750) for A, beta, and Abeta reserves, respectively. CONCLUSION: Evidence supports the use of quantitative MCE as a non-invasive test for detection of CAD. Standardizing MCE quantification analysis and adherence to reporting standards for diagnostic tests could enhance the quality of evidence in this field.

Diagnostic Accuracy of Copeptin in the Differential Diagnosis of the Polyuria-polydipsia Syndrome: A Prospective Multicenter Study

CONTEXT The polyuria-polydipsia syndrome comprises primary polydipsia (PP) and central and nephrogenic diabetes insipidus (DI). Correctly discriminating these entities is mandatory, given that inadequate treatment causes serious complications. The diagnostic "gold standard" is the water deprivation test with assessment of arginine vasopressin (AVP) activity. However, test interpretation and AVP measurement are challenging. OBJECTIVE The objective was to evaluate the accuracy of copeptin, a stable peptide stoichiometrically cosecreted with AVP, in the differential diagnosis of polyuria-polydipsia syndrome. DESIGN, SETTING, AND PATIENTS This was a prospective multicenter observational cohort study from four Swiss or German tertiary referral centers of adults >18 years old with the history of polyuria and polydipsia. MEASUREMENTS A standardized combined water deprivation/3% saline infusion test was performed and terminated when serum sodium exceeded 147 mmol/L. Circulating copeptin and AVP levels were measured regularly throughout the test. Final diagnosis was based on the water deprivation/saline infusion test results, clinical information, and the treatment response. RESULTS Fifty-five patients were enrolled (11 with complete central DI, 16 with partial central DI, 18 with PP, and 10 with nephrogenic DI). Without prior thirsting, a single baseline copeptin level >21.4 pmol/L differentiated nephrogenic DI from other etiologies with a 100% sensitivity and specificity, rendering a water deprivation testing unnecessary in such cases. A stimulated copeptin >4.9 pmol/L (at sodium levels >147 mmol/L) differentiated between patients with PP and patients with partial central DI with a 94.0% specificity and a 94.4% sensitivity. A stimulated AVP >1.8 pg/mL differentiated between the same categories with a 93.0% specificity and a 83.0% sensitivity. LIMITATION This study was limited by incorporation bias from including AVP levels as a diagnostic criterion. CONCLUSION Copeptin is a promising new tool in the differential diagnosis of the polyuria-polydipsia syndrome, and a valid surrogate marker for AVP. Primary Funding Sources: Swiss National Science Foundation, University of Basel.

Accuracy of diagnostic testing in primary ciliary dyskinesia.

Diagnosis of primary ciliary dyskinesia (PCD) lacks a "gold standard" test and is therefore based on combinations of tests including nasal nitric oxide (nNO), high-speed video microscopy analysis (HSVMA), genotyping and transmission electron microscopy (TEM). There are few published data on the accuracy of this approach.Using prospectively collected data from 654 consecutive patients referred for PCD diagnostics we calculated sensitivity and specificity for individual and combination testing strategies. Not all patients underwent all tests.HSVMA had excellent sensitivity and specificity (100% and 93%, respectively). TEM was 100% specific, but 21% of PCD patients had normal ultrastructure. nNO (30 nL·min(-1) cut-off) had good sensitivity and specificity (91% and 96%, respectively). Simultaneous testing using HSVMA and TEM was 100% sensitive and 92% specific.In conclusion, combination testing was found to be a highly accurate approach for diagnosing PCD. HSVMA alone has excellent accuracy, but requires significant expertise, and repeated sampling or cell culture is often needed. TEM alone is specific but misses 21% of cases. nNO (≤30 nL·min(-1)) contributes well to the diagnostic process. In isolation nNO screening at this cut-off would miss ∼10% of cases, but in combination with HSVMA could reduce unnecessary further testing. Standardisation of testing between centres is a future priority.

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative

Objective To improve the accuracy and completeness of reporting of studies of diagnostic accuracy, to allow readers to assess the potential for bias in a study, and to evaluate a study's generalisability. Methods The Standards for Reporting of Diagnostic Accuracy (STARD) steering committee searched the literature to identify publications on the appropriate conduct and reporting of diagnostic studies and extracted potential items into an extensive list. Researchers, editors, and members of professional organisations shortened this list during a two day consensus meeting, with the goal of developing a checklist and a generic flow diagram for studies of diagnostic accuracy. Results The search for published guidelines about diagnostic research yielded 33 previously published checklists, from which we extracted a list of 75 potential items. At the consensus meeting, participants shortened the list to a 25 item checklist, by using evidence, whenever available. A prototype of a flow diagram provides information about the method of patient recruitment, the order of test execution, and the numbers of patients undergoing the test under evaluation and the reference standard, or both. Conclusions Evaluation of research depends on complete and accurate reporting. If medical journals adopt the STARD checklist and flow diagram, the quality of reporting of studies of diagnostic accuracy should improve to the advantage of clinicians, researchers, reviewers, journals, and the public.

A systematic review and meta-analysis of the diagnostic accuracy of rapid immunochromatographic assays for the detection of dengue virus IgM antibodies during acute infection

A meta-analysis of rapid (

A randomized trial comparing the diagnostic accuracy of visual inspection with acetic acid to Visual Inspection with Lugol's Iodine for cervical cancer screening in HIV-infected women.

Visual inspection with Acetic Acid (VIA) and Visual Inspection with Lugol’s Iodine (VILI) are increasingly recommended in various cervical cancer screening protocols in low-resource settings. Although VIA is more widely used, VILI has been advocated as an easier and more specific screening test. VILI has not been well-validated as a stand-alone screening test, compared to VIA or validated for use in HIV-infected women. We carried out a randomized clinical trial to compare the diagnostic accuracy of VIA and VILI among HIV-infected women. Women attending the Family AIDS Care and Education Services (FACES) clinic in western Kenya were enrolled and randomized to undergo either VIA or VILI with colposcopy. Lesions suspicious for cervical intraepithelial neoplasia 2 or greater (CIN2+) were biopsied. Between October 2011 and June 2012, 654 were randomized to undergo VIA or VILI. The test positivity rates were 26.2% for VIA and 30.6% for VILI (p = 0.22). The rate of detection of CIN2+ was 7.7% in the VIA arm and 11.5% in the VILI arm (p = 0.10). There was no significant difference in the diagnostic performance of VIA and VILI for the detection of CIN2+. Sensitivity and specificity were 84.0% and 78.6%, respectively, for VIA and 84.2% and 76.4% for VILI. The positive and negative predictive values were 24.7% and 98.3% for VIA, and 31.7% and 97.4% for VILI. Among women with CD4+ count < 350, VILI had a significantly decreased specificity (66.2%) compared to VIA in the same group (83.9%, p = 0.02) and compared to VILI performed among women with CD4+ count ≥ 350 (79.7%, p = 0.02). VIA and VILI had similar diagnostic accuracy and rates of CIN2+ detection among HIV-infected women.

High Diagnostic Accuracy And Reproducibility Of Fine-needle Aspiration Cytology For Diagnosing Salivary Gland Tumors: Cytohistologic Correlation In 182 Cases.

The purpose of this study was to assess the efficacy and reproducibility of the cytologic diagnosis of salivary gland tumors (SGTs) using fine-needle aspiration cytology (FNAC). The study aimed to determine diagnostic accuracy, sensitivity, and specificity and to evaluate the extent of interobserver agreement. We retrospectively evaluated SGTs from the files of the Division of Pathology at the Clinics Hospital of São Paulo and Piracicaba Dental School between 2000 and 2006. We performed cytohistologic correlation in 182 SGTs. The sensitivity, specificity, positive predictive value, negative predictive value, and diagnostic accuracy were 94%, 100%, 100%, 100%, and 99%, respectively. The interobserver cytologic reproducibility showed significant statistical concordance (P < .0001). FNAC is an effective tool for performing a reliable preoperative diagnosis in SGTs and shows high diagnostic accuracy and consistent interobserver reproducibility. Further FNAC studies analyzing large samples of malignant SGTs and reactive salivary lesions are needed to confirm their accuracy.

The accuracy of the Clock Drawing Test compared to that of standard screening tests for Alzheimer`s disease: results from a study of Brazilian elderly with heterogeneous educational backgrounds

Background: Although the Clock Drawing Test (CDT) is the second most used test in the world for the screening of dementia, there is still debate over its sensitivity specificity, application and interpretation in dementia diagnosis. This study has three main aims: to evaluate the sensitivity and specificity of the CDT in a sample composed of older adults with Alzheimer`s disease (AD) and normal controls; to compare CDT accuracy to the that of the Mini-mental State Examination (MMSE) and the Cambridge Cognitive Examination (CAMCOG), and to test whether the association of the MMSE with the CDT leads to higher or comparable accuracy as that reported for the CAMCOG. Methods: Cross-sectional assessment was carried out for 121 AD and 99 elderly controls with heterogeneous educational levels from a geriatric outpatient clinic who completed the Cambridge Examination for Mental Disorder of the Elderly (CAMDEX). The CDT was evaluated according to the Shulman, Mendez and Sunderland scales. Results: The CDT showed high sensitivity and specificity. There were significant correlations between the CDT and the MMSE (0.700-0.730; p < 0.001) and between the CDT and the CAMCOG (0.753-0.779; p < 0.001). The combination of the CDT with the MMSE improved sensitivity and specificity (SE = 89.2-90%; SP = 71.7-79.8%). Subgroup analysis indicated that for elderly people with lower education, sensitivity and specificity were both adequate and high. Conclusions: The CDT is a robust screening test when compared with the MMSE or the CAMCOG, independent of the scale used for its interpretation. The combination with the MMSE improves its performance significantly, becoming equivalent to the CAMCOG.

Accuracy of predicting a child's response to potential threat: A comparison of children and their mothers

Considerable research has indicated that children and their parents often demonstrate marked discrepancies in their reporting of anxiety-related phenomena. In such cases, the question arises as to whether children are capable of accurately reporting on their anxiety. In the present study, 50 children (aged 5 to 14 years) were asked to approach a large, German Shepherd dog. Prior to the task, both the mother and child independently predicted the closest point likely to be reached by the child and the degree of anxiety likely to be experienced. These predictions were then compared with the actual phenomena displayed by the child during the task. On the behavioural measure (closest step reached), both the child and mother demonstrated equivalent predictive accuracy. On the subjective measure (fear ratings) children were considerably more accurate than their mothers. The data were not influenced by gender, age, or clinical status. The results indicate the ability of children to accurately predict their anxious responses, and support the value of incorporating children's self-reports in the assessment of emotional disorders.

PVALB, a New Hurthle Adenoma Diagnostic Marker Identified through Gene Expression

Context: A better means to accurately identify malignant thyroid nodules and to distinguish them from benign tumors is needed. We previously identified markers for detecting thyroid malignancy, with sensitivity estimated at or close to 100%. One lingering problem with these markers was that false positives occurred with Hurthle cell adenomas (HCA) which lowered test specificity. Methods: To locate accurate diagnostic markers, we profiled in depth the transcripts of a HCA and a Hurthle cell carcinoma (HCC). From 1146 differentially expressed genes, 18 transcripts specifically expressed in HCA were tested by quantitative PCR in a wide range of thyroid tumors (n = 76). Sensibility and specificity were calculated using receiver operating characteristic (ROC). Selected markers were further validated in an independent set of thyroid tumors (n = 82) by immunohistochemistry. To define the panel that would yield best diagnostic accuracy, these markers were tested in combination with our previous identified markers. Results: Seventeen of the 18 genes showed statistical significance based on a mean relative level of expression (P < 0.05). KLK1 (sensitivity = 0.97) and PVALB (sensitivity = 0.94) were the best candidate markers. The combination of PVALB and C1orf24 increased specificity to > 97% and maintained sensitivity for detection of carcinoma. Conclusion: We identified tumor markers that can be used in combination for a more accurate preoperative diagnosis of thyroid nodules and for postoperative diagnosis of thyroid carcinoma in tumor sections. This improved test would help physicians rapidly focus treatment on true malignancies and avoid unnecessary treatment of benign tumors, simultaneously improving medical care and reducing costs. (J Clin Endocrinol Metab 96: E151-E160, 2011)

Optimizing the CAMCOG test in the screening for mild cognitive impairment and incipient dementia: saving time with relevant domains

Objective: To identify the CAMCOG sub-items that best contribute for the identification of patients with mild cognitive impairment (MCI) and incipient Alzheimer`s disease (AD) in clinical practice. Methods: Cross-sectional assessment of 272 older adults (98 MCI, 82 AD, and 92 controls) with a standardized neuropsychological battery and the CAMCOG schedule. Backward logistic regression analysis with diagnosis (MCI and controls) as dependent variable and the sub-items of the CAMCOG as independent variable was carried out to determine the CAMCOG sub-items that predicted the diagnosis of MCI. Results: Lower scores on Language, Memory, Praxis, and Calculation CAMCOG sub-items were significantly associated with the diagnosis of MCI. A composite score obtained by the sum of these scores significantly discriminated MCI patients from comparison groups. This reduced version of the CAMCOG showed similar diagnostic accuracy than the original schedule for the identification of patients with MCI as compared to controls (AUC = 0.80 +/- 0.03 for the reduced CAMCOG; AUC = 0.79 +/- 0.03 for the original CAMCOG). Conclusion: This reduced version of the CAMCOG had similar diagnostic properties as the original CAMCOG and was faster and easier to administer, rendering it more suitable for the screening of subtle cognitive deficits in general clinical practice. Copyright (C) 2010 John Wiley & Sons, Ltd.

Effect of Disease Severity and Optic Disc Size on Diagnostic Accuracy of RTVue Spectral Domain Optical Coherence Tomograph in Glaucoma

PURPOSE. To evaluate the effect of disease severity and optic disc size on the diagnostic accuracies of optic nerve head (ONH), retinal nerve fiber layer (RNFL), and macular parameters with RTVue (Optovue, Fremont, CA) spectral domain optical coherence tomography (SDOCT) in glaucoma. METHODS. 110 eyes of 62 normal subjects and 193 eyes of 136 glaucoma patients from the Diagnostic Innovations in Glaucoma Study underwent ONH, RNFL, and macular imaging with RTVue. Severity of glaucoma was based on visual field index (VFI) values from standard automated perimetry. Optic disc size was based on disc area measurement using the Heidelberg Retina Tomograph II (Heidelberg Engineering, Dossenheim, Germany). Influence of disease severity and disc size on the diagnostic accuracy of RTVue was evaluated by receiver operating characteristic (ROC) and logistic regression models. RESULTS. Areas under ROC curve (AUC) of all scanning areas increased (P < 0.05) as disease severity increased. For a VFI value of 99%, indicating early damage, AUCs for rim area, average RNLI thickness, and ganglion cell complex-root mean square were 0.693, 0.799, and 0.779, respectively. For a VFI of 70%, indicating severe damage, corresponding AUCs were 0.828, 0.985, and 0.992, respectively. Optic disc size did not influence the AUCs of any of the SDOCT scanning protocols of RTVue (P > 0.05). Sensitivity of the rim area increased and specificity decreased in large optic discs. CONCLUSIONS. Diagnostic accuracies of RTVue scanning protocols for glaucoma were significantly influenced by disease severity. Sensitivity of the rim area increased in large optic discs at the expense of specificity. (Invest Ophthalmol Vis Sci. 2011;92:1290-1296) DOI:10.1167/iovs.10-5516

Can the CAMCOG be a good cognitive test for patients with Alzheimer`s disease with low levels of education?

Background: The Cambridge Cognitive Examination (CAMCOG) is a useful test in screening for Alzheimer`s disease (AD). However, the interpretation of CAMCOG cut-off scores is problematic and reference values are needed for different educational strata. Given the importance of earlier diagnoses of mild dementia, new cut-off values are required which take into account patients with low levels of education. This study aims to evaluate whether the CAMCOG can be used as an accurate screening test among AD patients and normal controls with different educational levels. Methods: Cross-sectional assessment was undertaken of 113 AD and 208 elderly controls with heterogeneous educational levels (group 1: 1-4 years; group 2: 5-8 years; and group 3: >= 9 years) from a geriatric clinic. submitted to a thorough diagnostic evaluation for AD including the Cambridge Examination for Mental Disorders of the Elderly (CAMDEX). Controls had no cognitive or mood complaints. Sensitivity (SE) and specificity (SP) for the CAMCOG in each educational group was assessed with receiver-operator-characteristic (ROC) curves. Results: CAMCOG mean values were lower when education was reduced in both diagnostic groups (controls - group 1: 87; group 2: 91; group 3: 96; AD - group 1: 63; group 2: 62; group 3: 77). Cutoff scores for the three education groups were 79, 80 and 90, respectively. SE and SP varied among the groups (group 1: 88.1% and 83.5%; group 2: 84.6% and 96%; group 3: 70.8% and 90%). Conclusion: The CAMCOG can be used as a cognitive test for patients with low educational level with good accuracy. Patients with higher education showed lower scores than previously reported.