Reporting standards for studies of diagnostic test accuracy in dementia: The STARDdem Initiative.

OBJECTIVE To provide guidance on standards for reporting studies of diagnostic test accuracy for dementia disorders. METHODS An international consensus process on reporting standards in dementia and cognitive impairment (STARDdem) was established, focusing on studies presenting data from which sensitivity and specificity were reported or could be derived. A working group led the initiative through 4 rounds of consensus work, using a modified Delphi process and culminating in a face-to-face consensus meeting in October 2012. The aim of this process was to agree on how best to supplement the generic standards of the STARD statement to enhance their utility and encourage their use in dementia research. RESULTS More than 200 comments were received during the wider consultation rounds. The areas at most risk of inadequate reporting were identified and a set of dementia-specific recommendations to supplement the STARD guidance were developed, including better reporting of patient selection, the reference standard used, avoidance of circularity, and reporting of test-retest reliability. CONCLUSION STARDdem is an implementation of the STARD statement in which the original checklist is elaborated and supplemented with guidance pertinent to studies of cognitive disorders. Its adoption is expected to increase transparency, enable more effective evaluation of diagnostic tests in Alzheimer disease and dementia, contribute to greater adherence to methodologic standards, and advance the development of Alzheimer biomarkers.

Accuracy of B-type natriuretic peptide tests to exclude congestive heart failure: systematic review of test accuracy studies

BACKGROUND: Congestive heart failure (CHF) is a major public health problem. The use of B-type natriuretic peptide (BNP) tests shows promising diagnostic accuracy. Herein, we summarize the evidence on the accuracy of BNP tests in the diagnosis of CHF and compare the performance of rapid enzyme-linked immunosorbent assay (ELISA) and standard radioimmunosorbent assay (RIA) tests. METHODS: We searched electronic databases and the reference lists of included studies, and we contacted experts. Data were extracted on the study population, the type of test used, and methods. Receiver operating characteristic (ROC) plots and summary ROC curves were produced and negative likelihood ratios pooled. Random-effect meta-analysis and metaregression were used to combine data and explore sources of between-study heterogeneity. RESULTS: Nineteen studies describing 22 patient populations (9 ELISA and 13 RIA) and 9093 patients were included. The diagnosis of CHF was verified by echocardiography, radionuclide scan, or echocardiography combined with clinical criteria. The pooled negative likelihood ratio overall from random-effect meta-analysis was 0.18 (95% confidence interval [CI], 0.13-0.23). It was lower for the ELISA test (0.12; 95% CI, 0.09-0.16) than for the RIA test (0.23; 95% CI, 0.16-0.32). For a pretest probability of 20%, which is typical for patients with suspected CHF in primary care, a negative result of the ELISA test would produce a posttest probability of 2.9%; a negative RIA test, a posttest probability of 5.4%. CONCLUSIONS: The use of BNP tests to rule out CHF in primary care settings could reduce demand for echocardiography. The advantages of rapid ELISA tests need to be balanced against their higher cost.

Estimating Diagnostic Test Accuracies for Brachyspira hyodysenteriae Accounting for the Complexities of Population Structure in Food Animals

For swine dysentery, which is caused by Brachyspira hyodysenteriae infection and is an economically important disease in intensive pig production systems worldwide, a perfect or error-free diagnostic test ("gold standard") is not available. In the absence of a gold standard, Bayesian latent class modelling is a well-established methodology for robust diagnostic test evaluation. In contrast to risk factor studies in food animals, where adjustment for within group correlations is both usual and required for good statistical practice, diagnostic test evaluation studies rarely take such clustering aspects into account, which can result in misleading results. The aim of the present study was to estimate test accuracies of a PCR originally designed for use as a confirmatory test, displaying a high diagnostic specificity, and cultural examination for B. hyodysenteriae. This estimation was conducted based on results of 239 samples from 103 herds originating from routine diagnostic sampling. Using Bayesian latent class modelling comprising of a hierarchical beta-binomial approach (which allowed prevalence across individual herds to vary as herd level random effect), robust estimates for the sensitivities of PCR and culture, as well as for the specificity of PCR, were obtained. The estimated diagnostic sensitivity of PCR (95% CI) and culture were 73.2% (62.3; 82.9) and 88.6% (74.9; 99.3), respectively. The estimated specificity of the PCR was 96.2% (90.9; 99.8). For test evaluation studies, a Bayesian latent class approach is well suited for addressing the considerable complexities of population structure in food animals.

Early Improvement As a Predictor of Later Response to Antipsychotics in Schizophrenia: A Diagnostic Test Review

OBJECTIVE How long clinicians should wait before considering an antipsychotic ineffective and changing treatment in schizophrenia is an unresolved clinical question. Guidelines differ substantially in this regard. The authors conducted a diagnostic test meta-analysis using mostly individual patient data to assess whether lack of improvement at week 2 predicts later nonresponse. METHOD The search included EMBASE, MEDLINE, BIOSIS, PsycINFO, Cochrane Library, CINAHL, and reference lists of relevant articles, supplemented by requests to authors of all relevant studies. The main outcome was prediction of nonresponse, defined as <50% reduction in total score on either the Positive and Negative Syndrome Scale (PANSS) or Brief Psychiatric Rating Scale (BPRS) (corresponding to at least much improved) from baseline to endpoint (4-12 weeks), by <20% PANSS or BPRS improvement (corresponding to less than minimally improved) at week 2. Secondary outcomes were absent cross-sectional symptomatic remission and <20% PANSS or BPRS reduction at endpoint. Potential moderator variables were examined by meta-regression. RESULTS In 34 studies (N=9,460) a <20% PANSS or BPRS reduction at week 2 predicted nonresponse at endpoint with a specificity of 86% and a positive predictive value (PPV) of 90%. Using data for observed cases (specificity=86%, PPV=85%) or lack of remission (specificity=77%, PPV=88%) yielded similar results. Conversely, using the definition of <20% reduction at endpoint yielded worse results (specificity=70%, PPV=55%). The test specificity was significantly moderated by a trial duration of <6 weeks, higher baseline illness severity, and shorter illness duration. CONCLUSIONS Patients not even minimally improved by week 2 of antipsychotic treatment are unlikely to respond later and may benefit from a treatment change.

Allele-specific polymerase chain reaction diagnostic test for the functional MDR1 polymorphism in dogs

The major multidrug transporter P-glycoprotein (Pgp) contributes to the barrier function of several tissues and organs, including the brain. In a subpopulation of Collies and seven further dog breeds, a 4 base pair deletion has been described in the Pgp-encoding MDR1 gene. This deletion results in the absence of a functional form of Pgp and loss of its protective function. Severe intoxication with the Pgp substrate ivermectin has been attributed to the genetically determined lack of Pgp. An allele-specific polymerase chain reaction (PCR)-based screening method has been developed to detect the mutant allele and to determine if a dog is homozygous or heterozygous for the mutation. Based on this validation, the allele-specific PCR proved to be a robust, reproducible and specific tool, allowing rapid determination of the MDR1 genotype of dogs of at risk breeds using blood samples or buccal swabs.

The sensitivity and specificity of a diagnostic test of sequence-space synesthesia

People with sequence-space synesthesia (SSS) report stable visuo-spatial forms corresponding to numbers, days, and months (amongst others). This type of synesthesia has intrigued scientists for over 130 years but the lack of an agreed upon tool for assessing it has held back research on this phenomenon. The present study builds on previous tests by measuring the consistency of spatial locations that is known to discriminate controls from synesthetes. We document, for the first time, the sensitivity and specificity of such a test and suggest a diagnostic cut-off point for discriminating between the groups based on the area bounded by different placement attempts with the same item.

Multivariable adjustments counteract spectrum and test review bias in accuracy studies

OBJECTIVES: The STAndards for Reporting studies of Diagnostic accuracy (STARD) for investigators and editors and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) for reviewers and readers offer guidelines for the quality and reporting of test accuracy studies. These guidelines address and propose some solutions to two major threats to validity: spectrum bias and test review bias. STUDY DESIGN AND SETTING: Using a clinical example, we demonstrate that these solutions fail and propose an alternative solution that concomitantly addresses both sources of bias. We also derive formulas that prove the generality of our arguments. RESULTS: A logical extension of our ideas is to extend STARD item 23 by adding a requirement for multivariable statistical adjustment using information collected in QUADAS items 1, 2, and 12 and STARD items 3-5, 11, 15, and 18. CONCLUSION: We recommend reporting not only variation of diagnostic accuracy across subgroups (STARD item 23) but also the effects of the multivariable adjustments on test performance. We also suggest that the QUADAS be supplemented by an item addressing the appropriateness of statistical methods, in particular whether multivariable adjustments have been included in the analysis.

Autofluorescence endoscopy in surveillance of Barrett's esophagus: a multicenter randomized trial on diagnostic efficacy

BACKGROUND AND STUDY AIMS: The reference surveillance method in patients with Barrett's esophagus is careful endoscopic observation, with targeted as well as random four-quadrant biopsies. Autofluorescence endoscopy (AFE) may make it easier to locate neoplasia. The aim of this study was to elucidate the diagnostic accuracy of surveillance with AFE-guided plus four-quadrant biopsies in comparison with the conventional approach. PATIENTS AND METHODS: A total of 187 of 200 consecutive Barrett's esophagus patients who were initially enrolled (73 % male, mean age 67 years, mean Barrett's segment length 4.6 cm), who underwent endoscopy for Barrett's esophagus in four study centers, were randomly assigned to undergo either AFE-targeted biopsy followed by four-quadrant biopsies or conventional endoscopic surveillance, also including four-quadrant biopsies (study phase 1). After exclusion of patients with early cancer or high-grade dysplasia, who underwent endoscopic or surgical treatment, as well as those who declined to participate in phase 2 of the study, 130 patients remained. These patients were examined again with the alternative method after a mean of 10 weeks, using the same methods described. The main study parameter was the detection of early cancer/adenocarcinoma or high-grade dysplasia (HGD), comparing both approaches in study phase 1; the secondary study aim in phase 2 was to assess the additional value of the AFE-guided approach after conventional surveillance, and vice versa. Test accuracy measures were derived from study phase 1. RESULTS: In study phase 1, the AFE and conventional approaches yielded adenocarcinoma/HGD rates of 12 % and 5.3 %, respectively, on a per-patient basis. With AFE, four previously unrecognized adenocarcinoma/HGD lesions were identified (4.3 % of the patients); with the conventional approach, one new lesion (1.1 %) was identified. Of the 19 adenocarcinoma/HGD lesions detected during AFE endoscopy in study phase 1, eight were visualized, while 11 were only detected using untargeted four-quadrant biopsies (sensitivity 42 %). Of the 766 biopsies classified at histology as being nonneoplastic, 58 appeared suspicious (specificity 92 %, positive predictive value 12 %, negative predictive value 98.5 %). In study phase 2, AFE detected two further lesions in addition to the initial alternative approach in 3.2 % of cases, in comparison with one lesion with conventional endoscopy (1.7 %). CONCLUSIONS: In this referral Barrett's esophagus population with a higher prevalence of neoplastic lesions, the AFE-guided approach improved the diagnostic yield for neoplasia in comparison with the conventional approach using four-quadrant biopsies. However, AFE alone was not suitable for replacing the standard four-quadrant biopsy protocol.

Variation of a test's sensitivity and specificity with disease prevalence

BACKGROUND Anecdotal evidence suggests that the sensitivity and specificity of a diagnostic test may vary with disease prevalence. Our objective was to investigate the associations between disease prevalence and test sensitivity and specificity using studies of diagnostic accuracy. METHODS We used data from 23 meta-analyses, each of which included 10-39 studies (416 total). The median prevalence per review ranged from 1% to 77%. We evaluated the effects of prevalence on sensitivity and specificity using a bivariate random-effects model for each meta-analysis, with prevalence as a covariate. We estimated the overall effect of prevalence by pooling the effects using the inverse variance method. RESULTS Within a given review, a change in prevalence from the lowest to highest value resulted in a corresponding change in sensitivity or specificity from 0 to 40 percentage points. This effect was statistically significant (p < 0.05) for either sensitivity or specificity in 8 meta-analyses (35%). Overall, specificity tended to be lower with higher disease prevalence; there was no such systematic effect for sensitivity. INTERPRETATION The sensitivity and specificity of a test often vary with disease prevalence; this effect is likely to be the result of mechanisms, such as patient spectrum, that affect prevalence, sensitivity and specificity. Because it may be difficult to identify such mechanisms, clinicians should use prevalence as a guide when selecting studies that most closely match their situation.

Accuracy of electrocardiography in diagnosis of left ventricular hypertrophy in arterial hypertension: systematic review

OBJECTIVE: To review the accuracy of electrocardiography in screening for left ventricular hypertrophy in patients with hypertension. DESIGN: Systematic review of studies of test accuracy of six electrocardiographic indexes: the Sokolow-Lyon index, Cornell voltage index, Cornell product index, Gubner index, and Romhilt-Estes scores with thresholds for a positive test of > or =4 points or > or =5 points. DATA SOURCES: Electronic databases ((Pre-)Medline, Embase), reference lists of relevant studies and previous reviews, and experts. STUDY SELECTION: Two reviewers scrutinised abstracts and examined potentially eligible studies. Studies comparing the electrocardiographic index with echocardiography in hypertensive patients and reporting sufficient data were included. DATA EXTRACTION: Data on study populations, echocardiographic criteria, and methodological quality of studies were extracted. DATA SYNTHESIS: Negative likelihood ratios, which indicate to what extent the posterior odds of left ventricular hypertrophy is reduced by a negative test, were calculated. RESULTS: 21 studies and data on 5608 patients were analysed. The median prevalence of left ventricular hypertrophy was 33% (interquartile range 23-41%) in primary care settings (10 studies) and 65% (37-81%) in secondary care settings (11 studies). The median negative likelihood ratio was similar across electrocardiographic indexes, ranging from 0.85 (range 0.34-1.03) for the Romhilt-Estes score (with threshold > or =4 points) to 0.91 (0.70-1.01) for the Gubner index. Using the Romhilt-Estes score in primary care, a negative electrocardiogram result would reduce the typical pre-test probability from 33% to 31%. In secondary care the typical pre-test probability of 65% would be reduced to 63%. CONCLUSION: Electrocardiographic criteria should not be used to rule out left ventricular hypertrophy in patients with hypertension.

Evidence-based diagnosis

Making an accurate diagnosis is essential to ensure that a patient receives appropriate treatment and correct information regarding their prognosis. Characteristics of diagnostic tests are quantified in test accuracy studies, but many such studies have methodological flaws. The HSRC evidence-based diagnosis programme has focused on methods for systematic reviews of test accuracy studies, and the wider context in which tests are ordered and interpreted. We carried out a range of projects relating to literature searching, quality assessment, meta-analysis, presentation of results, and interactions between doctors and patients during the diagnostic process. We have shown that systematic reviews of test accuracy studies should search a range of databases and that current diagnostic filters do not have sufficient accuracy to be used in test accuracy reviews. Summary quality scores should not be used in test accuracy reviews; the Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Reviews (QUADAS) tool for assessing test accuracy studies is acceptable for quality assessment. We have shown that the hierarchical summary receiver operating characteristic (HSROC) and bivariate models for meta-analysis of test accuracy are statistically equivalent in many circumstances, and have developed an add-on module for the statistical software package Stata that enables these statistically rigorous models to be fitted by those without expert statistical knowledge. Three areas that would benefit from further research are literature searching, synthesis of results from individual patient data and presentation of results.

Combined magnetic resonance imaging and magnetic resonance spectroscopy imaging in the diagnosis of prostate cancer: a systematic review and meta-analysis

CONTEXT: Magnetic resonance imaging (MRI) combined with magnetic resonance spectroscopy imaging (MRSI) emerged as a promising test in the diagnosis of prostate cancer and showed encouraging results. OBJECTIVE: The aim of this systematic review is to meta-analyse the diagnostic accuracy of combined MRI/MRSI in prostate cancer and to explore risk profiles with highest benefit. EVIDENCE ACQUISITION: The authors searched the MEDLINE and EMBASE databases and the Cochrane Library, and the authors screened reference lists and contacted experts. There were no language restrictions. The last search was performed in August 2008. EVIDENCE SYNTHESIS: We identified 31 test-accuracy studies (1765 patients); 16 studies (17 populations) with a total of 581 patients were suitable for meta-analysis. Nine combined MRI/MRSI studies (10 populations) examining men with pathologically confirmed prostate cancer (297 patients; 1518 specimens) had a pooled sensitivity and specificity on prostate subpart level of 68% (95% CI, 56-78%) and 85% (95% CI, 78-90%), respectively. Compared with patients at high risk for clinically relevant cancer (six studies), sensitivity was lower in low-risk patients (four studies) (58% [46-69%] vs 74% [58-85%]; p>0.05) but higher for specificity (91% [86-94%] vs 78% [70-84%]; p<0.01). Seven studies examining patients with suspected prostate cancer at combined MRI/MRSI (284 patients) had an overall pooled sensitivity and specificity on patients level of 82% (59-94%) and 88% (80-95%). In the low-risk group (five studies) these values were 75% (39-93%) and 91% (77-97%), respectively. CONCLUSIONS: A limited number of small studies suggest that MRI combined with MRSI could be a rule-in test for low-risk patients. This finding needs further confirmation in larger studies and cost-effectiveness needs to be established.

Approach to the patient with drug allergy

Clinicians commonly encounter patients who report to have drug allergy. In a large part, such allergy corresponds to adverse drug reactions, which are not immune mediated. The incriminated drug need not always be avoided for further therapy. On the other hand, drug allergy may manifest in many unexpected clinical pictures and thus not be recognized. There is no single standardized diagnostic test to confirm the immune-mediated mechanism and to identify the causative drug. Therefore, immune-mediated drug hypersensitivity reactions and their causative drugs have to be considered by the constellation of exposure, timing, and clinical features, including the pattern of organ manifestation. Prior experience with the drug is also an important feature. An allergologic workup with additional investigation may provide some help. Patients should be informed carefully about their drug allergy, whereby symptoms, drug that elicits reaction, modes of diagnosis of drug allergy, and possibly alternatives should be indicated in their allergy passport.