The clinical reasoning characteristics of diagnostic experts

The aim of this study was to identify and describe the clinical reasoning characteristics of diagnostic experts. A group of 21 experienced general practitioners were asked to complete the Diagnostic Thinking Inventory (DTI) and a set of 10 clinical reasoning problems (CRPs) to evaluate their clinical reasoning. Both the DTI and the CRPs were scored, and the CRP response patterns of each GP examined in terms of the number and type of errors contained in them. Analysis of these data showed that six GPs were able to reach the correct diagnosis using significantly less clinical information than their colleagues. These GPs also made significantly fewer interpretation errors but scored lower on both the DTI and the CRPs. Additionally, this analysis showed that more than 20% of misdiagnoses occurred despite no errors being made in the identification and interpretation of relevant clinical information. These results indicate that these six GPs diagnose efficiently, effectively and accurately using relatively few clinical data and can therefore be classified as diagnostic experts. They also indicate that a major cause of misdiagnoses is failure to properly integrate clinical data. We suggest that increased emphasis on this step in the reasoning process should prove beneficial to the development of clinical reasoning skill in undergraduate medical students.

Accuracy of LightCycler® SeptiFast for the detection and identification of pathogens in the blood of patients with suspected sepsis: a systematic review protocol

Background: There is growing interest in the potential utility of molecular diagnostics in improving the detection of life-threatening infection (sepsis). LightCycler® SeptiFast is a multipathogen probebased real-time PCR system targeting DNA sequences of bacteria and fungi present in blood samples within a few hours. We report here the protocol of the first systematic review of published clinical diagnostic accuracy studies of this technology when compared with blood culture in the setting of suspected sepsis. Methods/design: Data sources: the Cochrane Database of Systematic Reviews, the Database of Abstracts of Reviews of Effects (DARE), the Health Technology Assessment Database (HTA), the NHS Economic Evaluation Database (NHSEED), The Cochrane Library, MEDLINE, EMBASE, ISI Web of Science, BIOSIS Previews, MEDION and the Aggressive Research Intelligence Facility Database (ARIF). Study selection: diagnostic accuracy studies that compare the real-time PCR technology with standard culture results performed on a patient's blood sample during the management of sepsis. Data extraction: three reviewers, working independently, will determine the level of evidence, methodological quality and a standard data set relating to demographics and diagnostic accuracy metrics for each study. Statistical analysis/data synthesis: heterogeneity of studies will be investigated using a coupled forest plot of sensitivity and specificity and a scatter plot in Receiver Operator Characteristic (ROC) space. Bivariate model method will be used to estimate summary sensitivity and specificity. The authors will investigate reporting biases using funnel plots based on effective sample size and regression tests of asymmetry. Subgroup analyses are planned for adults, children and infection setting (hospital vs community) if sufficient data are uncovered. Dissemination: Recommendations will be made to the Department of Health (as part of an open-access HTA report) as to whether the real-time PCR technology has sufficient clinical diagnostic accuracy potential to move forward to efficacy testing during the provision of routine clinical care.

The accuracy of accredited glaucoma optometrists in the diagnosis and treatment recommendation for glaucoma

Aim: To compare the diagnostic performance of accredited glaucoma optometrists (AGO) for both the diagnosis of glaucoma and the decision to treat with that of routine hospital eye care, against a reference standard of expert opinion (a consultant ophthalmologist with a special interest in glaucoma). Methods: A directly comparative, masked, performance study was undertaken in Grampian, Scotland. Of 165 people invited to participate, 100 (61%) were examined. People suspected of having glaucoma underwent, within one month, a full ophthalmic assessment in both a newly established community optometry led glaucoma management scheme and a consultant led hospital eye service. Results: Agreement between the AGO and the consultant ophthalmologist in diagnosing glaucoma was substantial (89%; ? = 0.703, SE = 0.083). Agreement over the need for treatment was also substantial (88%; ? = 0.716, SE = 0.076). The agreement between the trainee ophthalmologists and the consultant ophthalmologist in the diagnosis of glaucoma and treatment recommendation was moderate (83%, ? = 0.541, SE = 0.098, SE = 0.98; and 81%, ? = 0.553, SE = 0.90, respectively). The diagnostic accuracy of the optometrists in detecting glaucoma in this population was high for specificity (0.93 (95% confidence interval, 0.85 to 0.97)) but lower for sensitivity (0.76 (0.57 to 0.89)). Performance was similar when accuracy was assessed for treatment recommendation (sensitivity 0.73 (0.57 to 0.85); specificity 0.96 (0.88 to 0.99)). The differences in sensitivity and specificity between AGO and junior ophthalmologist were not statistically significant. Conclusions: Community optometrists trained in glaucoma provided satisfactory decisions regarding diagnosis and initiation of treatment for glaucoma. With such additional training in glaucoma, optometrists are at least as accurate as junior ophthalmologists but some cases of glaucoma are missed.

Validation of Next Generation Sequencing Technologies in Comparison to Current Diagnostic Gold Standards for BRAF, EGFR and KRAS Mutational Analysis

Next Generation Sequencing (NGS) has the potential of becoming an important tool in clinical diagnosis and therapeutic decision-making in oncology owing to its enhanced sensitivity in DNA mutation detection, fast-turnaround of samples in comparison to current gold standard methods and the potential to sequence a large number of cancer-driving genes at the one time. We aim to test the diagnostic accuracy of current NGS technology in the analysis of mutations that represent current standard-of-care, and its reliability to generate concomitant information on other key genes in human oncogenesis. Thirteen clinical samples (8 lung adenocarcinomas, 3 colon carcinomas and 2 malignant melanomas) already genotyped for EGFR, KRAS and BRAF mutations by current standard-of-care methods (Sanger Sequencing and q-PCR), were analysed for detection of mutations in the same three genes using two NGS platforms and an additional 43 genes with one of these platforms. The results were analysed using closed platform-specific proprietary bioinformatics software as well as open third party applications. Our results indicate that the existing format of the NGS technology performed well in detecting the clinically relevant mutations stated above but may not be reliable for a broader unsupervised analysis of the wider genome in its current design. Our study represents a diagnostically lead validation of the major strengths and weaknesses of this technology before consideration for diagnostic use.

Accuracy of LightCycler SeptiFast for the detection and identification of pathogens in the blood of patients with suspected sepsis: a systematic review and meta-analysis

Purpose: There is an urgent need to develop diagnostic tests to improve the detection of pathogens causing life-threatening infection (sepsis). SeptiFast is a CE-marked multi-pathogen real-time PCR system capable of detecting DNA sequences of bacteria and fungi present in blood samples within a few hours. We report here a systematic review and meta-analysis of diagnostic accuracy studies of SeptiFast in the setting of suspected sepsis.

Methods: A comprehensive search strategy was developed to identify studies that compared SeptiFast with blood culture in suspected sepsis. Methodological quality was assessed using QUADAS. Heterogeneity of studies was investigated using a coupled forest plot of sensitivity and specificity and a scatter plot in receiver operator characteristic space. Bivariate model method was used to estimate summary sensitivity and specificity.

Results: From 41 phase III diagnostic accuracy studies, summary sensitivity and specificity for SeptiFast compared with blood culture were 0.68 (95 % CI 0.63–0.73) and 0.86 (95 % CI 0.84–0.89) respectively. Study quality was judged to be variable with important deficiencies overall in design and reporting that could impact on derived diagnostic accuracy metrics.

Conclusions: SeptiFast appears to have higher specificity than sensitivity, but deficiencies in study quality are likely to render this body of work unreliable. Based on the evidence presented here, it remains difficult to make firm recommendations about the likely clinical utility of SeptiFast in the setting of suspected sepsis.

Diagnostic performance on briefly presented digital pathology images

Background: Identifying new and more robust assessments of proficiency/expertise (finding new "biomarkers of expertise") in histopathology is desirable for many reasons. Advances in digital pathology permit new and innovative tests such as flash viewing tests and eye tracking and slide navigation analyses that would not be possible with a traditional microscope. The main purpose of this study was to examine the usefulness of time-restricted testing of expertise in histopathology using digital images.
Methods: 19 novices (undergraduate medical students), 18 intermediates (trainees), and 19 experts (consultants) were invited to give their opinion on 20 general histopathology cases after 1 s and 10 s viewing times. Differences in performance between groups were measured and the internal reliability of the test was calculated.
Results: There were highly significant differences in performance between the groups using the Fisher's least significant difference method for multiple comparisons. Differences between groups were consistently greater in the 10-s than the 1-s test. The Kuder-Richardson 20 internal reliability coefficients were very high for both tests: 0.905 for the 1-s test and 0.926 for the 10-s test. Consultants had levels of diagnostic accuracy of 72% at 1 s and 83% at 10 s.
Conclusions: Time-restricted tests using digital images have the potential to be extremely reliable tests of diagnostic proficiency in histopathology. A 10-s viewing test may be more reliable than a 1-s test. Over-reliance on "at a glance" diagnoses in histopathology is a potential source of medical error due to over-confidence bias and premature closure.

A Benefit-Risk Assessment Framework for Development of Clinical Guidelines in Diagnostic Radiology

Thesis (Ph.D.)--University of Washington, 2015-12

Accuracy of Periapical Radiography and Cone-Beam Computed Tomography Scans in Diagnosing Apical Periodontitis Using Histopathological Findings as a Gold Standard

Introduction: The aim of this study was to evaluate the accuracy of two imaging methods in diagnosing apical periodontitis (AP) using histopathological findings as a gold standard. Methods: The periapex of 83 treated or untreated roots of dogs` teeth was examined using periapical radiography (PR), cone-beam computed tomography (CBCT) scans, and histology. Sensitivity, specificity, predictive values, and accuracy of PR and CBCT diagnosis were calculated. Results: PR detected AP in 71% of roots, a CBCT scan detected AP in 84%, and AP was histologically diagnosed in 93% (p = 0.001). Overall, sensitivity was 0.77 and 0.91 for PR and CBCT, respectively. Specificity was 1 for both. Negative predictive value was 0.25 and 0.46 for PR and CBCT, respectively. Positive predictive value was 1 for both. Diagnostic accuracy (true positives + true negatives) was 0.78 and 0.92 for PR and CBCT (p = 0.028), respectively. Conclusion: A CBCT scan was more sensitive in detecting AP compared with PR, which was more likely to miss AP when it was still present. (J Endod 2009;35:1009-1012)

Recurrent events counted in evaluations of predictive accuracy

Objectives: To describe an alternate approach for the calculation of sensitivity and specificity when analyzing the accuracy of screening tools, which can be used when standard calculations may be inappropriate. Sensitivity^ER (ER denoting event rate) is the number of events correctly predicted, divided by the total number of events. Specificity^ER is the amount of time that study participants are predicted to be event negative, divided by the total amount of participant observed time. Variance estimates for these statistics are constructed by bootstrap resampling, taking into account event dependence.

Methods: Standard and alternate approaches for calculating sensitivity and specificity were applied to hospital falls risk screening tool data. In this application, the outcome of interest was a recurrent event, there were multiple applications of the screening tool, delays in screening tool  completion, and patients' follow-up durations were unequal.

Results: Application of sensitivity^ER and specificity^ER to this data not only provided a clearer description of the screening tool's overall accuracy, but also allowed examination of accuracy over time, accuracy in predicting specific event numbers, and evaluation of the added value that screening tool reapplications may have.

Conclusion: Sensitivity^ER and specificity^ER provide a valuable approach to screening tool evaluation in the clinical setting.

Accuracy of zoomed digital image in the detection of periodontal bone defect: in vitro study

Objectives: (1) To evaluate the intraobserver agreement related to image interpretation and (2) to compare the accuracy of 100%, 200% and 400% zoomed digital images in the detection of simulated periodontal bone defects.Methods: Periodontal bone defects were created in 60 pig hemi-mandibles with slow-speed burs 0.5 mm, 1.0 mm, 1.5 mm, 2.0 mm and 3.0 mm in diameter. 180 standardized digital radiographs were made using Schick sensor and evaluated at 100%, 200% and 400% zooming. The intraobserver agreement was estimated by Kappa statistic (kappa). For the evaluation of diagnostic accuracy receiver operating characteristic (ROC) analysis was performed followed by chi-square test to compare the areas under ROC curves according to each level of zooming.Results: For 100%, 200% and 400% zooming the intraobserver agreement was moderate (kappa = 0.48, kappa = 0.54 and kappa = 0.43, respectively) and there were similar performances in the discrimination capacity, with ROC areas of 0.8611 (95% CI: 0.7660-0.9562), 0.8600 (95% CI: 0.7659-0.9540), and 0.8368 (95% CI: 0.7346-0.9390), respectively, with no statistical significant differences (chi(2)-test; P = 0.8440).Conclusions: A moderate intraobserver agreement was observed in the classification of periodontal bone defects and the 100%, 200% and 400% zoomed digital images presented similar performances in the detection of periodontal bone defects.

The diagnostic value of Gram stain for initial identification of the etiologic agent of peritonitis in CAPD patients

Objective: To evaluate the effectiveness of the Gram stain in the initial diagnosis of the etiologic agent of peritonitis in continuous ambulatory peritoneal dialysis (CAPD). Design: Retrospective study analyzing the sensitivity (S), specificity (SS), positive predictive value (+PV), and negative predictive value (-PV) of the Gram stain relating to the results of cultures in 149 episodes of peritonitis in CAPD. The data were analyzed in two studies. In the first, only the cases with detection of a single agent by Gram stain were taken (Study 1). In the second, only the cases with two agents in Gram stain were evaluated (Study 2). Setting: Dialysis Unit and Laboratory of Microbiology of a tertiary medical center. Patients: Sixty-three patients on regular CAPD who presented one or more episodes of peritonitis from May 1992 to May 1995. Results: The positivity of Gram stain was 93.2% and the sensitivity was 95.7%. The values of S, SS, +PV, and -PV were respectively: 94.9%, 53.5%, 68.3%, and 90.9% for gram-positive cocci and 83.3%, 98.8%, 95.2%, and 95.6% for gram-negative bacilli. The association of gram-positive cocci plus gram-negative bacilli were predictive of growth of both in 6.8%, growth of gram-positive cocci in 13.7%, and growth of gram-negative bacilli in 72.5%. Conclusions: The Gram stain is a method of great value in the initial diagnosis of the etiologic agent of peritonitis in CAPD, especially for gram-negative bacilli.

Diagnostic value of serum activin A and follistatin levels in women with peritoneal, ovarian and deep infiltrating endometriosis

Activin A is a growth factor, produced by the endometrium, whose actions are modulated by the binding protein follistatin. Both proteins are detectable in the peripheral serum and their concentrations may be increased in women with endometriosis. The present study was designed to evaluate whether serum levels of activin A and follistatin are altered, and therefore have a potential diagnostic value, in women with peritoneal, ovarian and deep infiltrating endometriosis. We performed a multicenter controlled study evaluating simultaneously serum activin A and follistatin concentrations in women with and without endometriosis. Women with endometriosis (n 139) were subdivided into three groups: peritoneal endometriosis (n 28); ovarian endometrioma (n 61) and deep infiltrating endometriosis (n 50). The control group (n 75) consisted of healthy women with regular menstrual cycles. Blood samples were collected from a peripheral vein and assayed for activin A and follistatin using commercially available enzyme immunoassay kits. The ovarian endometrioma group had serum activin A levels significantly higher than healthy controls (0.22 0.01 ng/ml versus 0.17 0.01 ng/ml, P 0.01). None of the endometriosis groups had serum follistatin levels which were significantly altered compared with healthy controls; however, levels found in the endometrioma group (2.34 0.32 ng/ml) were higher than that in the deep endometriosis group (1.50 0.17 ng/ml, P 0.05). The area under the receiver operating characteristic curve of activin A was 0.700 (95 confidence interval: 0.6050.794), while that of follistatin was 0.620 (95 confidence interval: 0.5100.730) for the diagnosis of ovarian endometrioma. The combination of both markers into a duo marker index did not improve significantly their diagnostic accuracy. The present study demonstrated that serum activin A and follistatin are not significantly altered in peritoneal or deep infiltrating endometriosis and have limited diagnostic accuracy in the diagnosis of ovarian endometrioma.

Accuracy of immunological criteria for identifying virological failure in children on antiretroviral therapy - The IeDEA Southern Africa Collaboration

Objectives  To determine the diagnostic accuracy of World Health Organization (WHO) 2010 and 2006 as well as United States Department of Health and Human Services (DHHS) 2008 definitions of immunological failure for identifying virological failure (VF) in children on antiretroviral therapy (ART). Methods  Analysis of data from children (<16 years at ART initiation) at South African ART sites at which CD4 count/per cent and HIV-RNA monitoring are performed 6-monthly. Incomplete virological suppression (IVS) was defined as failure to achieve ≥1 HIV-RNA ≤400 copies/ml between 6 and 15 months on ART and viral rebound (VR) as confirmed HIV-RNA ≥5000 copies/ml in a child on ART for ≥18 months who had achieved suppression during the first year on treatment. Results  Among 3115 children [median (interquartile range) age 48 (20-84) months at ART initiation] on treatment for ≥1 year, sensitivity of immunological criteria for IVS was 10%, 6% and 26% for WHO 2006, WHO 2010 and DHHS 2008 criteria, respectively. The corresponding positive predictive values (PPV) were 31%, 20% and 20%. Diagnostic accuracy for VR was determined in 2513 children with ≥18 months of follow-up and virological suppression during the first year on ART with sensitivity of 5% (WHO 2006/2010) and 27% (DHHS 2008). PPV results were 42% (WHO 2010), 43% (WHO 2006) and 20% (DHHS 2008). Conclusion  Current immunological criteria are unable to correctly identify children failing ART virologically. Improved access to viral load testing is needed to reliably identify VF in children.

Effect of tumor size and tumor-to-liver contrast of hypovascular liver tumors on the diagnostic performance of hepatic CT imaging

To assess the effect of tumor size and tumor-to-liver contrast of simulated hypovascular liver tumors on the diagnostic accuracy of hepatic computed tomography (CT).

Accuracy of B-type natriuretic peptide tests to exclude congestive heart failure: systematic review of test accuracy studies

BACKGROUND: Congestive heart failure (CHF) is a major public health problem. The use of B-type natriuretic peptide (BNP) tests shows promising diagnostic accuracy. Herein, we summarize the evidence on the accuracy of BNP tests in the diagnosis of CHF and compare the performance of rapid enzyme-linked immunosorbent assay (ELISA) and standard radioimmunosorbent assay (RIA) tests. METHODS: We searched electronic databases and the reference lists of included studies, and we contacted experts. Data were extracted on the study population, the type of test used, and methods. Receiver operating characteristic (ROC) plots and summary ROC curves were produced and negative likelihood ratios pooled. Random-effect meta-analysis and metaregression were used to combine data and explore sources of between-study heterogeneity. RESULTS: Nineteen studies describing 22 patient populations (9 ELISA and 13 RIA) and 9093 patients were included. The diagnosis of CHF was verified by echocardiography, radionuclide scan, or echocardiography combined with clinical criteria. The pooled negative likelihood ratio overall from random-effect meta-analysis was 0.18 (95% confidence interval [CI], 0.13-0.23). It was lower for the ELISA test (0.12; 95% CI, 0.09-0.16) than for the RIA test (0.23; 95% CI, 0.16-0.32). For a pretest probability of 20%, which is typical for patients with suspected CHF in primary care, a negative result of the ELISA test would produce a posttest probability of 2.9%; a negative RIA test, a posttest probability of 5.4%. CONCLUSIONS: The use of BNP tests to rule out CHF in primary care settings could reduce demand for echocardiography. The advantages of rapid ELISA tests need to be balanced against their higher cost.