Bayesian generalized linear models for meta-analysis of diagnostic tests

With the recognition of the importance of evidence-based medicine, there is an emerging need for methods to systematically synthesize available data. Specifically, methods to provide accurate estimates of test characteristics for diagnostic tests are needed to help physicians make better clinical decisions. To provide more flexible approaches for meta-analysis of diagnostic tests, we developed three Bayesian generalized linear models. Two of these models, a bivariate normal and a binomial model, analyzed pairs of sensitivity and specificity values while incorporating the correlation between these two outcome variables. Noninformative independent uniform priors were used for the variance of sensitivity, specificity and correlation. We also applied an inverse Wishart prior to check the sensitivity of the results. The third model was a multinomial model where the test results were modeled as multinomial random variables. All three models can include specific imaging techniques as covariates in order to compare performance. Vague normal priors were assigned to the coefficients of the covariates. The computations were carried out using the 'Bayesian inference using Gibbs sampling' implementation of Markov chain Monte Carlo techniques. We investigated the properties of the three proposed models through extensive simulation studies. We also applied these models to a previously published meta-analysis dataset on cervical cancer as well as to an unpublished melanoma dataset. In general, our findings show that the point estimates of sensitivity and specificity were consistent among Bayesian and frequentist bivariate normal and binomial models. However, in the simulation studies, the estimates of the correlation coefficient from Bayesian bivariate models are not as good as those obtained from frequentist estimation regardless of which prior distribution was used for the covariance matrix. The Bayesian multinomial model consistently underestimated the sensitivity and specificity regardless of the sample size and correlation coefficient. In conclusion, the Bayesian bivariate binomial model provides the most flexible framework for future applications because of its following strengths: (1) it facilitates direct comparison between different tests; (2) it captures the variability in both sensitivity and specificity simultaneously as well as the intercorrelation between the two; and (3) it can be directly applied to sparse data without ad hoc correction. ^

Proceedings of the First Conference on Cancer Diagnostic Tests /

Mode of access: Internet.

Genetic diversity of Plasmodium falciparum histidine-rich protein 2 (PfHRP2) and its effect on the performance of PfHRP2-based rapid diagnostic tests

Rising costs of antimalarial agents are increasing the demand for accurate diagnosis of malaria. Rapid diagnostic tests (RDTs) offer great potential to improve the diagnosis of malaria, particularly in remote areas. Many RDTs are based on the detection of Plasmodium falciparum histidine-rich protein (PfHRP) 2, but reports from field tests have questioned their sensitivity and reliability. We hypothesize that the variability in the results of PfHRP2-based RDTs is related to the variability in the target antigen. We tested this hypothesis by examining the genetic diversity of PfHRP2, which includes numerous amino acid repeats, in 75 P. falciparum lines and isolates originating from 19 countries and testing a subset of parasites by use of 2 PfHRP2-based RDTs. We observed extensive diversity in PfHRP2 sequences, both within and between countries. Logistic regression analysis indicated that 2 types of repeats were predictive of RDT detection sensitivity (87.5% accuracy), with predictions suggesting that only 84% of P. falciparum parasites in the Asia-Pacific region are likely to be detected at densities

Effect of sequence variation in Plasmodium falciparum Histidine-Rich protein 2 on binding of specific monoclonal antibodies: Implications for rapid diagnostic tests for malaria

This Article Right arrow Full Text Right arrow Full Text (PDF) Right arrow Supplemental material Right arrow Alert me when this article is cited Right arrow Alert me if a correction is posted Services Right arrow Similar articles in this journal Right arrow Similar articles in PubMed Right arrow Alert me to new issues of the journal Right arrow Download to citation manager Right arrow Reprints and Permissions Right arrow Copyright Information Right arrow Books from ASM Press Right arrow MicrobeWorld Citing Articles Right arrow Citing Articles via HighWire Right arrow Citing Articles via Google Scholar Google Scholar Right arrow Articles by Lee, N. Right arrow Articles by McCarthy, J. Right arrow Search for Related Content PubMed Right arrow PubMed Citation Right arrow Articles by Lee, N. Right arrow Articles by McCarthy, J. Right arrow Pubmed/NCBI databases * Substance via MeSH Previous Article | Next Article Journal of Clinical Microbiology, August 2006, p. 2773-2778, Vol. 44, No. 8 0095-1137/06/$08.00+0 doi:10.1128/JCM.02557-05 Copyright © 2006, American Society for Microbiology. All Rights Reserved. Effect of Sequence Variation in Plasmodium falciparum Histidine- Rich Protein 2 on Binding of Specific Monoclonal Antibodies: Implications for Rapid Diagnostic Tests for Malaria{dagger} Nelson Lee,1,2 Joanne Baker,2 Kathy T. Andrews,1 Michelle L. Gatton,1,3 David Bell,4 Qin Cheng,2,3 and James McCarthy1* Australian Centre for International and Tropical Health and Nutrition, Queensland Institute of Medical Research and School of Population Health, University of Queensland, Queensland, Australia,1 Department of Drug Resistance and Diagnostics, Australian Army Malaria Institute, Brisbane, Australia,2 Malaria Drug Resistance and Chemotherapy, Queensland Institute of Medical Research, Queensland, Australia,3 World Health Organization, Regional Office for the Western Pacific, Manila, Philippines4 Received 8 December 2005/ Returned for modification 23 February 2006/ Accepted 26 May 2006 The ability to accurately diagnose malaria infections, particularly in settings where laboratory facilities are not well developed, is of key importance in the control of this disease. Rapid diagnostic tests (RDTs) offer great potential to address this need. Reports of significant variation in the field performance of RDTs based on the detection of Plasmodium falciparum histidine-rich protein 2 (HRP2) (PfHRP2) and of significant sequence polymorphism in PfHRP2 led us to evaluate the binding of four HRP2-specific monoclonal antibodies (MABs) to parasite proteins from geographically distinct P. falciparum isolates, define the epitopes recognized by these MABs, and relate the copy number of the epitopes to MAB reactivity. We observed a significant difference in the reactivity of the same MAB to different isolates and between different MABs tested with single isolates. When the target epitopes of three of the MABs were determined and mapped onto the peptide sequences of the field isolates, significant variability in the frequency of these epitopes was observed. These findings support the role of sequence variation as an explanation for variations in the performance of HRP2-based RDTs and point toward possible approaches to improve their diagnostic sensitivities

Diagnostic Tests and their Application in the Management of Soil- and Water-borne Oomycete Pathogen Species

Oomycete diseases cause significant losses across a broad range of crop and aquaculture commodities worldwide. These losses can be greatly reduced by disease management practices steered by accurate and early diagnoses of pathogen presence. Determinations of disease potential can help guide optimal crop rotation regimes, varietal selections, targeted control measures, harvest timings and crop post-harvest handling. Pathogen detection prior to infection can also reduce the incidence of disease epidemics. Classical methods for the isolation of oomycete pathogens are normally deployed only after disease symptom appearance. These processes are often-time consuming, relying on culturing the putative pathogen(s) and the availability of expert taxonomic skills for accurate identification; a situation that frequently results in either delayed application, or routine ‘blanket’ over-application of control measures. Increasing concerns about pesticides in the environment and the food chain, removal or restriction of their usage combined with rising costs have focussed interest in the development and improvement of disease management systems. To be effective, these require timely, accurate and preferably quantitatve diagnoses. A wide range of rapid diagnostic tools, from point of care immunodiagnostic kits to next generation nucleotide sequencing have potential application in oomycete disease management. Here we review currently-available as well as promising new technologies in the context of commercial agricultural production systems, considering the impacts of specific biotic and abiotic and other important factors such as speed and ease of access to information and cost effectiveness

Utility and safety of invasive (fractional flow reserve) and non-invasive (cardiac magnetic resonance imaging) diagnostic tests in patients with NSTEMI

A prospective randomised controlled clinical trial of treatment decisions informed by invasive functional testing of coronary artery disease severity compared with standard angiography-guided management was implemented in 350 patients with a recent non-ST elevation myocardial infarction (NSTEMI) admitted to 6 hospitals in the National Health Service. The main aims of this study were to examine the utility of both invasive fractional flow reserve (FFR) and non-invasive cardiac magnetic resonance imaging (MRI) amongst patients with a recent diagnosis of NSTEMI. In summary, the findings of this thesis are: (1) the use of FFR combined with intravenous adenosine was feasible and safe amongst patients with NSTEMI and has clinical utility; (2) there was discordance between the visual, angiographic estimation of lesion significance and FFR; (3). The use of FFR led to changes in treatment strategy and an increase in prescription of medical therapy in the short term compared with an angiographically guided strategy; (4) in the incidence of major adverse cardiac events (MACE) at 12 months follow up was similar in the two groups. Cardiac MRI was used in a subset of patients enrolled in two hospitals in the West of Scotland. T1 and T2 mapping methods were used to delineate territories of acute myocardial injury. T1 and T2 mapping were superior when compared with conventional T2-weighted dark blood imaging for estimation of the ischaemic area-at-risk (AAR) with less artifact in NSTEMI. There was poor correlation between the angiographic AAR and MRI methods of AAR estimation in patients with NSTEMI. FFR had a high accuracy at predicting inducible perfusion defects demonstrated on stress perfusion MRI. This thesis describes the largest randomized trial published to date specifically looking at the clinical utility of FFR in the NSTEMI population. We have provided evidence of the diagnostic and clinical utility of FFR in this group of patients and provide evidence to inform larger studies. This thesis also describes the largest ever MRI cohort, including with myocardial stress perfusion assessments, specifically looking at the NSTEMI population. We have demonstrated the diagnostic accuracy of FFR to predict reversible ischaemia as referenced to a non-invasive gold standard with MRI. This thesis has also shown the futility of using dark blood oedema imaging amongst all comer NSTEMI patients when compared to novel T1 and T2 mapping methods.

Cost effectiveness of OptiMal (R) rapid diagnostic test for malaria in remote areas of the Amazon Region, Brazil

Background: In areas with limited structure in place for microscopy diagnosis, rapid diagnostic tests (RDT) have been demonstrated to be effective. Method: The cost-effectiveness of the Optimal (R) and thick smear microscopy was estimated and compared. Data were collected on remote areas of 12 municipalities in the Brazilian Amazon. Data sources included the National Malaria Control Programme of the Ministry of Health, the National Healthcare System reimbursement table, hospitalization records, primary data collected from the municipalities, and scientific literature. The perspective was that of the Brazilian public health system, the analytical horizon was from the start of fever until the diagnostic results provided to patient and the temporal reference was that of year 2006. The results were expressed in costs per adequately diagnosed cases in 2006 U. S. dollars. Sensitivity analysis was performed considering key model parameters. Results: In the case base scenario, considering 92% and 95% sensitivity for thick smear microscopy to Plasmodium falciparum and Plasmodium vivax, respectively, and 100% specificity for both species, thick smear microscopy is more costly and more effective, with an incremental cost estimated at US$ 549.9 per adequately diagnosed case. In sensitivity analysis, when sensitivity and specificity of microscopy for P. vivax were 0.90 and 0.98, respectively, and when its sensitivity for P. falciparum was 0.83, the RDT was more cost-effective than microscopy. Conclusion: Microscopy is more cost-effective than OptiMal (R) in these remote areas if high accuracy of microscopy is maintained in the field. Decision regarding use of rapid tests for diagnosis of malaria in these areas depends on current microscopy accuracy in the field.

Quantitative myocardial contrast echocardiography during pharmacological stress for diagnosis of coronary artery disease: a systematic review and meta-analysis of diagnostic accuracy studies

Aims We conducted a meta-analysis to evaluate the accuracy of quantitative stress myocardial contrast echocardiography (MCE) in coronary artery disease (CAD). Methods and results Database search was performed through January 2008. We included studies evaluating accuracy of quantitative stress MCE for detection of CAD compared with coronary angiography or single-photon emission computed tomography (SPECT) and measuring reserve parameters of A, beta, and A beta. Data from studies were verified and supplemented by the authors of each study. Using random effects meta-analysis, we estimated weighted mean difference (WMD), likelihood ratios (LRs), diagnostic odds ratios (DORs), and summary area under curve (AUC), all with 95% confidence interval (0). Of 1443 studies, 13 including 627 patients (age range, 38-75 years) and comparing MCE with angiography (n = 10), SPECT (n = 1), or both (n = 2) were eligible. WMD (95% CI) were significantly less in CAD group than no-CAD group: 0.12 (0.06-0.18) (P < 0.001), 1.38 (1.28-1.52) (P < 0.001), and 1.47 (1.18-1.76) (P < 0.001) for A, beta, and A beta reserves, respectively. Pooled LRs for positive test were 1.33 (1.13-1.57), 3.76 (2.43-5.80), and 3.64 (2.87-4.78) and LRs for negative test were 0.68 (0.55-0.83), 0.30 (0.24-0.38), and 0.27 (0.22-0.34) for A, beta, and A beta reserves, respectively. Pooled DORs were 2.09 (1.42-3.07), 15.11 (7.90-28.91), and 14.73 (9.61-22.57) and AUCs were 0.637 (0.594-0.677), 0.851 (0.828-0.872), and 0.859 (0.842-0.750) for A, beta, and A beta reserves, respectively. Conclusion Evidence supports the use of quantitative MCE as a non-invasive test for detection of CAD. Standardizing MCE quantification analysis and adherence to reporting standards for diagnostic tests could enhance the quality of evidence in this field.

Canine visceral leishmaniasis: Performance of a rapid diagnostic test (Kalazar Detect (TM)) in dogs with and without signs of the disease

Current visceral leishmaniasis (VL) control programs in Brazil include the infected dog elimination but, despite this strategy, the incidence of human VL is still increasing. One of the reasons is the long delay between sample collection, analysis, control implementation and the low sensitivity of diagnostic tests. Due to the high prevalence of asymptomatic dogs, the diagnosis of these animals is important considering their vector infection capacity. Hence, a rapid and accurate diagnosis of canine visceral leishmaniasis is essential for an efficient surveillance program. In this study we evaluated the performance of rK39 antigen in an immunochromatographic format to detect symptomatic and asymptomatic Leishmania chagasi infection in dogs and compared the results with those using a crude antigen ELISA. The sensitivity of rK39 dipstick and ELISA were 83% vs. 95%, respectively, while the specificity was both 100%. Our results also demonstrated that the dipstick test was able to detect infected dogs presenting different clinical forms. (C) 2008 Elsevier B.V. All rights reserved.

Sensitivity and specificity of pooled faecal culture and serology as flock-screening tests for detection of ovine paratuberculosis in Australia

The flock-level sensitivity of pooled faecal culture and serological testing using AGID for the detection of ovine Johne's disease-infected flocks were estimated using non-gold-standard methods. The two tests were compared in an extensive field trial in 296 flocks in New South Wales during 1998. In each flock, a sample of sheep was selected and tested for ovine Johne's disease using both the AGID and pooled faecal culture. The flock-specificity of pooled faecal culture also was estimated from results of surveillance and market-assurance testing in New South Wales. The overall flock-sensitivity of pooled faecal culture was 92% (95% CI: 82.4 and 97.4%) compared to 61% (50.5 and 70.9%) for serology (assuming that both tests were 100% specific). In low-prevalence flocks (estimated prevalence

Polymerase chain reaction tests for the identification of Ross River, Kunjin and Murray Valley encephalitis virus infections in horses

Objective To develop and validate specific, sensitive and rapid diagnostic tests using RT-PCR for the detection of Ross River virus (RRV), Kunjin virus (KV) and Murray Valley encephalitis virus (MVEV) infections in horses. Methods Primer sets based on nucleotide sequence encoding the envelope glycoprotein E2 of RRV and on the nonstructural protein 5 (NS5) of KV and MVEV were designed and used in single round PCRs to test for the respective viruses in infected cell cultures and, in the case of RRV, in samples of horse blood and synovial fluid. Results The primer pairs designed for each of the three viruses amplified a product of expected size from prototype viruses that were grown in cell culture. The identity of each of the products was confirmed by nucleotide sequencing indicating that in the context used the RT-PCRs were specific. RRV was detected in serums from 8 horses for which there were clinical signs consistent with RRV infection such that an acute-phase serum sample was taken and submitted for RRV serology testing. The RRV RT-PCR was analytically sensitive in that it was estimated to detect as little as 50 TCID50 of RRV per mL of serum and was specific in that the primer pairs did not amplify other products from the 8 serum samples. The RRV primers also detected virus in three independent mosquito pools known to contain RRV by virus isolation in cell culture. Samples from horses suspected to be infected with KV and MVEV were not available. Conclusion Despite much anecdotal and serological evidence for infection of horses with RRV actual infection and associated clinical disease are infrequently confirmed. The availability of a specific and analytically sensitive RT-PCR for the detection of RRV provides additional opportunities to confirm the presence of this virus in clinical samples. The RTPCR primers for the diagnosis of KV and MVEV infections were shown to be specific for cell culture grown viruses but the further validation of these tests requires the availability of appropriate clinical samples from infected horses.

Performance of a rapid diagnostic test for the detection of visceral leishmaniasis in a large urban setting

Introduction Rapid diagnostic tests (RDTs) may improve the early detection of visceral leishmaniasis (VL), but their real-world performance requires additional study. Therefore, we evaluated the performance of an rK39-based RDT (Kalazar Detect™) for the detection of VL in an endemic, large urban area. Methods Data were collected from a registry of rK39 RDT performed at 11 emergency care units in Belo Horizonte, Brazil, and from a national database of reportable communicable diseases of the Sistema de Informação de Agravos de Notificação (SINAN). Results The rapid rK39 test was performed in 476 patients, with 114 (23.9%) positive results. The analysis of rK39 RDT performance was based on 381 (80%) cases reported to the SINAN database, of which 145 (38.1%) were confirmed cases. Estimates for sensitivity and specificity were 72.4% (95% CI: 64.6-79%) and 99.6% (95%CI: 97.6-99.9%), respectively. Positive and negative predictive values were estimated at 99.1% (95%CI: 94.9-99.8%) and 85.5% (95%CI: 80.8-89.1%), respectively. In addition, close agreement between the rK39 RDT and indirect immunofluorescence was observed. Conclusions In summary, the rK39 RDT showed a high specificity but only moderate sensitivity. In endemic areas for VL, treatment may be considered in cases with clinical manifestations and a positive rK39 RDT, but those with a negative test should be subjected to further investigation.

Viability study of a multiplex diagnostic platform for Chagas disease

A new multiplex assay platform was evaluated to detect Trypanosoma cruzi infection using the recombinant antigens CRA, FRA, CRAFRA fusion and parasite lysate. The antigens presented different sensitivity and specificity in a singleplex test when compared to a serial dilution of two pools comprising 10 positive serum samples and one pool of 10 negative samples. The recombinant protein CRA presented lower sensitivity (55%) in contrast to the 100% specificity and sensitivity of FRA, CRAFRA and T. cruzi lysate. These antigens also showed good results in a duplex test and the duplex test with CRAFRA/T. cruzi lysate showed better performance with 100% specificity and sensitivity, as well as a lower cut-off value in comparison to the other duplex test, FRA/T. cruzi lysate. Hence, when the antigens were used in duplex format, both tests showed decreased cut-off values and no interference between different bead sets, resulting in increasing sensitivity and specificity. The results of these multiplex tests show that they could be an alternative to singleplex detection for Chagas disease, and also indicate the necessity of using multiplex diagnostic tools to increase the sensitivity and specificity for diagnostic tests. Emerging data from the T. cruzi genome and from its ORFeome project will also allow the identification of new antigens for this disease detection application.