Next-generation sequencing: a change of paradigm in molecular diagnostic validation

Next-generation sequencing (NGS) is beginning to show its full potential for diagnostic and therapeutic applications. In particular, it is enunciating its capacity to contribute to a molecular taxonomy of cancer, to be used as a standard approach for diagnostic mutation detection, and to open new treatment options that are not exclusively organ-specific. If this is the case, how much validation is necessary and what should be the validation strategy, when bringing NGS into the diagnostic/clinical practice? This validation strategy should address key issues such as: what is the overall extent of the validation? Should essential indicators of test performance such as sensitivity of specificity be calculated for every target or sample type? Should bioinformatic interpretation approaches be validated with the same rigour? What is a competitive clinical turnaround time for a NGS-based test, and when does it become a cost-effective testing proposition? While we address these and other related topics in this commentary, we also suggest that a single set of international guidelines for the validation and use of NGS technology in routine diagnostics may allow us all to make a much more effective use of resources.

Diagnostic accuracy of loop-mediated isothermal amplification as a near-patient test for meningococcal disease in children: An observational cohort study

Background: Diagnosis of meningococcal disease relies on recognition of clinical signs and symptoms that are notoriously non-specific, variable, and often absent in the early stages of the disease. Loop-mediated isothermal amplification (LAMP) has previously been shown to be fast and effective for the molecular detection of meningococcal DNA in clinical specimens. We aimed to assess the diagnostic accuracy of meningococcal LAMP as a near-patient test in the emergency department.

Methods: For this observational cohort study of diagnostic accuracy, children aged 0-13 years presenting to the emergency department of the Royal Belfast Hospital for Sick Children (Belfast, UK) with suspected meningococcal disease were eligible for inclusion. Patients underwent a standard meningococcal pack of investigations testing for meningococcal disease. Respiratory (nasopharyngeal swab) and blood specimens were collected from patients and tested with near-patient meningococcal LAMP and the results were compared with those obtained by reference laboratory tests (culture and PCR of blood and cerebrospinal fluid).

Findings: Between Nov 1, 2009, and Jan 31, 2012, 161 eligible children presenting at the hospital underwent the meningococcal pack of investigations and were tested for meningococcal disease, of whom 148 consented and were enrolled in the study. Combined testing of respiratory and blood specimens with use of LAMP was accurate (sensitivity 89% [95% CI 72-96], specificity 100% [97-100], positive predictive value 100% [85-100]; negative predictive value 98% [93-99]) and diagnostically useful (positive likelihood ratio 213 [95% CI 13-infinity] and negative likelihood ratio 0·11 [0·04-0·32]). The median time required for near-patient testing from sample to result was 1 h 26 min (IQR 1 h 20 min-1 h 32 min).

Interpretation: Meningococcal LAMP is straightforward enough for use in any hospital with basic laboratory facilities, and near-patient testing with this method is both feasible and effective. By contrast with existing UK National Institute of Health and Care Excellence guidelines, we showed that molecular testing of non-invasive respiratory specimens from children is diagnostically accurate and clinically useful.

Changes in quality and safety attributes throughout long term storage of tomato juice processed by high pressure.

Tomato is the second most widely grown vegetable crop across the globe and it is one of widely cultivated crops in Sri Lanka. However, tomato industry in Sri Lanka facing a problem of high postharvest loss (54%) during the glut coupled with heavy revenue loss to the country by importing processed products. The aim of this work is to develop shelf-stable tomato product with maximum quality characteristics using high pressure processing (HPP). Tomato juice with altered and unaltered pH was processed using HPP at 600 MPa for 1 min after blanching (90 oC/2 min). As a control tomato juice was subjected to thermal processing (TP) at 95 oC /20 min. Processed samples were stored under 20oC and 28oC for 9 month period and analysed for total viable count (TVC) and instrumental colour (L, a, b) value at 0,1,2 3, and 4 week and 2, 3, 6 and 9 months interval. The raw juice sample had initial 6.69 log10 CFU/ml and both TP and HPP caused a more than 4.69 log10 reduction in the TVC of juice and microbial numbers remained low throughout the storage period even at 3 months after storage irrespective of the storage temperature. Both TP and HPP treated samples had the redness ⤘a value’ of 14.44-17.15 just after processing and showed non-significant reduction with storage in all the treatments after 3 months. The storage study results and discussed in relation to the end goal and compared with the literature.

Evaluation of the diagnostic potential of a novel field immunomagnetic separation-immunochromatographic lateral flow assay to detect Mycobacterium bovis cells in European badger (Meles meles) faeces

The European badger (Meles meles) is a natural reservoir for Mycobacterium bovis, the causative agent of Bovine Tuberculosis, and has consequently been implicated in transmission of the disease to cattle. This study describes application of a novel M. bovis-specific immunochromatographic (lateral flow) assay in combination with immunomagnetic separation (IMS-LFD), to test badger faeces samples. In total, 441 faeces samples from badgers of unknown disease status collected from latrines at 110 badger setts throughout Northern Ireland (NI) and 100 faeces samples from badgers of known infection status from Great Britain (GB) were tested. Faeces (approx. 1g) was homogenised in 9 ml phosphate buffered saline, filtered (70 µm), and then 6-8 ml subjected to the IMS-LFD test. Residual clarified faecal homogenates were subjected to automated IMS followed by MGIT™ liquid culture (AIMS-MGIT™ culture) and qPCR (AIMS-qPCR). Evidence for the presence of M. bovis was obtained for 78 (18%), 61 (14%) and 140 (32%) of 441 NI badger faeces samples, and 10 (10%), 41 (41%) and 56 (56%) of 100 GB badger faeces samples, by IMS-LFD, AIMS-MGIT culture and AIMS-qPCR tests, respectively. The IMS-LFD test was less sensitive than AIMS-qPCR for detection of M. bovis and was, therefore, detecting badgers shedding high numbers of M. bovis in their faeces only. However, these ‘super shedders’ may be primarily responsible for the spread of Bovine Tuberculosis so are, therefore, an important target. This non-invasive test could form the basis of a field surveillance tool to indicate infected badger groups which are actively spreading M. bovis.

Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review

Background: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. 

Objective: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. 

Design: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. 

Setting: Critical care departments within NHS hospitals in the north-west of England. 

Participants: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. 

Main outcome measures: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. 

Results: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4–16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. 

Conclusion: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error.

Predicting forest attributes In southeast Alaska using artificial neural networks

Artificial neural network (ANN) methods are used to predict forest characteristics. The data source is the Southeast Alaska (SEAK) Grid Inventory, a ground survey compiled by the USDA Forest Service at several thousand sites. The main objective of this article is to predict characteristics at unsurveyed locations between grid sites. A secondary objective is to evaluate the relative performance of different ANNs. Data from the grid sites are used to train six ANNs: multilayer perceptron, fuzzy ARTMAP, probabilistic, generalized regression, radial basis function, and learning vector quantization. A classification and regression tree method is used for comparison. Topographic variables are used to construct models: latitude and longitude coordinates, elevation, slope, and aspect. The models classify three forest characteristics: crown closure, species land cover, and tree size/structure. Models are constructed using n-fold cross-validation. Predictive accuracy is calculated using a method that accounts for the influence of misclassification as well as measuring correct classifications. The probabilistic and generalized regression networks are found to be the most accurate. The predictions of the ANN models are compared with a classification of the Tongass national forest in southeast Alaska based on the interpretation of satellite imagery and are found to be of similar accuracy.

Post-diagnostic oral bisphosphonate use and colorectal cancer mortality: a population-based cohort study within the UK Clinical Practice Research Datalink

Background:We conducted the first study to investigate post-diagnostic oral bisphosphonates use and colorectal cancer-specific mortality.

Methods:Colorectal cancer patients were identified from the National Cancer Data Repository (1998–2007) and linked to the UK Clinical Practice Research Datalink, providing prescription records, and Office of National Statistics mortality data. Time-dependent Cox regression models investigated colorectal cancer-specific mortality in post-diagnostic bisphosphonate users.

Results:Overall, in 4791 colorectal cancer patients, there was no evidence of an association between bisphosphonate use and colorectal cancer-specific mortality (adjusted hazard ratio=1.11; 95% confidence interval 0.80, 1.54) or with drug frequency or type.

Conclusions:In this novel population-based cohort study, post-diagnostic bisphosphonate use was not associated with longer rates of colorectal cancer survival.

Hui and Walter's latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data

Diagnostic test sensitivity and specificity are probabilistic estimates with far reaching implications for disease control, management and genetic studies. In the absence of 'gold standard' tests, traditional Bayesian latent class models may be used to assess diagnostic test accuracies through the comparison of two or more tests performed on the same groups of individuals. The aim of this study was to extend such models to estimate diagnostic test parameters and true cohort-specific prevalence, using disease surveillance data. The traditional Hui-Walter latent class methodology was extended to allow for features seen in such data, including (i) unrecorded data (i.e. data for a second test available only on a subset of the sampled population) and (ii) cohort-specific sensitivities and specificities. The model was applied with and without the modelling of conditional dependence between tests. The utility of the extended model was demonstrated through application to bovine tuberculosis surveillance data from Northern and the Republic of Ireland. Simulation coupled with re-sampling techniques, demonstrated that the extended model has good predictive power to estimate the diagnostic parameters and true herd-level prevalence from surveillance data. Our methodology can aid in the interpretation of disease surveillance data, and the results can potentially refine disease control strategies.