Next-generation sequencing: a change of paradigm in molecular diagnostic validation

Next-generation sequencing (NGS) is beginning to show its full potential for diagnostic and therapeutic applications. In particular, it is enunciating its capacity to contribute to a molecular taxonomy of cancer, to be used as a standard approach for diagnostic mutation detection, and to open new treatment options that are not exclusively organ-specific. If this is the case, how much validation is necessary and what should be the validation strategy, when bringing NGS into the diagnostic/clinical practice? This validation strategy should address key issues such as: what is the overall extent of the validation? Should essential indicators of test performance such as sensitivity of specificity be calculated for every target or sample type? Should bioinformatic interpretation approaches be validated with the same rigour? What is a competitive clinical turnaround time for a NGS-based test, and when does it become a cost-effective testing proposition? While we address these and other related topics in this commentary, we also suggest that a single set of international guidelines for the validation and use of NGS technology in routine diagnostics may allow us all to make a much more effective use of resources.

Diagnostic accuracy of loop-mediated isothermal amplification as a near-patient test for meningococcal disease in children: An observational cohort study

Background: Diagnosis of meningococcal disease relies on recognition of clinical signs and symptoms that are notoriously non-specific, variable, and often absent in the early stages of the disease. Loop-mediated isothermal amplification (LAMP) has previously been shown to be fast and effective for the molecular detection of meningococcal DNA in clinical specimens. We aimed to assess the diagnostic accuracy of meningococcal LAMP as a near-patient test in the emergency department.

Methods: For this observational cohort study of diagnostic accuracy, children aged 0-13 years presenting to the emergency department of the Royal Belfast Hospital for Sick Children (Belfast, UK) with suspected meningococcal disease were eligible for inclusion. Patients underwent a standard meningococcal pack of investigations testing for meningococcal disease. Respiratory (nasopharyngeal swab) and blood specimens were collected from patients and tested with near-patient meningococcal LAMP and the results were compared with those obtained by reference laboratory tests (culture and PCR of blood and cerebrospinal fluid).

Findings: Between Nov 1, 2009, and Jan 31, 2012, 161 eligible children presenting at the hospital underwent the meningococcal pack of investigations and were tested for meningococcal disease, of whom 148 consented and were enrolled in the study. Combined testing of respiratory and blood specimens with use of LAMP was accurate (sensitivity 89% [95% CI 72-96], specificity 100% [97-100], positive predictive value 100% [85-100]; negative predictive value 98% [93-99]) and diagnostically useful (positive likelihood ratio 213 [95% CI 13-infinity] and negative likelihood ratio 0·11 [0·04-0·32]). The median time required for near-patient testing from sample to result was 1 h 26 min (IQR 1 h 20 min-1 h 32 min).

Interpretation: Meningococcal LAMP is straightforward enough for use in any hospital with basic laboratory facilities, and near-patient testing with this method is both feasible and effective. By contrast with existing UK National Institute of Health and Care Excellence guidelines, we showed that molecular testing of non-invasive respiratory specimens from children is diagnostically accurate and clinically useful.

Evaluation of the diagnostic potential of a novel field immunomagnetic separation-immunochromatographic lateral flow assay to detect Mycobacterium bovis cells in European badger (Meles meles) faeces

The European badger (Meles meles) is a natural reservoir for Mycobacterium bovis, the causative agent of Bovine Tuberculosis, and has consequently been implicated in transmission of the disease to cattle. This study describes application of a novel M. bovis-specific immunochromatographic (lateral flow) assay in combination with immunomagnetic separation (IMS-LFD), to test badger faeces samples. In total, 441 faeces samples from badgers of unknown disease status collected from latrines at 110 badger setts throughout Northern Ireland (NI) and 100 faeces samples from badgers of known infection status from Great Britain (GB) were tested. Faeces (approx. 1g) was homogenised in 9 ml phosphate buffered saline, filtered (70 µm), and then 6-8 ml subjected to the IMS-LFD test. Residual clarified faecal homogenates were subjected to automated IMS followed by MGIT™ liquid culture (AIMS-MGIT™ culture) and qPCR (AIMS-qPCR). Evidence for the presence of M. bovis was obtained for 78 (18%), 61 (14%) and 140 (32%) of 441 NI badger faeces samples, and 10 (10%), 41 (41%) and 56 (56%) of 100 GB badger faeces samples, by IMS-LFD, AIMS-MGIT culture and AIMS-qPCR tests, respectively. The IMS-LFD test was less sensitive than AIMS-qPCR for detection of M. bovis and was, therefore, detecting badgers shedding high numbers of M. bovis in their faeces only. However, these ‘super shedders’ may be primarily responsible for the spread of Bovine Tuberculosis so are, therefore, an important target. This non-invasive test could form the basis of a field surveillance tool to indicate infected badger groups which are actively spreading M. bovis.

Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review

Background: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. 

Objective: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. 

Design: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. 

Setting: Critical care departments within NHS hospitals in the north-west of England. 

Participants: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. 

Main outcome measures: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. 

Results: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4–16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. 

Conclusion: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error.

Post-diagnostic oral bisphosphonate use and colorectal cancer mortality: a population-based cohort study within the UK Clinical Practice Research Datalink

Background:We conducted the first study to investigate post-diagnostic oral bisphosphonates use and colorectal cancer-specific mortality.

Methods:Colorectal cancer patients were identified from the National Cancer Data Repository (1998–2007) and linked to the UK Clinical Practice Research Datalink, providing prescription records, and Office of National Statistics mortality data. Time-dependent Cox regression models investigated colorectal cancer-specific mortality in post-diagnostic bisphosphonate users.

Results:Overall, in 4791 colorectal cancer patients, there was no evidence of an association between bisphosphonate use and colorectal cancer-specific mortality (adjusted hazard ratio=1.11; 95% confidence interval 0.80, 1.54) or with drug frequency or type.

Conclusions:In this novel population-based cohort study, post-diagnostic bisphosphonate use was not associated with longer rates of colorectal cancer survival.

Hui and Walter's latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data

Diagnostic test sensitivity and specificity are probabilistic estimates with far reaching implications for disease control, management and genetic studies. In the absence of 'gold standard' tests, traditional Bayesian latent class models may be used to assess diagnostic test accuracies through the comparison of two or more tests performed on the same groups of individuals. The aim of this study was to extend such models to estimate diagnostic test parameters and true cohort-specific prevalence, using disease surveillance data. The traditional Hui-Walter latent class methodology was extended to allow for features seen in such data, including (i) unrecorded data (i.e. data for a second test available only on a subset of the sampled population) and (ii) cohort-specific sensitivities and specificities. The model was applied with and without the modelling of conditional dependence between tests. The utility of the extended model was demonstrated through application to bovine tuberculosis surveillance data from Northern and the Republic of Ireland. Simulation coupled with re-sampling techniques, demonstrated that the extended model has good predictive power to estimate the diagnostic parameters and true herd-level prevalence from surveillance data. Our methodology can aid in the interpretation of disease surveillance data, and the results can potentially refine disease control strategies.

Cathepsin S: therapeutic, diagnostic, and prognostic potential

Cathepsin S is a member of the cysteine cathepsin protease family. It is a lysosomal protease which can promote degradation of damaged or unwanted proteins in the endo-lysosomal pathway. Additionally, it has more specific roles such as MHC class II antigen presentation, where it is important in the degradation of the invariant chain. Unsurprisingly, mis-regulation has implicated cathepsin S in a variety of pathological processes including arthritis, cancer, and cardiovascular disease, where it becomes secreted and can act on extracellular substrates. In comparison to many other cysteine cathepsin family members, cathepsin S has uniquely restricted tissue expression and is more stable at a neutral pH, which supports its involvement and importance in localised disease microenvironments. In this review, we examine the known involvement of cathepsin S in disease, particularly with respect to recent work indicating its role in mediating pain, diabetes, and cystic fibrosis. We provide an overview of current literature with regards cathepsin S as a therapeutic target, as well as its role and potential as a predictive diagnostic and/or prognostic marker in these diseases.

Panning for Gold: The Standardizing Work of Filling “Autistic” Shells – Using institutional ethnography to explore textually mediated health relations in the diagnostic process of autism.

Health reform practices in Canada and elsewhere have restructured the purpose and use of diagnostic labels and the processes of naming such labels. Diagnoses are no longer only a means to tell doctors and patients what may be wrong and indicate potential courses of treatment; some diagnoses activate specialized services and supports for persons with a disability and those who provide care for them. In British Columbia, a standardized process of diagnosis with the outcome of an autism spectrum disorder gives access to government provided health care and educational services and supports. Such processes enter individuals into a complex of text mediated relations, regulated by the principles of evidence-based medicine. However, the diagnosis of autism in children is notoriously uncertain. Because of this ambiguity, standardizing the diagnostic process creates a hurdle in gaining help and support for parents who have children with problems that could lead to a diagnosis on the autism spectrum. Such processes and their organizing relations are problematized, explored and explicated below. Grounded in the epistemological and ontological shift offered by Dorothy E. Smith (1987; 1990a; 1999; 2005), this article reports on the findings of an institutional ethnographic study that explored the diagnostic process of autism in British Columbia. More specifically, this article focuses on the processes involved in going from mothers talking from their experience about their childrens problems to the formalized and standardized, and thus “virtually” produced, diagnoses that may or may not give access to services and supports in different systems of care. Two psychologists, a developmental pediatrician, a social worker – members of a specialized multidisciplinary assessment team – and several mothers of children with a diagnosis on the autism spectrum were interviewed. The implications of standardizing the diagnosis process of a disability that is not clear-cut and has funding attached are discussed. This ethnography also provides a glimpse of the implications of current and ongoing reforms in the state-supported health care system in British Columbia, and more generally in Canada, for people’s everyday doings.