Diagnostic accuracy of pulmonary host inflammatory mediators in the exclusion of ventilator-acquired pneumonia

Background: Excessive use of empirical antibiotics is common in critically ill patients. Rapid biomarker-based exclusion of infection may improve antibiotic stewardship in ventilator-acquired pneumonia (VAP). However, successful validation of the usefulness of potential markers in this setting is exceptionally rare.

Objectives: We sought to validate the capacity for specific host inflammatory mediators to exclude pneumonia in patients with suspected VAP. 

Methods: A prospective, multicentre, validation study of patients with suspected VAP was conducted in 12 intensive care units. VAP was confirmed following bronchoscopy by culture of a potential pathogen in bronchoalveolar lavage fluid (BALF) at >10⁴ colony forming units per millilitre (cfu/mL). Interleukin-1 beta (IL-1β), IL-8, matrix metalloproteinase-8 (MMP-8), MMP-9 and human neutrophil elastase (HNE) were quantified in BALF. Diagnostic utility was determined for biomarkers individually and in combination. 

Results: Paired BALF culture and biomarker results were available for 150 patients. 53 patients (35%) had VAP and 97 (65%) patients formed the non-VAP group. All biomarkers were significantly higher in the VAP group (p<0.001). The area under the receiver operator characteristic curve for IL-1β was 0.81; IL-8, 0.74; MMP-8, 0.76; MMP-9, 0.79 and HNE, 0.78. A combination of IL-1β and IL-8, at the optimal cut-point, excluded VAP with a sensitivity of 100%, a specificity of 44.3% and a post-test probability of 0% (95% CI 0% to 9.2%). 

Conclusions: Low BALF IL-1β in combination with IL-8 confidently excludes VAP and could form a rapid biomarker-based rule-out test, with the potential to improve antibiotic stewardship.

The BTA stat test:A tumor marker for the detection of upper tract transitional cell carcinoma

Objectives. To conduct a prospective evaluation to determine the utility of the BTA stat test in the detection of upper tract transitional cell carcinoma (UTTCC). Monitoring for UTTCC currently relies on invasive procedures such as upper tract imaging, ureteral washing cytology (UWC) and/or ureteroscopy, or voided urine cytology (VUC). The BTA stat test is a sensitive qualitative immunoassay that detects human complement factor H-related protein in voided urine.

Methods. A total of 81 patients participated, 27 with histopathologically confirmed UTTCC, 26 with upper tract calculi, and 28 with microscopic hematuria but no evidence of urologic disease. Voided specimens collected before surgery or treatment were tested with the BTA stat test and VUC. UWC was performed in specimens collected by a ureteral catheter.

Results. The BTA stat test was significantly more sensitive and specific than VUC or UWC. The overall sensitivity for each was 82%, 11%, and 48%; the specificity was 89%, 54%, and 33%. The positive predictive value for the BTA stat test was 79% and the negative predictive value was 91%, both the highest of the three tests.

Conclusions. The BTA stat test was superior to VUC and UWC in the detection of UTTCC. These results may support the adoption of a less aggressive follow-up policy when monitoring for UTTCC when the BTA stat result is negative. If cystoscopy is negative and the BTA stat test is positive, upper tract investigations should be expedited and, if the bladder is in place, bladder biopsies performed. (C) 2001, Elsevier Science Inc.

Diagnostic accuracy of loop-mediated isothermal amplification as a near-patient test for meningococcal disease in children: An observational cohort study

Background: Diagnosis of meningococcal disease relies on recognition of clinical signs and symptoms that are notoriously non-specific, variable, and often absent in the early stages of the disease. Loop-mediated isothermal amplification (LAMP) has previously been shown to be fast and effective for the molecular detection of meningococcal DNA in clinical specimens. We aimed to assess the diagnostic accuracy of meningococcal LAMP as a near-patient test in the emergency department.

Methods: For this observational cohort study of diagnostic accuracy, children aged 0-13 years presenting to the emergency department of the Royal Belfast Hospital for Sick Children (Belfast, UK) with suspected meningococcal disease were eligible for inclusion. Patients underwent a standard meningococcal pack of investigations testing for meningococcal disease. Respiratory (nasopharyngeal swab) and blood specimens were collected from patients and tested with near-patient meningococcal LAMP and the results were compared with those obtained by reference laboratory tests (culture and PCR of blood and cerebrospinal fluid).

Findings: Between Nov 1, 2009, and Jan 31, 2012, 161 eligible children presenting at the hospital underwent the meningococcal pack of investigations and were tested for meningococcal disease, of whom 148 consented and were enrolled in the study. Combined testing of respiratory and blood specimens with use of LAMP was accurate (sensitivity 89% [95% CI 72-96], specificity 100% [97-100], positive predictive value 100% [85-100]; negative predictive value 98% [93-99]) and diagnostically useful (positive likelihood ratio 213 [95% CI 13-infinity] and negative likelihood ratio 0·11 [0·04-0·32]). The median time required for near-patient testing from sample to result was 1 h 26 min (IQR 1 h 20 min-1 h 32 min).

Interpretation: Meningococcal LAMP is straightforward enough for use in any hospital with basic laboratory facilities, and near-patient testing with this method is both feasible and effective. By contrast with existing UK National Institute of Health and Care Excellence guidelines, we showed that molecular testing of non-invasive respiratory specimens from children is diagnostically accurate and clinically useful.

Rapid detection of health-care-associated bloodstream infection in critical care using multipathogen real-time polymerase chain reaction technology: a diagnostic accuracy study and systematic review

Background: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. 

Objective: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. 

Design: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. 

Setting: Critical care departments within NHS hospitals in the north-west of England. 

Participants: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. 

Main outcome measures: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. 

Results: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4–16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. 

Conclusion: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error.

Do chitons have a compass? Evidence for magnetic sensitivity in Polyplacophora

Several animals and microbes have been shown to be sensitive to magnetic fields, though the exact mechanisms of this ability remain unclear in many animals. Chitons are marine molluscs which have high levels of biomineralised magnetite coating their radulae. This discovery led to persistent anecdotal suggestions that they too may be able to navigationally respond to magnetic fields. Several researchers have attempted to test this, but to date there have been no large-scale controlled empirical trials. In the current study, four chiton species (Katharina tunicata, Mopalia kennerleyi, Mopalia muscosa and Leptochiton rugatus, n=24 in each) were subjected to natural and artificially rotated magnetic fields while their movement through an arena was recorded over four hours. Field orientation did not influence the position of the chitons at the end of trials, possibly as a result of the primacy of other sensory cues (i.e. thigmotaxis). Under non-rotated magnetic field conditions, the orientation of subjects when they first reached the edge of an arena was clustered around 309-345 degrees (north-north-west) in all four species. However, orientations were random under the rotated magnetic field, which may indicate a disruptive effect of field rotation. This pattern suggests that chitons can detect and respond to magnetism.

Clinical and Cost-Effectiveness of Procalcitonin Test for Prodromal Meningococcal Disease-A Meta-Analysis

BACKGROUND: Despite vaccines and improved medical intensive care, clinicians must continue to be vigilant of possible Meningococcal Disease in children. The objective was to establish if the procalcitonin test was a cost-effective adjunct for prodromal Meningococcal Disease in children presenting at emergency department with fever without source.

METHODS AND FINDINGS: Data to evaluate procalcitonin, C-reactive protein and white cell count tests as indicators of Meningococcal Disease were collected from six independent studies identified through a systematic literature search, applying PRISMA guidelines. The data included 881 children with fever without source in developed countries.The optimal cut-off value for the procalcitonin, C-reactive protein and white cell count tests, each as an indicator of Meningococcal Disease, was determined. Summary Receiver Operator Curve analysis determined the overall diagnostic performance of each test with 95% confidence intervals. A decision analytic model was designed to reflect realistic clinical pathways for a child presenting with fever without source by comparing two diagnostic strategies: standard testing using combined C-reactive protein and white cell count tests compared to standard testing plus procalcitonin test. The costs of each of the four diagnosis groups (true positive, false negative, true negative and false positive) were assessed from a National Health Service payer perspective. The procalcitonin test was more accurate (sensitivity=0.89, 95%CI=0.76-0.96; specificity=0.74, 95%CI=0.4-0.92) for early Meningococcal Disease compared to standard testing alone (sensitivity=0.47, 95%CI=0.32-0.62; specificity=0.8, 95% CI=0.64-0.9). Decision analytic model outcomes indicated that the incremental cost effectiveness ratio for the base case was £-8,137.25 (US $ -13,371.94) per correctly treated patient.

CONCLUSIONS: Procalcitonin plus standard recommended tests, improved the discriminatory ability for fatal Meningococcal Disease and was more cost-effective; it was also a superior biomarker in infants. Further research is recommended for point-of-care procalcitonin testing and Markov modelling to incorporate cost per QALY with a life-time model.

Hui and Walter's latent-class model extended to estimate diagnostic test properties from surveillance data: a latent model for latent data

Diagnostic test sensitivity and specificity are probabilistic estimates with far reaching implications for disease control, management and genetic studies. In the absence of 'gold standard' tests, traditional Bayesian latent class models may be used to assess diagnostic test accuracies through the comparison of two or more tests performed on the same groups of individuals. The aim of this study was to extend such models to estimate diagnostic test parameters and true cohort-specific prevalence, using disease surveillance data. The traditional Hui-Walter latent class methodology was extended to allow for features seen in such data, including (i) unrecorded data (i.e. data for a second test available only on a subset of the sampled population) and (ii) cohort-specific sensitivities and specificities. The model was applied with and without the modelling of conditional dependence between tests. The utility of the extended model was demonstrated through application to bovine tuberculosis surveillance data from Northern and the Republic of Ireland. Simulation coupled with re-sampling techniques, demonstrated that the extended model has good predictive power to estimate the diagnostic parameters and true herd-level prevalence from surveillance data. Our methodology can aid in the interpretation of disease surveillance data, and the results can potentially refine disease control strategies.

Effectiveness of a biomarker-based exclusion of ventilator-acquired pneumonia to reduce antibiotic use: protocol for a randomised controlled trial (VAPrapid-2):Study protocol for a randomised controlled trial

Background Ventilator-acquired pneumonia (VAP) is a common reason for antimicrobial therapy in the intensive care unit (ICU). Biomarker-based diagnostics could improve antimicrobial stewardship through rapid exclusion of VAP. Bronchoalveloar lavage (BAL) fluid biomarkers have previously been shown to allow the exclusion of VAP with high confidence. Methods/Design This is a prospective, multi-centre, randomised, controlled trial to determine whether a rapid biomarker-based exclusion of VAP results in fewer antibiotics and improved antimicrobial management. Patients with clinically suspected VAP undergo BAL, and VAP is confirmed by growth of a potential pathogen at > 104 colony-forming units per millilitre (CFU/ml). Patients are randomised 1:1, to either a ‘biomarker-guided recommendation on antibiotics’ in which BAL fluid is tested for IL-1β and IL-8 in addition to routine microbiology testing, or to ‘routine use of antibiotics’ in which BAL undergoes routine microbiology testing only. Clinical teams are blinded to intervention until 6 hours after randomisation, when biomarker results are reported to the clinician. The primary outcome is a change in the frequency distribution of antibiotic-free days (AFD) in the 7 days following BAL. Secondary outcome measures include antibiotic use at 14 and 28 days; ventilator-free days; 28-day mortality and ICU mortality; sequential organ failure assessment (SOFA) at days 3, 7 and 14; duration of stay in critical care and the hospital; antibiotic-associated infections; and antibiotic-resistant pathogen cultures up to hospital discharge, death or 56 days. A healthcare-resource-utilisation analysis will be calculated from the duration of critical care and hospital stay. In addition, safety data will be collected with respect to performing BAL. A sample size of 210 will be required to detect a clinically significant shift in the distribution of AFD towards more patients having fewer antibiotics and therefore more AFD. Discussion This trial will test whether a rapid biomarker-based exclusion of VAP results in rapid discontinuation of antibiotics and therefore improves antibiotic management in patients with suspected VAP.

Shortened Lung Clearance Index is a repeatable and sensitive test in children and adults with cystic fibrosis

Background: Lung clearance index (LCI) derived from sulfur hexafluoride (SF6) multiple breath washout (MBW) is a sensitive measure of lung disease in people with cystic fibrosis (CF). However, it can be time-consuming, limiting its use clinically. Aim: To compare the repeatability, sensitivity and test duration of LCI derived from washout to 1/30th (LCI1/30), 1/20th (LCI1/20) and 1/10th (LCI1/10) to ‘standard’ LCI derived from washout to 1/40th initial concentration (LCI1/40). Methods: Triplicate MBW test results from 30 clinically stable people with CF and 30 healthy controls were analysed retrospectively. MBW tests were performed using 0.2% SF6 and a modified Innocor device. All LCI end points were calculated using SimpleWashout software. Repeatability was assessed using coefficient of variation (CV%). The proportion of people with CF with and without abnormal LCI and forced expiratory volume in 1 s (FEV1) % predicted was compared. Receiver operating characteristic (ROC) curve statistics were calculated. Test duration of all LCI end points was compared using paired t tests. Results: In people with CF, LCI1/40 CV% (p=0.16), LCI1/30 CV%, (p=0.53), LCI1/20 CV% (p=0.14) and LCI1/10 CV% (p=0.25) was not significantly different to controls. The sensitivity of LCI1/40, LCI1/30 and LCI1/20 to the presence of CF was equal (67%). The sensitivity of LCI1/10 and FEV1% predicted was lower (53% and 47% respectively). Area under the ROC curve (95% CI) for LCI1/40, LCI1/30, LCI1/20, LCI1/10 and FEV1% predicted was 0.89 (0.80 to 0.97), 0.87 (0.77 to 0.96), 0.87 (0.78 to 0.96), 0.83 (0.72 to 0.94) and 0.73 (0.60 to 0.86), respectively. Test duration of LCI1/30, LCI1/20 and LCI1/10 was significantly shorter compared with the test duration of LCI1/40 in people with CF (p<0.0001) equating to a 5%, 9% and 15% time saving, respectively. Conclusions: In this study, LCI1/20 was a repeatable and sensitive measure with equal diagnostic performance to LCI1/40. LCI1/20 was shorter, potentially offering a more feasible research and clinical measure.

Rapid-bTB: a novel lateral flow test able to differentiate Mycobacterium bovis from Mycobacterium tuberculosis in sputum

Background: A novel lateral flow, immunochromatographic assay (LFD) specific for Mycobacterium bovis, the cause of bovine tuberculosis and zoonotic TB, was recently developed at Queen’s University Belfast. The LFD detects whole M. bovis cells, in contrast to other commercially available LFD tests (BD MGITTM TBc ID, SD Bioline TB Ag MPT 64, Capilia TB-Neo kit) which detect MPT64 antigen secreted during growth. The new LFD test has been evaluated in the veterinary context, and its specificity for M. bovis in the broadest sense (i.e. subsp. bovis, subsp. caprae and BCG) and sensitivity to detect M. bovis in positive MGIT™ liquid cultures was demonstrated comprehensively.
Methods: Preliminary work was carried out by researchers at Queen’s University Belfast to optimise sputum sample preparation, estimate the limit of detection (LOD) of the LFD with M. bovis-spiked sputum samples, and check LFD specificity by testing a broad range of non-tuberculous Mycobacterium spp. (NTM) and other bacterial genera commonly encountered in sputum samples (Haemophilus, Klebsiella, Pseudomonas, Staphylococcus). In the Cameroon laboratory direct detection of M. bovis in human sputa was attempted, and 50 positive sputum MGIT™ cultures and 33 cultures of various Mycobacterium spp. originally isolated from human sputa were tested.
Results: Sputum sample preparation consisted of digestion with 1% NALC for 30 min, centrifugation at 3000g for 20 min, PBS wash, centrifugation again, and pellet resuspended in KPL blocking buffer before 100 µl was applied to the LFD. The LOD of the LFD applied to M. bovis-spiked sputum was estimated to be 104 CFU/ml. A small number of confirmed Ziehl-Neelsen ‘3+’ M. bovis positive sputum samples were tested directly but no positive LFD results were obtained. All of the sputum MGIT™ cultures and mycobacterial cultures (including M. tuberculosis, M. africanum, M. bovis, M. intracellulare, M. scrofulaceum, M. fortuitum, M. peregrinum, M. interjectum) tested LFD negative when read after 15 min except for the M. bovis cultures, thereby confirming specificity of LFD for M. bovis in the clinical microbiology context.
Conclusions: Results indicate that the ‘Rapid-bTB’ LFD is a very specific test, able to differentiate M. bovis from M. tuberculosis, M. africanum, and a range of NTM isolated from human sputa in MGITTM liquid cultures. However, the LFD lacks sufficient sensitivity to be applied earlier in the diagnostic process to directly test human sputa.

Impact of age, various forms of cataract, and visual acuity on whole-field scotopic sensitivity screening for glaucoma in rural Taiwan.

OBJECTIVE: To evaluate the impact of age, various forms of cataract, and visual acuity on whole-field scotopic sensitivity screening for glaucoma in a rural population. DESIGN: Clinic-based study with population-based recruitment. SETTING: Jin Shan Township near Taipei, Taiwan. SUBJECTS: Three hundred forty-six residents (ages, > or = 40 years) of Jin Shan Township. INTERVENTIONS: Whole-field scotopic testing, ophthalmoscopy with dilation of the pupils, cataract grading against photographic standards, and screening visual field testing in a random one-third subsample. MAIN OUTCOME MEASURES: Whole-field scotopic sensitivity (in decibels) and diagnostic status as a case of glaucoma, glaucoma suspect, or normal. RESULTS: Participants in Jin Shan Township did not differ significantly in the rate of blindness, low visual acuity, or family history of glaucoma from a random sample of nonrespondents. Scotopic sensitivity testing detected 100% (6/6) of subjects with open-angle glaucoma at a specificity of 80.2%. The mean +/- SE scotopic sensitivity for six subjects with open-angle glaucoma (32.78 +/- 1.51 dB) differed significantly from that of 315 normal individuals (38.51 +/- 0.22 dB), when adjusted for age and visual acuity (P = .05, t test). With linear regression modeling, factors that correlated significantly with scotopic sensitivity were intraocular pressure, screening visual field, best corrected visual acuity, presence of cortical cataract, and increasing age. CONCLUSIONS: Although cataract affects the whole-field scotopic threshold, it appears that scotopic testing may be of value in field-based screening for glaucoma.

Sepsis: the LightCycler SeptiFast Test MGRADE®, SepsiTest™ and IRIDICA BAC BSI assay for rapidly identifying bloodstream bacteria and fungi – a systematic review and economic evaluation

Background: Sepsis can lead to multiple organ failure and death. Timely and appropriate treatment can reduce in-hospital mortality and morbidity. Objectives: To determine the clinical effectiveness and cost-effectiveness of three tests [LightCycler SeptiFast Test MGRADE® (Roche Diagnostics, Risch-Rotkreuz, Switzerland); SepsiTest™ (Molzym Molecular Diagnostics, Bremen, Germany); and the IRIDICA BAC BSI assay (Abbott Diagnostics, Lake Forest, IL, USA)] for the rapid identification of bloodstream bacteria and fungi in patients with suspected sepsis compared with standard practice (blood culture with or without matrix-absorbed laser desorption/ionisation time-offlight mass spectrometry). Data sources: Thirteen electronic databases (including MEDLINE, EMBASE and The Cochrane Library) were searched from January 2006 to May 2015 and supplemented by hand-searching relevant articles. Review methods: A systematic review and meta-analysis of effectiveness studies were conducted. A review of published economic analyses was undertaken and a de novo health economic model was constructed. A decision tree was used to estimate the costs and quality-adjusted life-years (QALYs) associated with each test; all other parameters were estimated from published sources. The model was populated with evidence from the systematic review or individual studies, if this was considered more appropriate (base case 1). In a secondary analysis, estimates (based on experience and opinion) from seven clinicians regarding the benefits of earlier test results were sought (base case 2). A NHS and Personal Social Services perspective was taken, and costs and benefits were discounted at 3.5% per annum. Scenario analyses were used to assess uncertainty. Results: For the review of diagnostic test accuracy, 62 studies of varying methodological quality were included. A meta-analysis of 54 studies comparing SeptiFast with blood culture found that SeptiFast had an estimated summary specificity of 0.86 [95% credible interval (CrI) 0.84 to 0.89] and sensitivity of 0.65 (95% CrI 0.60 to 0.71). Four studies comparing SepsiTest with blood culture found that SepsiTest had an estimated summary specificity of 0.86 (95% CrI 0.78 to 0.92) and sensitivity of 0.48 (95% CrI 0.21 to 0.74), and four studies comparing IRIDICA with blood culture found that IRIDICA had an estimated summary specificity of 0.84 (95% CrI 0.71 to 0.92) and sensitivity of 0.81 (95% CrI 0.69 to 0.90). Owing to the deficiencies in study quality for all interventions, diagnostic accuracy data should be treated with caution. No randomised clinical trial evidence was identified that indicated that any of the tests significantly improved key patient outcomes, such as mortality or duration in an intensive care unit or hospital. Base case 1 estimated that none of the three tests provided a benefit to patients compared with standard practice and thus all tests were dominated. In contrast, in base case 2 it was estimated that all cost per QALY-gained values were below £20,000; the IRIDICA BAC BSI assay had the highest estimated incremental net benefit, but results from base case 2 should be treated with caution as these are not evidence based. Limitations: Robust data to accurately assess the clinical effectiveness and cost-effectiveness of the interventions are currently unavailable. Conclusions: The clinical effectiveness and cost-effectiveness of the interventions cannot be reliably determined with the current evidence base. Appropriate studies, which allow information from the tests to be implemented in clinical practice, are required.