Collectives of diagnostic biomarkers identify high-risk subpopulations of hematuria patients: exploiting heterogeneity in large-scale biomarker data

Background: Ineffective risk stratification can delay diagnosis of serious disease in patients with hematuria. We applied a systems biology approach to analyze clinical, demographic and biomarker measurements (n = 29) collected from 157 hematuric patients: 80 urothelial cancer (UC) and 77 controls with confounding pathologies.

Methods: On the basis of biomarkers, we conducted agglomerative hierarchical clustering to identify patient and biomarker clusters. We then explored the relationship between the patient clusters and clinical characteristics using Chi-square analyses. We determined classification errors and areas under the receiver operating curve of Random Forest Classifiers (RFC) for patient subpopulations using the biomarker clusters to reduce the dimensionality of the data.

Results: Agglomerative clustering identified five patient clusters and seven biomarker clusters. Final diagnoses categories were non-randomly distributed across the five patient clusters. In addition, two of the patient clusters were enriched with patients with ‘low cancer-risk’ characteristics. The biomarkers which contributed to the diagnostic classifiers for these two patient clusters were similar. In contrast, three of the patient clusters were significantly enriched with patients harboring ‘high cancer-risk” characteristics including proteinuria, aggressive pathological stage and grade, and malignant cytology. Patients in these three clusters included controls, that is, patients with other serious disease and patients with cancers other than UC. Biomarkers which contributed to the diagnostic classifiers for the largest ‘high cancer- risk’ cluster were different than those contributing to the classifiers for the ‘low cancer-risk’ clusters. Biomarkers which contributed to subpopulations that were split according to smoking status, gender and medication were different.

Conclusions: The systems biology approach applied in this study allowed the hematuric patients to cluster naturally on the basis of the heterogeneity within their biomarker data, into five distinct risk subpopulations. Our findings highlight an approach with the promise to unlock the potential of biomarkers. This will be especially valuable in the field of diagnostic bladder cancer where biomarkers are urgently required. Clinicians could interpret risk classification scores in the context of clinical parameters at the time of triage. This could reduce cystoscopies and enable priority diagnosis of aggressive diseases, leading to improved patient outcomes at reduced costs. © 2013 Emmert-Streib et al; licensee BioMed Central Ltd.

Standardization of diagnostic biomarker concentrations in urine; the hematuria caveat

Sensitive and specific urinary biomarkers can improve patient outcomes in many diseases through informing early diagnosis. Unfortunately, to date, the accuracy and translation of diagnostic urinary biomarkers into clinical practice has been disappointing. We believe this may be due to inappropriate standardization of diagnostic urinary biomarkers. Our objective was therefore to characterize the effects of standardizing urinary levels of IL-6, IL-8, and VEGF using the commonly applied standards namely urinary creatinine, osmolarity and protein. First, we report results based on the biomarker levels measured in 120 hematuric patients, 80 with pathologically confirmed bladder cancer, 27 with confounding pathologies and 13 in whom no underlying cause for their hematuria was identified, designated “no diagnosis”. Protein levels were related to final diagnostic categories (p = 0.022, ANOVA). Osmolarity (mean = 529 mOsm; median = 528 mOsm) was normally distributed, while creatinine (mean = 10163 µmol/l, median = 9350 µmol/l) and protein (0.3297, 0.1155 mg/ml) distributions were not. When we compared AUROCs for IL-6, IL-8 and VEGF levels, we found that protein standardized levels consistently resulted in the lowest AUROCs. The latter suggests that protein standardization attenuates the “true” differences in biomarker levels across controls and bladder cancer samples. Second, in 72 hematuric patients; 48 bladder cancer and 24 controls, in whom urine samples had been collected on recruitment and at follow-up (median = 11 (1 to 20 months)), we demonstrate that protein levels were approximately 24% lower at follow-up (Bland Altman plots). There was an association between differences in individual biomarkers and differences in protein levels over time, particularly in control patients.

Spin-Based Diagnostic of Nanostructure in Copper Phthalocyanine-C-60 Solar Cell Blends

Nanostructure and molecular orientation play a crucial role in determining the functionality of organic thin films. In practical devices, such as organic solar cells consisting of donor-acceptor mixtures, crystallinity is poor and these qualities cannot be readily determined by conventional diffraction techniques, while common microscopy only reveals surface morphology. Using a simple nondestructive technique, namely, continuous-wave electron paramagnetic resonance spectroscopy, which exploits the well-understood angular dependence of the g-factor and hyperfine tensors, we show that in the solar cell blend of C-60 and copper phthalocyanine (CuPc)-for which X-ray diffraction gives no information-the CuPc, and by implication the C-60, molecules form nanoclusters, with the planes of the CuPc molecules oriented perpendicular to the film surface. This information demonstrates that the current nanostructure in CuPc:C-60 solar cells is far from optimal and suggests that their efficiency could be considerably increased by alternative film growth algorithms.

The quality of reporting of diagnostic accuracy studies in glaucoma using scanning laser polarimetry

PURPOSE: Scanning laser polarimetry (SLP) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the SLP for diagnosing glaucoma. METHODS: A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the SLP for glaucoma was performed. Two reviewers independently selected and appraised the manuscripts. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS: A total of 47 papers were identified of which the first 10 (from 1997 to 2000) and the last 10 articles (from 2004 to 2005) were appraised. Interobserver rating agreement of STARD items was high (85.5% agreement, ?=0.796). The number of STARD items properly reported ranged from 3/25 to 19/25. Only a quarter of studies (5/20) explicitly reported more than half of the STARD items. Important aspects of the methodology were often missing such as participant sampling (reported in 40% of manuscripts), masking of the readers of the index test and reference standard (reported in 20% of manuscripts), and estimation of uncertainty (eg, 95% confidence intervals, reported in 25% of manuscripts). There was a slight increase in the number of STARD items reported with time. CONCLUSIONS: The quality of reporting of diagnostic accuracy tests for glaucoma with SLP is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. © 2007 Lippincott Williams & Wilkins, Inc.

Diagnostic accuracy and reproducibility of tendency oriented perimetry in glaucoma

PURPOSE. To evaluate the diagnostic capability of tendency oriented perimetry (TOP) in glaucoma. METHODS. A): The diagnostic accuracy of mean defect (MD), square-root of the loss variance (sLV), and number of pathologic points (NPP) was calculated in 295 normal and 414 glaucoma eyes (179 early, 112 moderate, and 123 advanced) examined with TOP. B): Threshold fluctuation (F) and its relationship with the loss variance (LV) was measured in 34 normal and 33 glaucoma eyes (mean MD=3 dB; SD=3.9) for TOP and for full-threshold perimetry (FT). C): Twenty-eight eyes with stable glaucoma (mean MD=9.5 dB; SD=7.2) were examined six times to quantify LV error. D): TOP and FT were tested with the simulation program PeriSim using different behavior models. RESULTS. A): The best diagnostic index in early glaucoma (MD

The quality of reporting of diagnostic accuracy studies in glaucoma using the Heidelberg retina tomograph

PURPOSE. Scanning laser tomography with the Heidelberg retina tomograph (HRT; Heidelberg Engineering, Heidelberg, Germany) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the HRT for diagnosing glaucoma. METHODS. A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the HRT for glaucoma was performed. Two reviewers selected and appraised the papers independently. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS. A total of 29 articles were included. Interobserver rating agreement was observed in 83% of items (? = 0.76). The number of STARD items properly reported ranged from 5 to 18. Less than a third of studies (7/29) explicitly reported more than half of the STARD items. Descriptions of key aspects of the methodology were frequently missing. For example, the design of the study (prospective or retrospective) was reported in 6 of 29 studies, and details of participant sampling (e.g., consecutive or random selection) were described in 5 of 29 publications. The commonest description of diagnostic accuracy was sensitivity and specificity (25/29) followed by area under the ROC curve (13/29), with 9 of 29 publications reporting both. CONCLUSIONS. The quality of reporting of diagnostic accuracy tests for glaucoma with HRT is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. Copyright © Association for Research in Vision and Ophthalmology.

The quality of reporting of diagnostic accuracy studies published in ophthalmic journals

Aim: To evaluate the quality of reporting of all diagnostic studies published in five major ophthalmic journals in the year 2002 using the Standards for Reporting of Diagnostic Accuracy (STARD) initiative parameters. Methods: Manual searching was used to identify diagnostic studies published in 2002 in five leading ophthalmic journals, the American Journal of Ophthalmology (AJO), Archives of Ophthalmology (Archives), British Journal of Ophthalmology (BJO), Investigative Ophthalmology and Visual Science (IOVS), and Ophthalmology. The STARD checklist of 25 items and flow chart was used to evaluate the quality of each publication. Results: A total of 16 publications were included (AJO = 5, Archives = 1, BJO = 2, IOVS = 2, and Ophthalmology = 6). More than half of the studies (n = 9) were related to glaucoma diagnosis. Other specialties included retina (n = 4) cornea (n = 2), and neuro-ophthalmology (n = 1). The most common description of diagnostic accuracy was sensitivity and specificity values, published in 13 articles. The number of fully reported items in evaluated studies ranged from eight to 19. Seven studies reported more than 50% of the STARD items. Conclusions: The current standards of reporting of diagnostic accuracy tests are highly variable. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies.

The Quality of Reporting of Diagnostic Accuracy Studies of Optical Coherence Tomography in Glaucoma

Objective: To evaluate the quality of reporting of diagnostic accuracy studies using optical coherence tomography (OCT) in glaucoma. Design: Descriptive series of published studies. Participants: Published studies reporting a measure of the diagnostic accuracy of OCT for glaucoma. Methods: Review of English language papers reporting measures of diagnostic accuracy of OCT for glaucoma. Papers were identified from a Medline literature search performed in June 2006. Articles were appraised using the 25 items provided by the Standards for Reporting of Diagnostic Accuracy (STARD) initiative. Each item was recorded as full, partially, or not reported. Main Outcome Measures: Degree of compliance with the STARD guidelines. Results: Thirty papers were appraised. Eight papers (26.7%) fully reported more than half of the STARD items. The lowest number of fully reported items in a study was 5 and the highest was 17. Descriptions of key aspects of methodology frequently were missing. For example, details of participant sampling (e.g., consecutive or random selection) were described in only 8 (26.7%) of 30 publications. Measures of statistical uncertainty were reported in 18 (60%) of 30 publications. No single STARD item was fully reported by all the papers. Conclusions: The standard of reporting of diagnostic accuracy studies in glaucoma using OCT was suboptimal. It is hoped that adoption of the STARD guidelines will lead to an improvement in reporting of diagnostic accuracy studies, enabling clearer evidence to be produced for the usefulness of OCT for the diagnosis of glaucoma. © 2007 American Academy of Ophthalmology.

Comparison of diagnostic ability between a fast strategy, tendency-oriented perimetry, and the standard bracketing strategy

Purpose: To compare the diagnostic abilities of the standard bracketing strategy (BR) and a fast strategy, the tendency-oriented perimetry (TOP). Methods: Seventy-seven controls and 91 eyes from patients with glaucoma were analyzed with the strategies TOP and BR. Sensitivity (Se), specificity (Sp), the area under the receiver operating characteristic (ROC) curve (AC) and the optimum cutoff value (CO) were calculated for the visual field indices mean defect (MD), the square root of the loss variance (sLV) and the number of pathological points (NPP). Results: In the glaucoma group, the mean MD value using TOP and BR was 7.5 and 8.3 dB, respectively. The mean sLV value using TOP and BR was 5.0 and 5.3 dB, respectively. Indices provided by TOP had higher ROC values than the ones provided by BR. Using TOP, the index with the best diagnostic ability was sLV (Sp = 94.8, Se = 90.1, AC = 0.966, CO = 2.5 dB), followed by NPP and MD. Using BR, the best results were obtained for MD (Sp = 92.2, Se = 81.3, AC = 0.900, CO = 2.5 dB) followed by sLV and NPP. Conclusions: A fast strategy, TOP, had superior diagnostic ability than the standard BR. Although TOP provided lower LV values than BR, the diagnostic ability of this index was higher than that of the conventional strategy. Copyright © 2005 S. Karger AG.

Sample size in studies on diagnostic accuracy in ophthalmology:A literature survey

Aim: To assess the sample sizes used in studies on diagnostic accuracy in ophthalmology. Design and sources: A survey literature published in 2005. Methods: The frequency of reporting calculations of sample sizes and the samples' sizes were extracted from the published literature. A manual search of five leading clinical journals in ophthalmology with the highest impact (Investigative Ophthalmology and Visual Science, Ophthalmology, Archives of Ophthalmology, American Journal of Ophthalmology and British Journal of Ophthalmology) was conducted by two independent investigators. Results: A total of 1698 articles were identified, of which 40 studies were on diagnostic accuracy. One study reported that sample size was calculated before initiating the study. Another study reported consideration of sample size without calculation. The mean (SD) sample size of all diagnostic studies was 172.6 (218.9). The median prevalence of the target condition was 50.5%. Conclusion: Only a few studies consider sample size in their methods. Inadequate sample sizes in diagnostic accuracy studies may result in misleading estimates of test accuracy. An improvement over the current standards on the design and reporting of diagnostic studies is warranted.