The quality of reporting of diagnostic accuracy studies in glaucoma using scanning laser polarimetry

PURPOSE: Scanning laser polarimetry (SLP) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the SLP for diagnosing glaucoma. METHODS: A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the SLP for glaucoma was performed. Two reviewers independently selected and appraised the manuscripts. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS: A total of 47 papers were identified of which the first 10 (from 1997 to 2000) and the last 10 articles (from 2004 to 2005) were appraised. Interobserver rating agreement of STARD items was high (85.5% agreement, ?=0.796). The number of STARD items properly reported ranged from 3/25 to 19/25. Only a quarter of studies (5/20) explicitly reported more than half of the STARD items. Important aspects of the methodology were often missing such as participant sampling (reported in 40% of manuscripts), masking of the readers of the index test and reference standard (reported in 20% of manuscripts), and estimation of uncertainty (eg, 95% confidence intervals, reported in 25% of manuscripts). There was a slight increase in the number of STARD items reported with time. CONCLUSIONS: The quality of reporting of diagnostic accuracy tests for glaucoma with SLP is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. © 2007 Lippincott Williams & Wilkins, Inc.

Diagnostic accuracy and reproducibility of tendency oriented perimetry in glaucoma

PURPOSE. To evaluate the diagnostic capability of tendency oriented perimetry (TOP) in glaucoma. METHODS. A): The diagnostic accuracy of mean defect (MD), square-root of the loss variance (sLV), and number of pathologic points (NPP) was calculated in 295 normal and 414 glaucoma eyes (179 early, 112 moderate, and 123 advanced) examined with TOP. B): Threshold fluctuation (F) and its relationship with the loss variance (LV) was measured in 34 normal and 33 glaucoma eyes (mean MD=3 dB; SD=3.9) for TOP and for full-threshold perimetry (FT). C): Twenty-eight eyes with stable glaucoma (mean MD=9.5 dB; SD=7.2) were examined six times to quantify LV error. D): TOP and FT were tested with the simulation program PeriSim using different behavior models. RESULTS. A): The best diagnostic index in early glaucoma (MD

The quality of reporting of diagnostic accuracy studies in glaucoma using the Heidelberg retina tomograph

PURPOSE. Scanning laser tomography with the Heidelberg retina tomograph (HRT; Heidelberg Engineering, Heidelberg, Germany) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the HRT for diagnosing glaucoma. METHODS. A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the HRT for glaucoma was performed. Two reviewers selected and appraised the papers independently. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS. A total of 29 articles were included. Interobserver rating agreement was observed in 83% of items (? = 0.76). The number of STARD items properly reported ranged from 5 to 18. Less than a third of studies (7/29) explicitly reported more than half of the STARD items. Descriptions of key aspects of the methodology were frequently missing. For example, the design of the study (prospective or retrospective) was reported in 6 of 29 studies, and details of participant sampling (e.g., consecutive or random selection) were described in 5 of 29 publications. The commonest description of diagnostic accuracy was sensitivity and specificity (25/29) followed by area under the ROC curve (13/29), with 9 of 29 publications reporting both. CONCLUSIONS. The quality of reporting of diagnostic accuracy tests for glaucoma with HRT is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. Copyright © Association for Research in Vision and Ophthalmology.

The quality of reporting of diagnostic accuracy studies published in ophthalmic journals

Aim: To evaluate the quality of reporting of all diagnostic studies published in five major ophthalmic journals in the year 2002 using the Standards for Reporting of Diagnostic Accuracy (STARD) initiative parameters. Methods: Manual searching was used to identify diagnostic studies published in 2002 in five leading ophthalmic journals, the American Journal of Ophthalmology (AJO), Archives of Ophthalmology (Archives), British Journal of Ophthalmology (BJO), Investigative Ophthalmology and Visual Science (IOVS), and Ophthalmology. The STARD checklist of 25 items and flow chart was used to evaluate the quality of each publication. Results: A total of 16 publications were included (AJO = 5, Archives = 1, BJO = 2, IOVS = 2, and Ophthalmology = 6). More than half of the studies (n = 9) were related to glaucoma diagnosis. Other specialties included retina (n = 4) cornea (n = 2), and neuro-ophthalmology (n = 1). The most common description of diagnostic accuracy was sensitivity and specificity values, published in 13 articles. The number of fully reported items in evaluated studies ranged from eight to 19. Seven studies reported more than 50% of the STARD items. Conclusions: The current standards of reporting of diagnostic accuracy tests are highly variable. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies.

The Quality of Reporting of Diagnostic Accuracy Studies of Optical Coherence Tomography in Glaucoma

Objective: To evaluate the quality of reporting of diagnostic accuracy studies using optical coherence tomography (OCT) in glaucoma. Design: Descriptive series of published studies. Participants: Published studies reporting a measure of the diagnostic accuracy of OCT for glaucoma. Methods: Review of English language papers reporting measures of diagnostic accuracy of OCT for glaucoma. Papers were identified from a Medline literature search performed in June 2006. Articles were appraised using the 25 items provided by the Standards for Reporting of Diagnostic Accuracy (STARD) initiative. Each item was recorded as full, partially, or not reported. Main Outcome Measures: Degree of compliance with the STARD guidelines. Results: Thirty papers were appraised. Eight papers (26.7%) fully reported more than half of the STARD items. The lowest number of fully reported items in a study was 5 and the highest was 17. Descriptions of key aspects of methodology frequently were missing. For example, details of participant sampling (e.g., consecutive or random selection) were described in only 8 (26.7%) of 30 publications. Measures of statistical uncertainty were reported in 18 (60%) of 30 publications. No single STARD item was fully reported by all the papers. Conclusions: The standard of reporting of diagnostic accuracy studies in glaucoma using OCT was suboptimal. It is hoped that adoption of the STARD guidelines will lead to an improvement in reporting of diagnostic accuracy studies, enabling clearer evidence to be produced for the usefulness of OCT for the diagnosis of glaucoma. © 2007 American Academy of Ophthalmology.

Comparison of diagnostic ability between a fast strategy, tendency-oriented perimetry, and the standard bracketing strategy

Purpose: To compare the diagnostic abilities of the standard bracketing strategy (BR) and a fast strategy, the tendency-oriented perimetry (TOP). Methods: Seventy-seven controls and 91 eyes from patients with glaucoma were analyzed with the strategies TOP and BR. Sensitivity (Se), specificity (Sp), the area under the receiver operating characteristic (ROC) curve (AC) and the optimum cutoff value (CO) were calculated for the visual field indices mean defect (MD), the square root of the loss variance (sLV) and the number of pathological points (NPP). Results: In the glaucoma group, the mean MD value using TOP and BR was 7.5 and 8.3 dB, respectively. The mean sLV value using TOP and BR was 5.0 and 5.3 dB, respectively. Indices provided by TOP had higher ROC values than the ones provided by BR. Using TOP, the index with the best diagnostic ability was sLV (Sp = 94.8, Se = 90.1, AC = 0.966, CO = 2.5 dB), followed by NPP and MD. Using BR, the best results were obtained for MD (Sp = 92.2, Se = 81.3, AC = 0.900, CO = 2.5 dB) followed by sLV and NPP. Conclusions: A fast strategy, TOP, had superior diagnostic ability than the standard BR. Although TOP provided lower LV values than BR, the diagnostic ability of this index was higher than that of the conventional strategy. Copyright © 2005 S. Karger AG.

Sample size in studies on diagnostic accuracy in ophthalmology:A literature survey

Aim: To assess the sample sizes used in studies on diagnostic accuracy in ophthalmology. Design and sources: A survey literature published in 2005. Methods: The frequency of reporting calculations of sample sizes and the samples' sizes were extracted from the published literature. A manual search of five leading clinical journals in ophthalmology with the highest impact (Investigative Ophthalmology and Visual Science, Ophthalmology, Archives of Ophthalmology, American Journal of Ophthalmology and British Journal of Ophthalmology) was conducted by two independent investigators. Results: A total of 1698 articles were identified, of which 40 studies were on diagnostic accuracy. One study reported that sample size was calculated before initiating the study. Another study reported consideration of sample size without calculation. The mean (SD) sample size of all diagnostic studies was 172.6 (218.9). The median prevalence of the target condition was 50.5%. Conclusion: Only a few studies consider sample size in their methods. Inadequate sample sizes in diagnostic accuracy studies may result in misleading estimates of test accuracy. An improvement over the current standards on the design and reporting of diagnostic studies is warranted.

Validation of Next Generation Sequencing Technologies in Comparison to Current Diagnostic Gold Standards for BRAF, EGFR and KRAS Mutational Analysis

Next Generation Sequencing (NGS) has the potential of becoming an important tool in clinical diagnosis and therapeutic decision-making in oncology owing to its enhanced sensitivity in DNA mutation detection, fast-turnaround of samples in comparison to current gold standard methods and the potential to sequence a large number of cancer-driving genes at the one time. We aim to test the diagnostic accuracy of current NGS technology in the analysis of mutations that represent current standard-of-care, and its reliability to generate concomitant information on other key genes in human oncogenesis. Thirteen clinical samples (8 lung adenocarcinomas, 3 colon carcinomas and 2 malignant melanomas) already genotyped for EGFR, KRAS and BRAF mutations by current standard-of-care methods (Sanger Sequencing and q-PCR), were analysed for detection of mutations in the same three genes using two NGS platforms and an additional 43 genes with one of these platforms. The results were analysed using closed platform-specific proprietary bioinformatics software as well as open third party applications. Our results indicate that the existing format of the NGS technology performed well in detecting the clinically relevant mutations stated above but may not be reliable for a broader unsupervised analysis of the wider genome in its current design. Our study represents a diagnostically lead validation of the major strengths and weaknesses of this technology before consideration for diagnostic use.

Irish study on high-density schizophrenia families:field methods and power to detect linkage

Large samples of multiplex pedigrees will probably be needed to detect susceptibility loci for schizophrenia by linkage analysis. Standardized ascertainment of such pedigrees from culturally and ethnically homogeneous populations may improve the probability of detection and replication of linkage. The Irish Study of High-Density Schizophrenia Families (ISHDSF) was formed from standardized ascertainment of multiplex schizophrenia families in 39 psychiatric facilities covering over 90% of the population in Ireland and Northern Ireland. We here describe a phenotypic sample and a subset thereof, the linkage sample. Individuals were included in the phenotypic sample if adequate diagnostic information, based on personal interview and/or hospital record, was available. Only individuals with available DNA were included in the linkage sample. Inclusion of a pedigree into the phenotypic sample required at least two first, second, or third degree relatives with non-affective psychosis (NAP), one whom had schizophrenia (S) or poor-outcome schizo-affective disorder (PO-SAD). Entry into the linkage sample required DNA samples on at least two individuals with NAP, of whom at least one had S or PO-SAD. Affection was defined by narrow, intermediate, and broad criteria. The phenotypic sample contained 277 pedigrees and 1,770 individuals and the linkage sample 265 pedigrees and 1,408 individuals. Using the intermediate definition of affection, the phenotypic sample contained 837 affected individuals and 526 affected sibling pairs. Parallel figures for the linkage sample were 700 and 420. Individuals with schizophrenia from these multiplex pedigrees resembled epidemiologically sampled cases with respect to age at onset, gender distribution, and most clinical symptoms, although they were more thought-disordered and had a poorer outcome. Power analyses based on the model of linkage heterogeneity indicated that the ISHDSF should be able to detect a major locus that influences susceptibility to schizophrenia in as few as 20% of families. Compared to first-degree relatives of epidemiologically sampled schizophrenic probands, first-degree relatives of schizophrenic members from the ISHDSF had a similar risk for schizotypal personality disorder, affective illness, alcoholism, and anxiety disorder. With sufficient resources, large-scale ascertainment of multiplex schizophrenia pedigrees is feasible, especially in countries with catchmented psychiatric care and stable populations. Although somewhat more severely ill, schizophrenic members of such pedigrees appear to clinically resemble typical schizophrenic patients. Our ascertainment process for multiplex schizophrenia families did not select for excess familial risk for affective illness or alcoholism. With its large sample ascertained in a standardized manner from a relatively homogeneous population, the ISHDSF provides considerable power to detect susceptibility loci for schizophrenia.

Post-diagnostic prescriptions for low-dose aspirin and breast cancer-specific survival: a nested case-control study in a breast cancer cohort from the UK Clinical Practice Research Datalink

INTRODUCTION: Recent observational studies indicate that post-diagnostic use of aspirin in breast cancer patients may protect against cancer progression perhaps by inhibiting cyclooxygenase-2 dependent mechanisms. Evidence also supports a crucial role for interactions between tumour cells and circulating platelets in cancer growth and dissemination, therefore, use of low-dose aspirin may reduce the risk of death from cancer in breast cancer patients.

METHODS: A cohort of newly diagnosed breast cancer patients (1998 to 2006) were identified in the UK Clinical Practice Research Datalink (and confirmed by cancer registry linkage). Cancer-specific deaths were identified up to 2011 from Office for National Statistics mortality data. A nested case-control analysis was conducted using conditional logistic regression to compare post-diagnostic aspirin exposure using General Practice prescription data in 1,435 cases (breast cancer deaths) with 5,697 controls (matched by age and year of diagnosis).

RESULTS: After breast cancer diagnosis, 18.3% of cancer-specific deaths and 18.5% of matched controls received at least one prescription for low-dose aspirin, corresponding to an odds ratio (OR) of 0.98 (95% CI 0.83, 1.15). Adjustment for potential confounders (including stage and grade) had little impact on this estimate. No dose response relationship was observed when the number of tablets was investigated and no associations were seen when analyses were stratified by receipt of prescriptions for aspirin in the pre-diagnostic period, by stage at diagnosis or by receipt of prescriptions for hormone therapy.

CONCLUSIONS: Overall, in this large population-based cohort of breast cancer patients, there was little evidence of an association between receipt of post-diagnostic prescriptions for low-dose aspirin and breast cancer-specific death. However, information was not available on medication compliance or over-the-counter use of aspirin, which may have contributed to the null findings.

Diagnostic accuracy of pulmonary host inflammatory mediators in the exclusion of ventilator-acquired pneumonia

Background: Excessive use of empirical antibiotics is common in critically ill patients. Rapid biomarker-based exclusion of infection may improve antibiotic stewardship in ventilator-acquired pneumonia (VAP). However, successful validation of the usefulness of potential markers in this setting is exceptionally rare.

Objectives: We sought to validate the capacity for specific host inflammatory mediators to exclude pneumonia in patients with suspected VAP. 

Methods: A prospective, multicentre, validation study of patients with suspected VAP was conducted in 12 intensive care units. VAP was confirmed following bronchoscopy by culture of a potential pathogen in bronchoalveolar lavage fluid (BALF) at >10⁴ colony forming units per millilitre (cfu/mL). Interleukin-1 beta (IL-1β), IL-8, matrix metalloproteinase-8 (MMP-8), MMP-9 and human neutrophil elastase (HNE) were quantified in BALF. Diagnostic utility was determined for biomarkers individually and in combination. 

Results: Paired BALF culture and biomarker results were available for 150 patients. 53 patients (35%) had VAP and 97 (65%) patients formed the non-VAP group. All biomarkers were significantly higher in the VAP group (p<0.001). The area under the receiver operator characteristic curve for IL-1β was 0.81; IL-8, 0.74; MMP-8, 0.76; MMP-9, 0.79 and HNE, 0.78. A combination of IL-1β and IL-8, at the optimal cut-point, excluded VAP with a sensitivity of 100%, a specificity of 44.3% and a post-test probability of 0% (95% CI 0% to 9.2%). 

Conclusions: Low BALF IL-1β in combination with IL-8 confidently excludes VAP and could form a rapid biomarker-based rule-out test, with the potential to improve antibiotic stewardship.

The Management of Long-Term Sickness Absence in Large Public Sector Healthcare Organisations: A Realist Evaluation Using Mixed Methods

Purpose The success of measures to reduce long-term sickness absence (LTSA) in public sector organisations is contingent on organisational context. This realist evaluation investigates how interventions interact with context to influence successful management of LTSA. Methods Multi-method case study in three Health and Social Care Trusts in Northern Ireland comprising realist literature review, semi-structured interviews (61 participants), Process-Mapping and feedback meetings (59 participants), observation of training, analysis of documents. Results Important activities included early intervention; workplace-based occupational rehabilitation; robust sickness absence policies with clear trigger points for action. Used appropriately, in a context of good interpersonal and interdepartmental communication and shared goals, these are able to increase the motivation of staff to return to work. Line managers are encouraged to take a proactive approach when senior managers provide support and accountability. Hindering factors: delayed intervention; inconsistent implementation of policy and procedure; lack of resources; organisational complexity; stakeholders misunderstanding each other’s goals and motives. Conclusions Different mechanisms have the potential to encourage common motivations for earlier return from LTSA, such as employees feeling that they have the support of their line manager to return to work and having the confidence to do so. Line managers’ proactively engage when they have confidence in the support of seniors and in their own ability to address LTSA. Fostering these motivations calls for a thoughtful, diagnostic process, taking into account the contextual factors (and whether they can be modified) and considering how a given intervention can be used to trigger the appropriate mechanisms.

Diagnostic accuracy of loop-mediated isothermal amplification as a near-patient test for meningococcal disease in children: An observational cohort study

Background: Diagnosis of meningococcal disease relies on recognition of clinical signs and symptoms that are notoriously non-specific, variable, and often absent in the early stages of the disease. Loop-mediated isothermal amplification (LAMP) has previously been shown to be fast and effective for the molecular detection of meningococcal DNA in clinical specimens. We aimed to assess the diagnostic accuracy of meningococcal LAMP as a near-patient test in the emergency department.

Methods: For this observational cohort study of diagnostic accuracy, children aged 0-13 years presenting to the emergency department of the Royal Belfast Hospital for Sick Children (Belfast, UK) with suspected meningococcal disease were eligible for inclusion. Patients underwent a standard meningococcal pack of investigations testing for meningococcal disease. Respiratory (nasopharyngeal swab) and blood specimens were collected from patients and tested with near-patient meningococcal LAMP and the results were compared with those obtained by reference laboratory tests (culture and PCR of blood and cerebrospinal fluid).

Findings: Between Nov 1, 2009, and Jan 31, 2012, 161 eligible children presenting at the hospital underwent the meningococcal pack of investigations and were tested for meningococcal disease, of whom 148 consented and were enrolled in the study. Combined testing of respiratory and blood specimens with use of LAMP was accurate (sensitivity 89% [95% CI 72-96], specificity 100% [97-100], positive predictive value 100% [85-100]; negative predictive value 98% [93-99]) and diagnostically useful (positive likelihood ratio 213 [95% CI 13-infinity] and negative likelihood ratio 0·11 [0·04-0·32]). The median time required for near-patient testing from sample to result was 1 h 26 min (IQR 1 h 20 min-1 h 32 min).

Interpretation: Meningococcal LAMP is straightforward enough for use in any hospital with basic laboratory facilities, and near-patient testing with this method is both feasible and effective. By contrast with existing UK National Institute of Health and Care Excellence guidelines, we showed that molecular testing of non-invasive respiratory specimens from children is diagnostically accurate and clinically useful.

Post-diagnostic oral bisphosphonate use and colorectal cancer mortality: a population-based cohort study within the UK Clinical Practice Research Datalink

Background:We conducted the first study to investigate post-diagnostic oral bisphosphonates use and colorectal cancer-specific mortality.

Methods:Colorectal cancer patients were identified from the National Cancer Data Repository (1998–2007) and linked to the UK Clinical Practice Research Datalink, providing prescription records, and Office of National Statistics mortality data. Time-dependent Cox regression models investigated colorectal cancer-specific mortality in post-diagnostic bisphosphonate users.

Results:Overall, in 4791 colorectal cancer patients, there was no evidence of an association between bisphosphonate use and colorectal cancer-specific mortality (adjusted hazard ratio=1.11; 95% confidence interval 0.80, 1.54) or with drug frequency or type.

Conclusions:In this novel population-based cohort study, post-diagnostic bisphosphonate use was not associated with longer rates of colorectal cancer survival.

Diagnostic performance on briefly presented digital pathology images

Background: Identifying new and more robust assessments of proficiency/expertise (finding new "biomarkers of expertise") in histopathology is desirable for many reasons. Advances in digital pathology permit new and innovative tests such as flash viewing tests and eye tracking and slide navigation analyses that would not be possible with a traditional microscope. The main purpose of this study was to examine the usefulness of time-restricted testing of expertise in histopathology using digital images.
Methods: 19 novices (undergraduate medical students), 18 intermediates (trainees), and 19 experts (consultants) were invited to give their opinion on 20 general histopathology cases after 1 s and 10 s viewing times. Differences in performance between groups were measured and the internal reliability of the test was calculated.
Results: There were highly significant differences in performance between the groups using the Fisher's least significant difference method for multiple comparisons. Differences between groups were consistently greater in the 10-s than the 1-s test. The Kuder-Richardson 20 internal reliability coefficients were very high for both tests: 0.905 for the 1-s test and 0.926 for the 10-s test. Consultants had levels of diagnostic accuracy of 72% at 1 s and 83% at 10 s.
Conclusions: Time-restricted tests using digital images have the potential to be extremely reliable tests of diagnostic proficiency in histopathology. A 10-s viewing test may be more reliable than a 1-s test. Over-reliance on "at a glance" diagnoses in histopathology is a potential source of medical error due to over-confidence bias and premature closure.