The quality of reporting of diagnostic accuracy studies in glaucoma using scanning laser polarimetry

PURPOSE: Scanning laser polarimetry (SLP) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the SLP for diagnosing glaucoma. METHODS: A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the SLP for glaucoma was performed. Two reviewers independently selected and appraised the manuscripts. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS: A total of 47 papers were identified of which the first 10 (from 1997 to 2000) and the last 10 articles (from 2004 to 2005) were appraised. Interobserver rating agreement of STARD items was high (85.5% agreement, ?=0.796). The number of STARD items properly reported ranged from 3/25 to 19/25. Only a quarter of studies (5/20) explicitly reported more than half of the STARD items. Important aspects of the methodology were often missing such as participant sampling (reported in 40% of manuscripts), masking of the readers of the index test and reference standard (reported in 20% of manuscripts), and estimation of uncertainty (eg, 95% confidence intervals, reported in 25% of manuscripts). There was a slight increase in the number of STARD items reported with time. CONCLUSIONS: The quality of reporting of diagnostic accuracy tests for glaucoma with SLP is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. © 2007 Lippincott Williams & Wilkins, Inc.

Diagnostic accuracy and reproducibility of tendency oriented perimetry in glaucoma

PURPOSE. To evaluate the diagnostic capability of tendency oriented perimetry (TOP) in glaucoma. METHODS. A): The diagnostic accuracy of mean defect (MD), square-root of the loss variance (sLV), and number of pathologic points (NPP) was calculated in 295 normal and 414 glaucoma eyes (179 early, 112 moderate, and 123 advanced) examined with TOP. B): Threshold fluctuation (F) and its relationship with the loss variance (LV) was measured in 34 normal and 33 glaucoma eyes (mean MD=3 dB; SD=3.9) for TOP and for full-threshold perimetry (FT). C): Twenty-eight eyes with stable glaucoma (mean MD=9.5 dB; SD=7.2) were examined six times to quantify LV error. D): TOP and FT were tested with the simulation program PeriSim using different behavior models. RESULTS. A): The best diagnostic index in early glaucoma (MD

The quality of reporting of diagnostic accuracy studies in glaucoma using the Heidelberg retina tomograph

PURPOSE. Scanning laser tomography with the Heidelberg retina tomograph (HRT; Heidelberg Engineering, Heidelberg, Germany) has been proposed as a useful diagnostic test for glaucoma. This study was conducted to evaluate the quality of reporting of published studies using the HRT for diagnosing glaucoma. METHODS. A validated Medline and hand search of English-language articles reporting on measures of diagnostic accuracy of the HRT for glaucoma was performed. Two reviewers selected and appraised the papers independently. The Standards for Reporting of Diagnostic Accuracy (STARD) checklist was used to evaluate the quality of each publication. RESULTS. A total of 29 articles were included. Interobserver rating agreement was observed in 83% of items (? = 0.76). The number of STARD items properly reported ranged from 5 to 18. Less than a third of studies (7/29) explicitly reported more than half of the STARD items. Descriptions of key aspects of the methodology were frequently missing. For example, the design of the study (prospective or retrospective) was reported in 6 of 29 studies, and details of participant sampling (e.g., consecutive or random selection) were described in 5 of 29 publications. The commonest description of diagnostic accuracy was sensitivity and specificity (25/29) followed by area under the ROC curve (13/29), with 9 of 29 publications reporting both. CONCLUSIONS. The quality of reporting of diagnostic accuracy tests for glaucoma with HRT is suboptimal. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies. Copyright © Association for Research in Vision and Ophthalmology.

The quality of reporting of diagnostic accuracy studies published in ophthalmic journals

Aim: To evaluate the quality of reporting of all diagnostic studies published in five major ophthalmic journals in the year 2002 using the Standards for Reporting of Diagnostic Accuracy (STARD) initiative parameters. Methods: Manual searching was used to identify diagnostic studies published in 2002 in five leading ophthalmic journals, the American Journal of Ophthalmology (AJO), Archives of Ophthalmology (Archives), British Journal of Ophthalmology (BJO), Investigative Ophthalmology and Visual Science (IOVS), and Ophthalmology. The STARD checklist of 25 items and flow chart was used to evaluate the quality of each publication. Results: A total of 16 publications were included (AJO = 5, Archives = 1, BJO = 2, IOVS = 2, and Ophthalmology = 6). More than half of the studies (n = 9) were related to glaucoma diagnosis. Other specialties included retina (n = 4) cornea (n = 2), and neuro-ophthalmology (n = 1). The most common description of diagnostic accuracy was sensitivity and specificity values, published in 13 articles. The number of fully reported items in evaluated studies ranged from eight to 19. Seven studies reported more than 50% of the STARD items. Conclusions: The current standards of reporting of diagnostic accuracy tests are highly variable. The STARD initiative may be a useful tool for appraising the strengths and weaknesses of diagnostic accuracy studies.

The accuracy of accredited glaucoma optometrists in the diagnosis and treatment recommendation for glaucoma

Aim: To compare the diagnostic performance of accredited glaucoma optometrists (AGO) for both the diagnosis of glaucoma and the decision to treat with that of routine hospital eye care, against a reference standard of expert opinion (a consultant ophthalmologist with a special interest in glaucoma). Methods: A directly comparative, masked, performance study was undertaken in Grampian, Scotland. Of 165 people invited to participate, 100 (61%) were examined. People suspected of having glaucoma underwent, within one month, a full ophthalmic assessment in both a newly established community optometry led glaucoma management scheme and a consultant led hospital eye service. Results: Agreement between the AGO and the consultant ophthalmologist in diagnosing glaucoma was substantial (89%; ? = 0.703, SE = 0.083). Agreement over the need for treatment was also substantial (88%; ? = 0.716, SE = 0.076). The agreement between the trainee ophthalmologists and the consultant ophthalmologist in the diagnosis of glaucoma and treatment recommendation was moderate (83%, ? = 0.541, SE = 0.098, SE = 0.98; and 81%, ? = 0.553, SE = 0.90, respectively). The diagnostic accuracy of the optometrists in detecting glaucoma in this population was high for specificity (0.93 (95% confidence interval, 0.85 to 0.97)) but lower for sensitivity (0.76 (0.57 to 0.89)). Performance was similar when accuracy was assessed for treatment recommendation (sensitivity 0.73 (0.57 to 0.85); specificity 0.96 (0.88 to 0.99)). The differences in sensitivity and specificity between AGO and junior ophthalmologist were not statistically significant. Conclusions: Community optometrists trained in glaucoma provided satisfactory decisions regarding diagnosis and initiation of treatment for glaucoma. With such additional training in glaucoma, optometrists are at least as accurate as junior ophthalmologists but some cases of glaucoma are missed.

The Quality of Reporting of Diagnostic Accuracy Studies of Optical Coherence Tomography in Glaucoma

Objective: To evaluate the quality of reporting of diagnostic accuracy studies using optical coherence tomography (OCT) in glaucoma. Design: Descriptive series of published studies. Participants: Published studies reporting a measure of the diagnostic accuracy of OCT for glaucoma. Methods: Review of English language papers reporting measures of diagnostic accuracy of OCT for glaucoma. Papers were identified from a Medline literature search performed in June 2006. Articles were appraised using the 25 items provided by the Standards for Reporting of Diagnostic Accuracy (STARD) initiative. Each item was recorded as full, partially, or not reported. Main Outcome Measures: Degree of compliance with the STARD guidelines. Results: Thirty papers were appraised. Eight papers (26.7%) fully reported more than half of the STARD items. The lowest number of fully reported items in a study was 5 and the highest was 17. Descriptions of key aspects of methodology frequently were missing. For example, details of participant sampling (e.g., consecutive or random selection) were described in only 8 (26.7%) of 30 publications. Measures of statistical uncertainty were reported in 18 (60%) of 30 publications. No single STARD item was fully reported by all the papers. Conclusions: The standard of reporting of diagnostic accuracy studies in glaucoma using OCT was suboptimal. It is hoped that adoption of the STARD guidelines will lead to an improvement in reporting of diagnostic accuracy studies, enabling clearer evidence to be produced for the usefulness of OCT for the diagnosis of glaucoma. © 2007 American Academy of Ophthalmology.

Sample size in studies on diagnostic accuracy in ophthalmology:A literature survey

Aim: To assess the sample sizes used in studies on diagnostic accuracy in ophthalmology. Design and sources: A survey literature published in 2005. Methods: The frequency of reporting calculations of sample sizes and the samples' sizes were extracted from the published literature. A manual search of five leading clinical journals in ophthalmology with the highest impact (Investigative Ophthalmology and Visual Science, Ophthalmology, Archives of Ophthalmology, American Journal of Ophthalmology and British Journal of Ophthalmology) was conducted by two independent investigators. Results: A total of 1698 articles were identified, of which 40 studies were on diagnostic accuracy. One study reported that sample size was calculated before initiating the study. Another study reported consideration of sample size without calculation. The mean (SD) sample size of all diagnostic studies was 172.6 (218.9). The median prevalence of the target condition was 50.5%. Conclusion: Only a few studies consider sample size in their methods. Inadequate sample sizes in diagnostic accuracy studies may result in misleading estimates of test accuracy. An improvement over the current standards on the design and reporting of diagnostic studies is warranted.

Improvement in clinical step and shoot intensity modulated radiation therapy delivery accuracy on an integrated linear accelerator control system

Purpose: The dose delivery accuracy of 30 clinical step and shoot intensity modulated radiation therapy plans was investigated using the single integrated multileaf collimator controller of the Varian Truebeam linear accelerator (linac) (Varian Medical Systems, Palo Alto, CA) and compared with the dose delivery accuracy on a previous generation Varian 2100CD C-Series linac.

Methods and Materials: Ten prostate, 10 prostate and pelvic node, and 10 head-and-neck cases were investigated in this study. Dose delivery accuracy on each linac was assessed using Farmer ionization chamber point dose measurements, 2-dimensional planar ionization chamber array measurements, and the corresponding Varian dynamic log files. Absolute point dose measurements, fluence delivery accuracy, leaf position accuracy, and the overshoot effect were assessed for each plan.

Results: Absolute point dose delivery accuracy increased by 1.5% on the Truebeam compared with the 2100CD linac. No improvement in fluence delivery accuracy between the linacs, at a gamma criterion of 3%/3 mm was measured using the 2-dimensional ionization chamber array, with median (interquartile range) gamma passing rates of 98.99% (97.70%-99.72%) and 99.28% (98.26%-99.75%) for the Truebeam and 2100CD linacs, respectively. Varian log files also showed no improvement in fluence delivery between the linacs at 3%/3 mm, with median gamma passing rates of 99.97% (99.93%-99.99%) and 99.98% (99.94%-100%) for the Truebeam and 2100CD linacs, respectively. However, log files revealed improved leaf position accuracy and fluence delivery at 1%/1 mm criterion on the Truebeam (99.87%; 99.78%-99.94%) compared with the 2100CD linac (97.87%; 91.93%-99.49%). The overshoot effect, characterized on the 2100CD linac, was not observed on the Truebeam.

Conclusions: The integrated multileaf collimator controller on the Varian Truebeam improves clinical treatment delivery accuracy of step and shoot intensity modulated radiation therapy fields compared with delivery on a Varian C-series linac. © 2014.

Accuracy of shoulder joint and subacromial injections in cadavers.

OBJECTIVE:

"Blind" shoulder injections are often inaccurate and infiltrate untargeted structures. We tested a hypothesis that optimizing certain anatomical and positional factors would improve accuracy and reduce dispersal.

METHODS:

We evaluated one subacromial and one glenohumeral injection technique on cadavers.

RESULTS:

Mean accuracy was 91% for subacromial-targeted and 74 and 91% (worst- and best-case scenarios) for joint-targeted injections. Mean dispersal was 19% for subacromial-targeted and 16% for joint-targeted injections. All results bettered those reported previously.

CONCLUSION:

These "optimized" techniques might improve accuracy and limit dispersal of blind shoulder injections in clinical situations, benefiting efficacy and safety. However, evaluation is required in a clinical setting.

The mediastinal staging accuracy of 18F-Fluorodeoxyglycose Positron Emission Tomography/Computed Tomography in non-small cell lung cancer with variable time intervals to surgery.

BACKGROUND: PET/CT scanning can determine suitability for curative therapy and inform decision making when considering radical therapy in patients with non-small cell lung cancer (NSCLC). Metastases to central mediastinal lymph nodes (N2) may alter such management decisions. We report a 2 year retrospective series assessing N2 lymph node staging accuracy with PET/CT compared to pathological analysis at surgery.

METHODS: Patients with NSCLC attending our centre (excluding those who had induction chemotherapy) who had staging PET/CT scans and pathological nodal sampling between June 2006 and June 2008 were analysed. For each lymph node assessed pathologically, the corresponding PET/CT status was determined. 64 patients with 200 N2 lymph nodes were analysed.

RESULTS: Sensitivity of PET/CT scans for indentifying involved N2 lymph nodes was
39%, specificity 96% and overall accuracy 90%. For individual lymph node analysis, logistic regression demonstrated a significant linear association between PET/CT sensitivity and time from scanning to surgery (p=0.031) but not for specificity and accuracy. Those scanned <9 weeks before pathological sampling were significantly more sensitive (64% >9 weeks, 0% ≥ 9 weeks, p=0.013) and more accurate (94% <9 weeks, 81% ≥ 9 weeks, p=0.007). Differences in specificity were not seen (97% <9 weeks, 91% ≥ 9 weeks, p=0.228). No significant difference in specificity was found at any time point.

CONCLUSIONS: We recommend that if a PET/CT scan is older than 9 weeks, and management would be altered by the presence of N2 nodes, re-staging of the
mediastinum should be undertaken.

Diagnostic accuracy of pulmonary host inflammatory mediators in the exclusion of ventilator-acquired pneumonia

Background: Excessive use of empirical antibiotics is common in critically ill patients. Rapid biomarker-based exclusion of infection may improve antibiotic stewardship in ventilator-acquired pneumonia (VAP). However, successful validation of the usefulness of potential markers in this setting is exceptionally rare.

Objectives: We sought to validate the capacity for specific host inflammatory mediators to exclude pneumonia in patients with suspected VAP. 

Methods: A prospective, multicentre, validation study of patients with suspected VAP was conducted in 12 intensive care units. VAP was confirmed following bronchoscopy by culture of a potential pathogen in bronchoalveolar lavage fluid (BALF) at >10⁴ colony forming units per millilitre (cfu/mL). Interleukin-1 beta (IL-1β), IL-8, matrix metalloproteinase-8 (MMP-8), MMP-9 and human neutrophil elastase (HNE) were quantified in BALF. Diagnostic utility was determined for biomarkers individually and in combination. 

Results: Paired BALF culture and biomarker results were available for 150 patients. 53 patients (35%) had VAP and 97 (65%) patients formed the non-VAP group. All biomarkers were significantly higher in the VAP group (p<0.001). The area under the receiver operator characteristic curve for IL-1β was 0.81; IL-8, 0.74; MMP-8, 0.76; MMP-9, 0.79 and HNE, 0.78. A combination of IL-1β and IL-8, at the optimal cut-point, excluded VAP with a sensitivity of 100%, a specificity of 44.3% and a post-test probability of 0% (95% CI 0% to 9.2%). 

Conclusions: Low BALF IL-1β in combination with IL-8 confidently excludes VAP and could form a rapid biomarker-based rule-out test, with the potential to improve antibiotic stewardship.