Interobserver variability for retreatment indications after Ranibizumab loading doses in neovascular age-related macular degeneration

To assess the interobserver variability (IOV) in indicating retreatment for neovascular Age-related macular degeneration 4 weeks after three Ranibizumab loading doses using spectral domain OCT (SD-OCT) as the primary objective diagnostic tool.

Interobserver variability in assessment of cranial ultrasound in very preterm infants

Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required.

Intraobserver and interobserver variability of 64-row computed tomography abdominal aortic aneurysm neck measurements

BACKGROUND: Integrity of the abdominal aortic aneurysm (AAA) neck is crucial for the long-term success of endovascular AAA repair (EVAR). However, suitable tools for reliable assessment of changes in small aortic volumes are lacking. The purpose of this study was to assess the intraobserver and interobserver variability of software-enhanced 64-row computed tomographic angiography (CTA) AAA neck volume measurements in patients after EVAR. METHODS: A total of 25 consecutive patients successfully treated by EVAR underwent 64-row follow-up CTA in 1.5-mm collimation. Manual CTA measurements were performed twice by three blinded and independent readers in random order with at least a 4-week interval between readings. Maximum and minimum transverse aortic neck diameters were measured twice on two different levels within the proximal neck. Volumetry of the proximal aortic neck was performed by using dedicated software. Variability was calculated as 1.96 SD of the mean arithmetic difference according to Bland and Altman. Two-sided and paired t tests were used to compare measurements. P values <.05 were considered to indicate statistical significance. RESULTS: Intraobserver agreement was excellent for dedicated aneurysmal neck volumetry, with mean differences of less than 1 mL (P > .05), whereas it was poor for transverse aortic neck diameter measurements (P < .05). However, interobserver variability was statistically significant for both neck volumetry (P < .005) and neck diameter measurements (P < .015). CONCLUSIONS: The reliability of dedicated AAA neck volumetry by using 64-row CTA is excellent for serial measurements by individual readers, but not between different readers. Therefore, studies should be performed with aortic neck volumetry by a single experienced reader.

Sixty-four-detector CT angiography of infrarenal aortic neck length and angulation: prospective analysis of interobserver variability

PURPOSE: To quantify the interobserver variability of abdominal aortic aneurysm (AAA) neck length and angulation measurements. MATERIALS AND METHODS: A total of 25 consecutive patients scheduled for endovascular AAA repair underwent follow-up 64-row computed tomographic (CT) angiography in 0.625-mm collimation. AAA neck length and angulation were determined by four blinded, independent readers. AAA neck length was defined as the longitudinal distance between the first transverse CT slice directly distal to the lowermost renal artery and the first transverse CT slice that showed at least a 15% larger outer aortic wall diameter versus the diameter measured directly below the lowermost renal artery. Infrarenal AAA neck angulation was defined as the true angle between the longitudinal axis of the proximal AAA neck and the longitudinal axis of the AAA lumen as analyzed on three-dimensional CT reconstructions. RESULTS: Mean deviation in aortic neck length determination was 32.3% and that in aortic neck angulation was 32.1%. Interobserver variability of aortic neck length and angulation measurements was considerable: in any reader combination, at least one measurement difference was outside the predefined limits of agreement. CONCLUSIONS: Assessment of the longitudinal extension and angulation of the infrarenal aortic neck is associated with substantial observer variability, even if measurement is carried out according to a standardized protocol. Further studies are mandatory to assess dedicated technical approaches to minimize variance in the determination of the longitudinal extension and angulation of the infrarenal aortic neck.

Interlaboratory variability of MIB1 staining in well-differentiated pancreatic neuroendocrine tumors

Neuroendocrine tumors (NET) are routinely graded and staged to judge prognosis. Proliferation index using MIB1 staining has been introduced to assess grading. There are vivid discussions on cutoff definitions, automated counting, and interobserver variability. However, no data exist regarding interlaboratory reproducibility for low proliferation indices which are of importance to discriminate between G1 and G2 NET. We performed MIB1 staining in three different university hospital-based pathology laboratories on a tissue micro array (TMA) of a well-characterized patient cohort, containing pancreatic NET of 61 patients. To calculate the proliferation index, number of positive tumor nuclei was divided by the total number of tumor nuclei. Labeling index was compared to mitotic counts in whole tissue sections and to clinical outcome. Linear regression analysis, intraclass comparison, and log-rank analysis were performed. Intraclass correlation showed moderate-to-fair agreement. Especially low proliferating tumors were affected by interlaboratory differences. Log-rank analysis was performed for each lab and resulted in three different cutoffs (5.0, 3.0, and 0.5 %). Every calculated cutoff stratified the patient cohort to a significant extent for the underlying stain (p < 0.001, <0.001, and <0.001) but showed no or lesser significance when applied to the other stains. Significant and relevant interlab differences for MIB1 exist. Since the MIB1 proliferation index influences grading, local cutoffs or external standardization should urgently be introduced to achieve reliability and reproducibility.

Interobserver variations of target volume delineation in multicatheter partial breast brachytherapy after open cavity surgery

PURPOSE To investigate interobserver variations of target volume delineations in accelerated partial breast irradiation with multicatheter brachytherapy (BT) and to assess the impact of guidelines on consistency of contouring. METHODS AND MATERIALS A contouring study with two phases in interstitial accelerated partial breast irradiation after open cavity surgery was conducted by the Groupe Européen de Curiethérapie-European Society for Radiotherapy and Oncology Breast Cancer Working Group. Contours of cavity and planning target volume (PTV) on preimplant and postimplant CT images were delineated. In Phase 1, nine radiation oncologists defined the target volumes of 5 patients, whereas in Phase 2, four observers draw the contours of 4 patients applying guidelines. In Phase 1, experience in breast BT after open cavity surgery was assessed. The delineations were compared between Phase 1 and Phase 2, the impact of guidelines was assessed, and cavity visualization score was related to consistency of delineations. RESULTS Significant interobserver variability in delineations of lumpectomy cavity and PTV was observed among the participants. Observers with BT experience after open cavity surgery outlined the cavity and PTV more consistently (conformity indexgen: 0.52 vs. 0.48 and 0.59 vs. 0.55 for preimplant and postimplant cavities). For all volumes, the mean Vmax/Vmin was 2.2 vs. 2.8. Having used guidelines all conformity indices increased significantly. For cavity, the increase was 14% and 11%, whereas for the PTV, 28% and 17% on the preimplant and postimplant CT images, respectively. A strong correlation was found between consistency of contours and cavity visualization score. CONCLUSIONS Simple guidelines on defining the lumpectomy cavity significantly increased the consistency of contouring. Reliable consistency of target volume definition can be expected only for good cavity visibility.

Tumor budding score based on 10 high-power fields is a promising basis for a standardized prognostic scoring system in stage II colorectal cancer

Tumor budding is recognized by the World Health Organization as an additional prognostic factor in colorectal cancer but remains unreported in diagnostic work due to the absence of a standardized scoring method. This study aims to assess the most prognostic and reproducible scoring systems for tumor budding in colorectal cancer. Tumor budding on pancytokeratin-stained whole tissue sections from 105 well-characterized stage II patients was scored by 3 observers using 7 methods: Hase, Nakamura, Ueno, Wang (conventional and rapid method), densest high-power field, and 10 densest high-power fields. The predictive value for clinicopathologic features, the prognostic significance, and interobserver variability of each scoring method was analyzed. Pancytokeratin staining allowed accurate evaluation of tumor buds. Interobserver agreement for 3 observers was excellent for densest high-power field (intraclass correlation coefficient, 0.83) and 10 densest high-power fields (intraclass correlation coefficient, 0.91). Agreement was moderate to substantial for the conventional Wang method (κ = 0.46-0.62) and moderate for the rapid method (κ = 0.46-0.58). For Nakamura, moderate agreement (κ = 0.41-0.52) was reached, whereas concordance was fair to moderate for Ueno (κ = 0.39-0.56) and Hase (κ = 0.29-0.51). The Hase, Ueno, densest high-power field, and 10 densest high-power field methods identified a significant association of tumor budding with tumor border configuration. In multivariate analysis, only tumor budding as evaluated in densest high-power field and 10 densest high-power fields had significant prognostic effects on patient survival (P < .01), with high prognostic accuracy over the full 10-year follow-up. Scoring tumor buds in 10 densest high-power fields is a promising method to identify stage II patients at high risk for recurrence in daily diagnostics; it is highly reproducible, accounts for heterogeneity, and has a strong predictive value for adverse outcome.

Evaluation of filtering blebs using the 'Wuerzburg bleb classification score' compared to clinical findings

To determine the agreement between intraocular pressure and the 'Wuerzburg bleb classification score', as well as between single items of the score and intraocular pressure. Interobserver variability was analyzed.

Uterine fibroid embolization: the utility of aortography in detecting ovarian artery collateral supply

PURPOSE: To retrospectively determine the sensitivity of ovarian artery (OA) visualization at aortography performed after uterine fibroid embolization (UFE) and, using OA arteriography as the reference standard, compare the extent of arterial flow to the uterus at aortography with selective ovarian arteriography, to establish the utility of aortography and ovarian arteriography in the routine practice of UFE. MATERIALS AND METHODS: This study received institutional review board approval with waiver of informed consent and was HIPAA compliant. Retrospective review of 1129 consecutive UFE patients (1072 with aortograms, 57 excluded; mean age, 44 years; range, 21-60 years) was performed to identify all visible OAs. Visible OAs were independently graded by two interventional radiologists according to extent of pelvic arterial flow. If selective arteriography was performed, a second grade was assigned based on assessment of the selective study. Descriptive and summary statistics were used for assessment by the senior observer, and interobserver variability was determined. RESULTS: Of 1072 UFE patients, 184 (17.2%) had at least one visible OA. Ten (0.8%) patients were identified at aortography with collateral OA supply to more than 10% of the uterus. In total, 251 OAs were visualized, and 157 of these were further evaluated with selective study. Sixty-two (5.8%) patients were identified at selective arteriography as having collateral OA supply. The sensitivity of aortography was approximately 18%. Interobserver concordance was high (kappa values of 0.81 and 0.90 for aortography and selective study, respectively), but not perfect. CONCLUSION: Aortography rarely helps identify patients with substantial residual OA supply to the uterus and is a poor predictor of the extent of that supply, and thus may be of limited utility in routine UFE.

Automatic algorithm for monitoring systolic pressure variation and difference in pulse pressure

BACKGROUND: Difference in pulse pressure (dPP) reliably predicts fluid responsiveness in patients. We have developed a respiratory variation (RV) monitoring device (RV monitor), which continuously records both airway pressure and arterial blood pressure (ABP). We compared the RV monitor measurements with manual dPP measurements. METHODS: ABP and airway pressure (PAW) from 24 patients were recorded. Data were fed to the RV monitor to calculate dPP and systolic pressure variation in two different ways: (a) considering both ABP and PAW (RV algorithm) and (b) ABP only (RV(slim) algorithm). Additionally, ABP and PAW were recorded intraoperatively in 10-min intervals for later calculation of dPP by manual assessment. Interobserver variability was determined. Manual dPP assessments were used for comparison with automated measurements. To estimate the importance of the PAW signal, RV(slim) measurements were compared with RV measurements. RESULTS: For the 24 patients, 174 measurements (6-10 per patient) were recorded. Six observers assessed dPP manually in the first 8 patients (10-min interval, 53 measurements); no interobserver variability occurred using a computer-assisted method. Bland-Altman analysis showed acceptable bias and limits of agreement of the 2 automated methods compared with the manual method (RV: -0.33% +/- 8.72% and RV(slim): -1.74% +/- 7.97%). The difference between RV measurements and RV(slim) measurements is small (bias -1.05%, limits of agreement 5.67%). CONCLUSIONS: Measurements of the automated device are comparable with measurements obtained by human observers, who use a computer-assisted method. The importance of the PAW signal is questionable.

Leg ischemia: assessment with MR angiography and spectroscopy

PURPOSE: To prospectively determine reproducibility of magnetic resonance (MR) angiography and MR spectroscopy of deoxymyoglobin in assessment of collateral vessels and tissue perfusion in patients with critical limb ischemia (CLI) and to follow changes in patients undergoing intramuscular vascular endothelial growth factor (pVEGF)-C gene therapy, percutaneous transluminal angioplasty, supervised exercise training, or no therapy. MATERIALS AND METHODS: Study and gene therapy protocols were approved, and all patients gave written informed consent. To determine repeatability and reproducibility, seven patients underwent MR angiography and five underwent MR spectroscopy. The techniques were used to judge disease progress in 12 other patients with or without therapy: MR angiography to help determine change in visualization of collateral vessels and MR spectroscopy to help assess change in perfusion at proximal and distal calf levels. MR angiographic results were subjectively analyzed by three blinded readers. Intraobserver variability was expressed as 95% confidence interval (CI) (n=7); interobserver variability, as kappa statistic (n=15). Reexamination variability of MR spectroscopy was given as 95% CI for subsequent recovery times, and correlation with disease extent was calculated with Kendall taub rank correlation. Fisher-Yates test was used to correlate changes with pressure measurements and clinical course. RESULTS: Intraobserver and interobserver concordance was sensitive for detection of collateral vessels. Intraobserver agreement was 85.7% (95% CI: 42.1%, 99.6%). Interobserver agreement was high for small collateral vessels (kappa=0.74, P <.001) and fair for large collateral vessels (kappa=0.36, P=.002). MR spectroscopy was reproducible (95% CI: +/-26 seconds for proximal, +/-21 seconds for distal) and showed a correlation with disease extent (proximal calf, taub=0.84, P <.001; distal calf, taub=0.68, P=.04). Small collateral vessels increased over time (P=.04) but did not correlate with pressure measurements and clinical course. Recovery time correlated with clinical course (proximal calf, P=.03; distal calf, P=.005). CONCLUSION: MR angiography and MR spectroscopy of deoxymyoglobin can help document changes in visualization of collateral vessels and tissue perfusion in patients with CLI.

Tumor Regression Grading of Gastrointestinal Carcinomas after Neoadjuvant Treatment

Multimodal therapy concepts have been successfully implemented in the treatment of locally advanced gastrointestinal malignancies. The effects of neoadjuvant chemo- or radiochemotherapy such as scarry fibrosis or resorptive changes and inflammation can be determined by histopathological investigation of the subsequent resection specimen. Tumor regression grading (TRG) systems which aim to categorize the amount of regressive changes after cytotoxic treatment mostly refer onto the amount of therapy induced fibrosis in relation to residual tumor or the estimated percentage of residual tumor in relation to the previous tumor site. Commonly used TRGs for upper gastrointestinal carcinomas are the Mandard grading and the Becker grading system, e.g., and for rectal cancer the Dworak or the Rödel grading system, or other systems which follow similar definitions. Namely for gastro-esophageal carcinomas these TRGs provide important prognostic information since complete or subtotal tumor regression has shown to be associated with better patient's outcome. The prognostic value of TRG may even exceed those of currently used staging systems (e.g., TNM staging) for tumors treated by neoadjuvant therapy. There have been some limitations described regarding interobserver variability especially in borderline cases, which may be improved by standardization of work up of resection specimen and better training of histopathologic determination of regressive changes. It is highly recommended that TRG should be implemented in every histopathological report of neoadjuvant treated gastrointestinal carcinomas. The aim of this review is to disclose the relevance of histomorphological TRG to accomplish an optimal therapy for patients with gastrointestinal carcinomas.

The role of diameter versus volume as the best prognostic measurement of abdominal aortic aneurysms

Accurate measurement of abdominal aortic aneurysms is necessary to predict rupture risk and, more recently, to follow aneurysm sac behavior following endovascular repair. Up until this point, aneurysm diameter has been the most common measurement utilized for these purposes. Although aneurysm diameter is predictive of rupture, accurate measurement is hindered by such factors as aortic tortuosity and interobserver variability, and it does not account for variations in morphology such as saccular aneurysms. Additionally, decreases in aneurysm diameter do not completely describe the somewhat complex remodeling seen following endovascular repair of aortic aneurysms. Measurement of aneurysm volume has the advantage of describing aneurysm morphology in a multidimensional fashion, but it has not been readily available or easily measured until recently. This has changed with the introduction of commercially available software tools that permit quicker and easier to perform volume measurements. Whether it is time for volume to replace, or compliment, diameter is the subject of the current debate.

Ventilation/perfusion SPECT/CT in patients with pulmonary emphysema. Evaluation of software-based analysing

UNLABELLED The purpose of this study was to evaluate the reproducibility of a new software based analysing system for ventilation/perfusion single-photon emission computed tomography/computed tomography (V/P SPECT/CT) in patients with pulmonary emphysema and to compare it to the visual interpretation. PATIENTS, MATERIAL AND METHODS 19 patients (mean age: 68.1 years) with pulmonary emphysema who underwent V/P SPECT/CT were included. Data were analysed by two independent observers in visual interpretation (VI) and by software based analysis system (SBAS). SBAS PMOD version 3.4 (Technologies Ltd, Zurich, Switzerland) was used to assess counts and volume per lung lobe/per lung and to calculate the count density per lung, lobe ratio of counts and ratio of count density. VI was performed using a visual scale to assess the mean counts per lung lobe. Interobserver variability and association for SBAS and VI were analysed using Spearman's rho correlation coefficient. RESULTS Interobserver agreement correlated highly in perfusion (rho: 0.982, 0.957, 0.90, 0.979) and ventilation (rho: 0.972, 0.924, 0.941, 0.936) for count/count density per lobe and ratio of counts/count density in SBAS. Interobserver agreement correlated clearly for perfusion (rho: 0.655) and weakly for ventilation (rho: 0.458) in VI. CONCLUSIONS SBAS provides more reproducible measures than VI for the relative tracer uptake in V/P SPECT/CTs in patients with pulmonary emphysema. However, SBAS has to be improved for routine clinical use.

Intraobserver and interobserver agreement for results of low-field magnetic resonance imaging in dogs with and without clinical signs of disk-associated wobbler syndrome

OBJECTIVE: To determine interobserver and intraobserver agreement for results of low-field magnetic resonance imaging (MRI) in dogs with and without disk-associated wobbler syndrome (DAWS). DESIGN: Validation study. ANIMALS: 21 dogs with and 23 dogs without clinical signs of DAWS. PROCEDURES: For each dog, MRI of the cervical vertebral column was performed. The MRI studies were presented in a randomized sequence to 4 board-certified radiologists blinded to clinical status. Observers assessed degree of disk degeneration, disk-associated and dorsal compression, alterations in intraspinal signal intensity (ISI), vertebral body abnormalities, and new bone formation and categorized each study as originating from a clinically affected or clinically normal dog. Interobserver agreement was calculated for 44 initial measurements for each observer. Intraobserver agreement was calculated for 11 replicate measurements for each observer. RESULTS: There was good interobserver agreement for ratings of disk degeneration and vertebral body abnormalities and moderate interobserver agreement for ratings of disk-associated compression, dorsal compression, alterations in ISI, new bone formation, and suspected clinical status. There was very good intraobserver agreement for ratings of disk degeneration, disk-associated compression, alterations in ISI, vertebral body abnormalities, and suspected clinical status. There was good intraobserver agreement for ratings of dorsal compression and new bone formation. Two of 21 clinically affected dogs were erroneously categorized as clinically normal, and 4 of 23 clinically normal dogs were erroneously categorized as clinically affected. CONCLUSIONS AND CLINICAL RELEVANCE: Results suggested that variability exists among observers with regard to results of MRI in dogs with DAWS and that MRI could lead to false-positive and false-negative assessments.