Intraobserver and interobserver variability of ascending aorta diameter measurements as assessed by ECG-gated MDCT : automatic versus manual measurements : P15

Purpose: Revolutionary endovascular treatments are on the verge of being available for management of ascending aortic diseases. Morphometric measurements of the ascending aorta have already been done with ECG-gated MDCT to help such therapeutic development. However the reliability of these measurements remains unknown. The objective of this work was to compare the intraobserver and interobserver variability of CAD (computer aided diagnosis) versus manual measurements in the ascending aorta. Methods and materials: Twenty-six consecutive patients referred for ECG-gated CT thoracic angiography (64-row CT scanner) were evaluated. Measurements of the maximum and minimum ascending aorta diameters at mid-distance between the brachiocephalic artery and the aortic valve were obtained automatically with a commercially available CAD and manually by two observers separately. Both observers repeated the measurements during a different session at least one month after the first measurements. Intraclass coefficients as well the Bland and Altman method were used for comparison between measurements. Two-paired t-test was used to determine the significance of intraobserver and interobserver differences (alpha = 0.05). Results: There is a significant difference between CAD and manual measurements in the maximum diameter (p = 0.004) for the first observer, whereas the difference was significant for minimum diameter between the second observer and the CAD (p <0.001). Interobserver variability showed a weak agreement when measurements were done manually. Intraobserver variability was lower with the CAD compared to the manual measurements (limits of variability: from -0.7 to 0.9 mm for the former and from -1.2 to 1.3 mm for the latter). Conclusion: In order to improve reproductibility of measurements whenever needed, pre- and post-therapeutic management of the ascending aorta may benefit from follow-up done by a unique observer with the help of CAD.

Intraobserver and interobserver variability of ascending aorta diameter as assessed with ECG-gated MDCT: automatic versus manual measurements

Purpose: Recently morphometric measurements of the ascending aorta have been done with ECG-gated MDCT to help the development of future endovascular therapies (TCT) [1]. However, the variability of these measurements remains unknown. It will be interesting to know the impact of CAD (computer aided diagnosis) with automated segmentation of the vessel and automatic measurements of diameter on the management of ascending aorta aneurysms. Methods and Materials: Thirty patients referred for ECG-gated CT thoracic angiography (64-row CT scanner) were evaluated. Measurements of the maximum and minimum ascending aorta diameters were obtained automatically with a commercially available CAD and semi-manually by two observers separately. The CAD algorithms segment the iv-enhanced lumen of the ascending aorta into perpendicular planes along the centreline. The CAD then determines the largest and the smallest diameters. Both observers repeated the automatic measurements and the semimanual measurements during a different session at least one month after the first measurements. The Bland and Altman method was used to study the inter/intraobserver variability. A Wilcoxon signed-rank test was also used to analyse differences between observers. Results: Interobserver variability for semi-manual measurements between the first and second observers was between 1.2 to 1.0 mm for maximal and minimal diameter, respectively. Intraobserver variability of each observer ranged from 0.8 to 1.2 mm, the lowest variability being produced by the more experienced observer. CAD variability could be as low as 0.3 mm, showing that it can perform better than human observers. However, when used in nonoptimal conditions (streak artefacts from contrast in the superior vena cava or weak lumen enhancement), CAD has a variability that can be as high as 0.9 mm, reaching variability of semi-manual measurements. Furthermore, there were significant differences between both observers for maximal and minimal diameter measurements (p<0.001). There was also a significant difference between the first observer and CAD for maximal diameter measurements with the former underestimating the diameter compared to the latter (p<0.001). As for minimal diameters, they were higher when measured by the second observer than when measured by CAD (p<0.001). Neither the difference of mean minimal diameter between the first observer and CAD nor the difference of mean maximal diameter between the second observer and CAD was significant (p=0.20 and 0.06, respectively). Conclusion: CAD algorithms can lessen the variability of diameter measurements in the follow-up of ascending aorta aneurysms. Nevertheless, in non-optimal conditions, it may be necessary to correct manually the measurements. Improvements of the algorithms will help to avoid such a situation.

Interobserver variability of ultrasound parameters in portal hypertension

The aim of this study was to assess interobserver agreement of ultrasound parameters for portal hypertension in hepatosplenic mansonic schistosomiasis. Spleen size, diameter of the portal, splenic and superior mesenteric veins and presence of thrombosis and cavernous transformation were determined by three radiologists in blinded and independent fashion in 30 patients. Interobserver agreement was measured by the kappa index and intraclass correlation coefficient. Interobserver agreement was considered substantial (κ = 0.714-0.795) for portal vein thrombosis and perfect (κ = 1) for cavernous transformation. Interobserver agreement measured by the intraclass correlation coefficient was excellent for longitudinal diameter of the spleen (r = 0.828-0.869) and splenic index (r = 0.816-0.905) and varied from fair to almost perfect for diameter of the portal (r = 0.622-0.675), splenic (r = 0.573-0.913) and superior mesenteric (r = 0.525-0.607) veins. According to the results, ultrasound is a highly reproducible method for the main morphological parameters of portal hypertension in schistosomiasis patients.

Comparison of the interobserver variability of 2 different methods of dietary assessment in a geriatric ward: a pilot study.

BACKGROUND: Protein-energy malnutrition is highly prevalent in aged populations. Associated clinical, economic, and social burden is important. A valid screening method that would be robust and precise, but also easy, simple, and rapid to apply, is essential for adequate therapeutic management. OBJECTIVES: To compare the interobserver variability of 2 methods measuring food intake: semiquantitative visual estimations made by nurses versus calorie measurements performed by dieticians on the basis of standardized color digital photographs of servings before and after consumption. DESIGN: Observational monocentric pilot study. SETTING/PARTICIPANTS: A geriatric ward. The meals were randomly chosen from the meal tray. The choice was anonymous with respect to the patients who consumed them. MEASUREMENTS: The test method consisted of the estimation of calorie consumption by dieticians on the basis of standardized color digital photographs of servings before and after consumption. The reference method was based on direct visual estimations of the meals by nurses. Food intake was expressed in the form of a percentage of the serving consumed and calorie intake was then calculated by a dietician based on these percentages. The methods were applied with no previous training of the observers. Analysis of variance was performed to compare their interobserver variability. RESULTS: Of 15 meals consumed and initially examined, 6 were assessed with each method. Servings not consumed at all (0% consumption) or entirely consumed by the patient (100% consumption) were not included in the analysis so as to avoid systematic error. The digital photography method showed higher interobserver variability in calorie intake estimations. The difference between the compared methods was statistically significant (P < .03). CONCLUSIONS: Calorie intake measures for geriatric patients are more concordant when estimated in a semiquantitative way. Digital photography for food intake estimation without previous specific training of dieticians should not be considered as a reference method in geriatric settings, as it shows no advantages in terms of interobserver variability.

A semi-automatic computerized method to measure baroreflex-mediated heart rate responses that reduces interobserver variability

Arterial baroreflex sensitivity estimated by pharmacological impulse stimuli depends on intrinsic signal variability and usually a subjective choice of blood pressure (BP) and heart rate (HR) values. We propose a semi-automatic method to estimate cardiovascular reflex sensitivity to bolus infusions of phenylephrine and nitroprusside. Beat-to-beat BP and HR time series for male Wistar rats (N = 13) were obtained from the digitized signal (sample frequency = 2 kHz) and analyzed by the proposed method (PRM) developed in Matlab language. In the PRM, time series were low-pass filtered with zero-phase distortion (3rd order Butterworth used in the forward and reverse direction) and presented graphically, and parameters were selected interactively. Differences between basal mean values and peak BP (deltaBP) and HR (deltaHR) values after drug infusions were used to calculate baroreflex sensitivity indexes, defined as the deltaHR/deltaBP ratio. The PRM was compared to the method traditionally (TDM) employed by seven independent observers using files for reflex bradycardia (N = 43) and tachycardia (N = 61). Agreement was assessed by Bland and Altman plots. Dispersion among users, measured as the standard deviation, was higher for TDM for reflex bradycardia (0.60 ± 0.46 vs 0.21 ± 0.26 bpm/mmHg for PRM, P < 0.001) and tachycardia (0.83 ± 0.62 vs 0.28 ± 0.28 bpm/mmHg for PRM, P < 0.001). The advantage of the present method is related to its objectivity, since the routine automatically calculates the desired parameters according to previous software instructions. This is an objective, robust and easy-to-use tool for cardiovascular reflex studies.

Interobserver variability for retreatment indications after Ranibizumab loading doses in neovascular age-related macular degeneration

To assess the interobserver variability (IOV) in indicating retreatment for neovascular Age-related macular degeneration 4 weeks after three Ranibizumab loading doses using spectral domain OCT (SD-OCT) as the primary objective diagnostic tool.

Interobserver variability in assessment of cranial ultrasound in very preterm infants

Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required.

Intraobserver and interobserver variability of 64-row computed tomography abdominal aortic aneurysm neck measurements

BACKGROUND: Integrity of the abdominal aortic aneurysm (AAA) neck is crucial for the long-term success of endovascular AAA repair (EVAR). However, suitable tools for reliable assessment of changes in small aortic volumes are lacking. The purpose of this study was to assess the intraobserver and interobserver variability of software-enhanced 64-row computed tomographic angiography (CTA) AAA neck volume measurements in patients after EVAR. METHODS: A total of 25 consecutive patients successfully treated by EVAR underwent 64-row follow-up CTA in 1.5-mm collimation. Manual CTA measurements were performed twice by three blinded and independent readers in random order with at least a 4-week interval between readings. Maximum and minimum transverse aortic neck diameters were measured twice on two different levels within the proximal neck. Volumetry of the proximal aortic neck was performed by using dedicated software. Variability was calculated as 1.96 SD of the mean arithmetic difference according to Bland and Altman. Two-sided and paired t tests were used to compare measurements. P values <.05 were considered to indicate statistical significance. RESULTS: Intraobserver agreement was excellent for dedicated aneurysmal neck volumetry, with mean differences of less than 1 mL (P > .05), whereas it was poor for transverse aortic neck diameter measurements (P < .05). However, interobserver variability was statistically significant for both neck volumetry (P < .005) and neck diameter measurements (P < .015). CONCLUSIONS: The reliability of dedicated AAA neck volumetry by using 64-row CTA is excellent for serial measurements by individual readers, but not between different readers. Therefore, studies should be performed with aortic neck volumetry by a single experienced reader.

Sixty-four-detector CT angiography of infrarenal aortic neck length and angulation: prospective analysis of interobserver variability

PURPOSE: To quantify the interobserver variability of abdominal aortic aneurysm (AAA) neck length and angulation measurements. MATERIALS AND METHODS: A total of 25 consecutive patients scheduled for endovascular AAA repair underwent follow-up 64-row computed tomographic (CT) angiography in 0.625-mm collimation. AAA neck length and angulation were determined by four blinded, independent readers. AAA neck length was defined as the longitudinal distance between the first transverse CT slice directly distal to the lowermost renal artery and the first transverse CT slice that showed at least a 15% larger outer aortic wall diameter versus the diameter measured directly below the lowermost renal artery. Infrarenal AAA neck angulation was defined as the true angle between the longitudinal axis of the proximal AAA neck and the longitudinal axis of the AAA lumen as analyzed on three-dimensional CT reconstructions. RESULTS: Mean deviation in aortic neck length determination was 32.3% and that in aortic neck angulation was 32.1%. Interobserver variability of aortic neck length and angulation measurements was considerable: in any reader combination, at least one measurement difference was outside the predefined limits of agreement. CONCLUSIONS: Assessment of the longitudinal extension and angulation of the infrarenal aortic neck is associated with substantial observer variability, even if measurement is carried out according to a standardized protocol. Further studies are mandatory to assess dedicated technical approaches to minimize variance in the determination of the longitudinal extension and angulation of the infrarenal aortic neck.

Interobserver and intraobserver variability of the apparent diffusion coefficient in treated malignant hepatic lesions on a 3.0T machine: measurements in the whole lesion versus in the area with the most restricted diffusion.

PURPOSE: To assess the inter/intraobserver variability of apparent diffusion coefficient (ADC) measurements in treated hepatic lesions and to compare ADC measurements in the whole lesion and in the area with the most restricted diffusion (MRDA). MATERIALS AND METHODS: Twenty-five patients with treated malignant liver lesions were examined on a 3.0T machine. After agreeing on the best ADC image, two readers independently measured the ADC values in the whole lesion and in the MRDA. These measurements were repeated 1 month later. The Bland-Altman method, Spearman correlation coefficients, and the Wilcoxon signed-rank test were used to evaluate the measurements. RESULTS: Interobserver variability for ADC measurements in the whole lesion and in the MRDA was 0.17 x 10(-3) mm(2)/s [-0.17, +0.17] and 0.43 x 10(-3) mm(2)/s [-0.45, +0.41], respectively. Intraobserver limits of agreement could be as low as [-0.10, +0.12] 10(-3) mm(2)/s and [-0.20, +0.33] 10(-3) mm(2)/s for measurements in the whole lesion and in the MRDA, respectively. CONCLUSION: A limited variability in ADC measurements does exist, and it should be considered when interpreting ADC values of hepatic malignancies. This is especially true for the measurements of the minimal ADC.

Intraductal Carcinoma Of The Prostate: Interobserver Reproducibility Survey Of 39 Urologic Pathologists.

The diagnosis of intraductal carcinoma (IDC) of the prostate remains subjective because 3 sets of diagnostic criteria are in use. An internet survey was compiled from 38 photomicrographs showing duct proliferations: 14 signed out as high-grade prostatic intraepithelial neoplasia (HGPIN), 17 IDC, and 7 invasive cribriform/ductal carcinoma. Each image was assessed for the presence of 9 histologic criteria ascribed to IDC. Thirty-nine respondents were asked to rate images as (1) benign/reactive, (2) HGPIN, (3) borderline between HGPIN and IDC, (4) IDC, or (5) invasive cribriform/ductal carcinoma. Intraclass correlation coefficient was 0.68. There was 70% overall agreement with HGPIN, 43% with IDC, and 73% with invasive carcinoma (P < .001, χ(2)). Respondents considered 19 (50%) of 38 cases as IDC candidates, of which 5 (26%) had a two-thirds consensus for IDC; two-thirds consensus for either borderline or IDC was reached in 9 (47%). Two-thirds consensus other than IDC was reached in the remaining 19 of 38 cases, with 15 supporting HGPIN and 4 supporting invasive carcinoma. Findings that differed across diagnostic categories were lumen-spanning neoplastic cells (P < .001), 2× benign duct diameters (P < .001), duct space contours (round, irregular, and branched) (P < .001), papillary growth (P = .048), dense cribriform or solid growth (both P = .023), and comedonecrosis (P = .015). When the 19 of 38 images that attained consensus for HGPIN or invasive carcinoma were removed from consideration, lack of IDC consensus was most often attributable to only loose cribriform growth (5/19), central nuclear maturation (5/19), or comedonecrosis (3/19). Of the 9 histologic criteria, only 1 retained significant correlation with a consensus diagnosis of IDC: the presence of solid areas (P = .038). One case that attained IDC consensus had less than 2× duct enlargement yet still had severe nuclear atypia and nucleomegaly. Six fold nuclear enlargement was not significant (P = .083), although no image had both 6× nuclei and papillary or loose cribriform growth: a combination postulated as sufficient criteria for IDC. Finally, 20.5% of respondents agreed that an isolated diagnosis of IDC on needle biopsy warrants definitive therapy, 20.5% disagreed, and 59.0% considered the decision to depend upon clinicopathologic variables. Although IDC diagnosis remains challenging, we propose these criteria: a lumen-spanning proliferation of neoplastic cells in preexisting ducts with a dense cribriform or partial solid growth pattern. Solid growth, in any part of the duct space, emerges as the most reproducible finding to rule in a diagnosis of IDC. Comedonecrosis is a rarer finding, but in most cases, it should rule in IDC. Duct space enlargement to greater than 2× the diameter of the largest, adjacent benign spaces is usually present in IDC, although there may be rare exceptions.

Variability of ascending aorta diameter measurements as assessed with electrocardiography-gated multidetector computerized tomography and computer assisted diagnosis software.

Recently, morphometric measurements of the ascending aorta have been done with ECG-gated multidector computerized tomography (MDCT) to help the development of future novel transcatheter therapies (TCT); nevertheless, the variability of such measurements remains unknown. Thirty patients referred for ECG-gated CT thoracic angiography were evaluated. Continuous reformations of the ascending aorta, perpendicular to the centerline, were obtained automatically with a commercially available computer aided diagnosis (CAD). Then measurements of the maximal diameter were done with the CAD and manually by two observers (separately). Measurements were repeated one month later. The Bland-Altman method, Spearman coefficients, and a Wilcoxon signed-rank test were used to evaluate the variability, the correlation, and the differences between observers. The interobserver variability for maximal diameter between the two observers was up to 1.2 mm with limits of agreement [-1.5, +0.9] mm; whereas the intraobserver limits were [-1.2, +1.0] mm for the first observer and [-0.8, +0.8] mm for the second observer. The intraobserver CAD variability was 0.8 mm. The correlation was good between observers and the CAD (0.980-0.986); however, significant differences do exist (P<0.001). The maximum variability observed was 1.2 mm and should be considered in reports of measurements of the ascending aorta. The CAD is as reproducible as an experienced reader.