Interobserver variability for retreatment indications after Ranibizumab loading doses in neovascular age-related macular degeneration

To assess the interobserver variability (IOV) in indicating retreatment for neovascular Age-related macular degeneration 4 weeks after three Ranibizumab loading doses using spectral domain OCT (SD-OCT) as the primary objective diagnostic tool.

Interobserver variability in assessment of cranial ultrasound in very preterm infants

Cranial ultrasound (cUS) findings help doctors in the clinical management of preterm infants and in their discussion with parents regarding prediction of outcome. cUS is often used as outcome measure in clinical research studies. Accurate cUS performance and interpretation is therefore required.

Intraobserver and interobserver agreement for results of low-field magnetic resonance imaging in dogs with and without clinical signs of disk-associated wobbler syndrome

OBJECTIVE: To determine interobserver and intraobserver agreement for results of low-field magnetic resonance imaging (MRI) in dogs with and without disk-associated wobbler syndrome (DAWS). DESIGN: Validation study. ANIMALS: 21 dogs with and 23 dogs without clinical signs of DAWS. PROCEDURES: For each dog, MRI of the cervical vertebral column was performed. The MRI studies were presented in a randomized sequence to 4 board-certified radiologists blinded to clinical status. Observers assessed degree of disk degeneration, disk-associated and dorsal compression, alterations in intraspinal signal intensity (ISI), vertebral body abnormalities, and new bone formation and categorized each study as originating from a clinically affected or clinically normal dog. Interobserver agreement was calculated for 44 initial measurements for each observer. Intraobserver agreement was calculated for 11 replicate measurements for each observer. RESULTS: There was good interobserver agreement for ratings of disk degeneration and vertebral body abnormalities and moderate interobserver agreement for ratings of disk-associated compression, dorsal compression, alterations in ISI, new bone formation, and suspected clinical status. There was very good intraobserver agreement for ratings of disk degeneration, disk-associated compression, alterations in ISI, vertebral body abnormalities, and suspected clinical status. There was good intraobserver agreement for ratings of dorsal compression and new bone formation. Two of 21 clinically affected dogs were erroneously categorized as clinically normal, and 4 of 23 clinically normal dogs were erroneously categorized as clinically affected. CONCLUSIONS AND CLINICAL RELEVANCE: Results suggested that variability exists among observers with regard to results of MRI in dogs with DAWS and that MRI could lead to false-positive and false-negative assessments.

The postoperative COFAS end-stage ankle arthritis classification system: interobserver and intraobserver reliability

End-stage ankle arthritis is operatively treated with numerous designs of total ankle replacement and different techniques for ankle fusion. For superior comparison of these procedures, outcome research requires a classification system to stratify patients appropriately. A postoperative 4-type classification system was designed by 6 fellowship-trained foot and ankle surgeons. Four surgeons reviewed blinded patient profiles and radiographs on 2 occasions to determine the interobserver and intraobserver reliability of the classification. Excellent interobserver reliability (κ = .89) and intraobserver reproducibility (κ = .87) were demonstrated for the postoperative classification system. In conclusion, the postoperative Canadian Orthopaedic Foot and Ankle Society (COFAS) end-stage ankle arthritis classification system appears to be a valid tool to evaluate the outcome of patients operated for end-stage ankle arthritis.

Intraobserver and interobserver variability of 64-row computed tomography abdominal aortic aneurysm neck measurements

BACKGROUND: Integrity of the abdominal aortic aneurysm (AAA) neck is crucial for the long-term success of endovascular AAA repair (EVAR). However, suitable tools for reliable assessment of changes in small aortic volumes are lacking. The purpose of this study was to assess the intraobserver and interobserver variability of software-enhanced 64-row computed tomographic angiography (CTA) AAA neck volume measurements in patients after EVAR. METHODS: A total of 25 consecutive patients successfully treated by EVAR underwent 64-row follow-up CTA in 1.5-mm collimation. Manual CTA measurements were performed twice by three blinded and independent readers in random order with at least a 4-week interval between readings. Maximum and minimum transverse aortic neck diameters were measured twice on two different levels within the proximal neck. Volumetry of the proximal aortic neck was performed by using dedicated software. Variability was calculated as 1.96 SD of the mean arithmetic difference according to Bland and Altman. Two-sided and paired t tests were used to compare measurements. P values <.05 were considered to indicate statistical significance. RESULTS: Intraobserver agreement was excellent for dedicated aneurysmal neck volumetry, with mean differences of less than 1 mL (P > .05), whereas it was poor for transverse aortic neck diameter measurements (P < .05). However, interobserver variability was statistically significant for both neck volumetry (P < .005) and neck diameter measurements (P < .015). CONCLUSIONS: The reliability of dedicated AAA neck volumetry by using 64-row CTA is excellent for serial measurements by individual readers, but not between different readers. Therefore, studies should be performed with aortic neck volumetry by a single experienced reader.

Sixty-four-detector CT angiography of infrarenal aortic neck length and angulation: prospective analysis of interobserver variability

PURPOSE: To quantify the interobserver variability of abdominal aortic aneurysm (AAA) neck length and angulation measurements. MATERIALS AND METHODS: A total of 25 consecutive patients scheduled for endovascular AAA repair underwent follow-up 64-row computed tomographic (CT) angiography in 0.625-mm collimation. AAA neck length and angulation were determined by four blinded, independent readers. AAA neck length was defined as the longitudinal distance between the first transverse CT slice directly distal to the lowermost renal artery and the first transverse CT slice that showed at least a 15% larger outer aortic wall diameter versus the diameter measured directly below the lowermost renal artery. Infrarenal AAA neck angulation was defined as the true angle between the longitudinal axis of the proximal AAA neck and the longitudinal axis of the AAA lumen as analyzed on three-dimensional CT reconstructions. RESULTS: Mean deviation in aortic neck length determination was 32.3% and that in aortic neck angulation was 32.1%. Interobserver variability of aortic neck length and angulation measurements was considerable: in any reader combination, at least one measurement difference was outside the predefined limits of agreement. CONCLUSIONS: Assessment of the longitudinal extension and angulation of the infrarenal aortic neck is associated with substantial observer variability, even if measurement is carried out according to a standardized protocol. Further studies are mandatory to assess dedicated technical approaches to minimize variance in the determination of the longitudinal extension and angulation of the infrarenal aortic neck.

Tumor budding in colorectal cancer revisited: results of a multicenter interobserver study.

Tumor budding in colorectal cancer (CRC) is recognized as a valuable prognostic factor but its translation into daily histopathology practice has been delayed by lack of agreement on the optimal method of assessment. Within the context of the Swiss Association of Gastrointestinal Pathology (SAGIP), we performed a multicenter interobserver study on tumor budding, comparing hematoxylin and eosin (H&E) with pan-cytokeratin staining using a 10 high power field (10HPF) and hotspot (1HPF) method. Two serial sections of 50 TNM stage II-IV surgically treated CRC were stained for H&E and pan-cytokeratin. Tumor buds were scored by independent observers at six participating centers in Switzerland and Austria using the 10HPF and 1HPF method on a digital pathology platform. Pearson correlation (r) and intra-class correlation coefficients (ICC) comparing scores between centers were calculated. Three to four times more tumor buds were detected in pan-cytokeratin compared to H&E slides. Correlation coefficients for tumor budding counts between centers ranged from r = 0.46 to r = 0.91 for H&E and from r = 0.73 to r = 0.95 for pan-cytokeratin slides. Interobserver agreement across all centers was excellent for pan-cytokeratin [10HPF: ICC = 0.83 and 1HPF: ICC = 0.8]. In contrast, assessment of tumor budding on H&E slides reached only moderate agreement [10HPF: ICC = 0.58 and 1HPF: ICC = 0.49]. Based on previous literature and our findings, we recommend (1) pan-cytokeratin staining whenever possible, (2) 10HPF method for resection specimens, and (3) 1HPF method for limited material (preoperative biopsy or pT1). Since tumor budding counts can be used to determine probabilities of relevant outcomes and as such more optimally complement clinical decision making, we advocate the avoidance of cutoff scores.

Interobserver variations of target volume delineation in multicatheter partial breast brachytherapy after open cavity surgery

PURPOSE To investigate interobserver variations of target volume delineations in accelerated partial breast irradiation with multicatheter brachytherapy (BT) and to assess the impact of guidelines on consistency of contouring. METHODS AND MATERIALS A contouring study with two phases in interstitial accelerated partial breast irradiation after open cavity surgery was conducted by the Groupe Européen de Curiethérapie-European Society for Radiotherapy and Oncology Breast Cancer Working Group. Contours of cavity and planning target volume (PTV) on preimplant and postimplant CT images were delineated. In Phase 1, nine radiation oncologists defined the target volumes of 5 patients, whereas in Phase 2, four observers draw the contours of 4 patients applying guidelines. In Phase 1, experience in breast BT after open cavity surgery was assessed. The delineations were compared between Phase 1 and Phase 2, the impact of guidelines was assessed, and cavity visualization score was related to consistency of delineations. RESULTS Significant interobserver variability in delineations of lumpectomy cavity and PTV was observed among the participants. Observers with BT experience after open cavity surgery outlined the cavity and PTV more consistently (conformity indexgen: 0.52 vs. 0.48 and 0.59 vs. 0.55 for preimplant and postimplant cavities). For all volumes, the mean Vmax/Vmin was 2.2 vs. 2.8. Having used guidelines all conformity indices increased significantly. For cavity, the increase was 14% and 11%, whereas for the PTV, 28% and 17% on the preimplant and postimplant CT images, respectively. A strong correlation was found between consistency of contours and cavity visualization score. CONCLUSIONS Simple guidelines on defining the lumpectomy cavity significantly increased the consistency of contouring. Reliable consistency of target volume definition can be expected only for good cavity visibility.

Comparison of two scoring systems for evaluation of treatment outcome in patients with complete bilateral cleft lip and palate

Objective : To compare two scoring systems: the Huddart/Bodenham system (HB system) and the Bauru-BCLP yardstick (BCLP yardstick), which classify treatment outcome in terms of dental arch relationships in patients with complete bilateral cleft lip and palate (CBCLP). The predictive value of these scoring systems for treatment outcome was also evaluated. Design : Retrospective longitudinal study. Patients : Dental arch relationships of 43 CBCLP patients were evaluated at 6, 9, and 12 years. Setting : Treatment outcome in BCLP patients using two scoring systems. Main Outcome Measures : For each age group, the HB scores were correlated with the BCLP yardstick scores using Spearman's correlation coefficient. The predictive value of the two scoring systems was evaluated by backward regression analysis. Results : Intraobserver Kappa values for the BCLP yardstick scoring for the two observers were .506 and .627, respectively, and the interobserver reliability ranged from .427 and .581. The intraobserver reliability for the HB system ranged from .92 to .97 and the interobserver reliability from .88 to .96. The BCLP yardstick scores of 6 and 9 years together were predictors for the outcome at 12 years (explained variance 41.3%). Adding the incisor and lateral HB scores in the regression model increased the explained variance to 67%. Conclusions : The BCLP yardstick and the HB system are reliable scoring systems for evaluation of dental arch relationships of CBCLP patients. The HB system categorizes treatment outcome into similar categories as the BCLP yardstick. In case a more sensitive measure of treatment outcome is needed, selectively both scoring systems should be used.

T1 assessment of hip joint cartilage following intra-articular gadolinium injection: a pilot study

This pilot study defines the feasibility of cartilage assessment in symptomatic femoroacetabular impingement patients using intra-articular delayed gadolinium-enhanced MRI of cartilage (ia-dGEMRIC). Nine patients were scanned preliminary to study the contrast infiltration process into hip joint cartilage. Twenty-seven patients with symptomatic femoroacetabular impingement were subsequently scanned with intra-articular delayed gadolinium-enhanced MRI of cartilage. These T(1) findings were correlated to morphological findings. Zonal variations were studied. This pilot study demonstrates a significant difference between the pre- and postcontrast T(1) values (P < 0.001) remaining constant for 45 min. We noted higher mean T(1) values in morphologically normal-appearing cartilage than in damaged cartilage, which was statistically significant for all zones except the anterior-superior zone. Intraobserver (0.972) and interobserver correlation coefficients (0.933) were statistically significant. This study outlines the feasibility of intra-articular delayed gadolinium-enhanced MRI of cartilage for assessment of cartilage changes in patients with femoroacetabular impingement. It can also define the topographic extent and differing severities of cartilage damage.

[Ultrasonic and radiographic quantification of palmar angulation in metacarpal IV and V neck fractures]

Therapy of metacarpal neck fractures depending on radiographically measured palmar angulation is discussed controversially in the literature. Some authors describe normal hand function of malunited metacarpal neck fractures with a palmar angulation up to 70°; others define 30° as the uppermost limit to maintain normal hand function. However, the methods of measuring palmar angulation are not clearly defined. Here, we present a new method to measure palmar angulation using ultrasound. The aim of this prospective study is to compare the radiographic methods of measuring palmar angulation with the ultrasound method. PATIENTS/MATERIAL AND METHOD: 20 patients with a neck fracture of the metacarpals IV or V were treated either conservatively or operatively. 2 weeks after trauma or operation, an x-ray was performed. 2 examiners measured the palmar angulation on the oblique and lateral projections using 2 different methods (medullary canal and dorsal cortex methods). At the same time, the 2 examiners performed measurements of palmar angulation using ultrasound. The measurements obtained with the different methods as well as by the 2 examiners at 2 different terms were compared. Intra- and interobserver reliability of each method was calculated, and for the ultrasound method a test for accuracy of the measured angles was performed.

Inter- and intraobserver reliability of predefined diagnostic levels in high-resolution sonography of the carpal tunnel syndrome - a validation study on healthy volunteers

High-resolution ultrasound is becoming increasingly important in the diagnosis of carpal tunnel syndrome (CTS). Most studies define cut-off values of the cross-sectional area (CSA) of the median nerve in different locations. The individual range of nerve swelling, the size of the nerve, and its CSA are not addressed. The aim of the study is to define the intra- and interobserver reliability of diagnostic ultrasound using two different cross-sectional areas of the median nerve at the carpal tunnel in predefined locations.

Development and validation of a paediatric long-bone fracture classification. A prospective multicentre study in 13 European paediatric trauma centres

BACKGROUND: The aim of this study was to develop a child-specific classification system for long bone fractures and to examine its reliability and validity on the basis of a prospective multicentre study. METHODS: Using the sequentially developed classification system, three samples of between 30 and 185 paediatric limb fractures from a pool of 2308 fractures documented in two multicenter studies were analysed in a blinded fashion by eight orthopaedic surgeons, on a total of 5 occasions. Intra- and interobserver reliability and accuracy were calculated. RESULTS: The reliability improved with successive simplification of the classification. The final version resulted in an overall interobserver agreement of κ = 0.71 with no significant difference between experienced and less experienced raters. CONCLUSIONS: In conclusion, the evaluation of the newly proposed classification system resulted in a reliable and routinely applicable system, for which training in its proper use may further improve the reliability. It can be recommended as a useful tool for clinical practice and offers the option for developing treatment recommendations and outcome predictions in the future.