63 resultados para Interobserver Agreement
em BORIS: Bern Open Repository and Information System - Berna - Suiça
Resumo:
OBJECTIVE: To determine interobserver and intraobserver agreement for results of low-field magnetic resonance imaging (MRI) in dogs with and without disk-associated wobbler syndrome (DAWS). DESIGN: Validation study. ANIMALS: 21 dogs with and 23 dogs without clinical signs of DAWS. PROCEDURES: For each dog, MRI of the cervical vertebral column was performed. The MRI studies were presented in a randomized sequence to 4 board-certified radiologists blinded to clinical status. Observers assessed degree of disk degeneration, disk-associated and dorsal compression, alterations in intraspinal signal intensity (ISI), vertebral body abnormalities, and new bone formation and categorized each study as originating from a clinically affected or clinically normal dog. Interobserver agreement was calculated for 44 initial measurements for each observer. Intraobserver agreement was calculated for 11 replicate measurements for each observer. RESULTS: There was good interobserver agreement for ratings of disk degeneration and vertebral body abnormalities and moderate interobserver agreement for ratings of disk-associated compression, dorsal compression, alterations in ISI, new bone formation, and suspected clinical status. There was very good intraobserver agreement for ratings of disk degeneration, disk-associated compression, alterations in ISI, vertebral body abnormalities, and suspected clinical status. There was good intraobserver agreement for ratings of dorsal compression and new bone formation. Two of 21 clinically affected dogs were erroneously categorized as clinically normal, and 4 of 23 clinically normal dogs were erroneously categorized as clinically affected. CONCLUSIONS AND CLINICAL RELEVANCE: Results suggested that variability exists among observers with regard to results of MRI in dogs with DAWS and that MRI could lead to false-positive and false-negative assessments.
Resumo:
The purpose of this study was to compare inter-observer agreement of Stratus™ OCT versus Spectralis™ OCT image grading in patients with neovascular age-related macular degeneration (AMD). Thirty eyes with neovascular AMD were examined with Stratus™ OCT and Spectralis™ OCT. Four different scan protocols were used for imaging. Three observers graded the images for the presence of various pathologies. Inter-observer agreement between OCT models was assessed by calculating intra-class correlation coefficients (ICC). In Stratus™ OCT highest interobserver agreement was found for subretinal fluid (ICC: 0.79), and in Spectralis™ OCT for intraretinal cysts (IRC) (ICC: 0.93). Spectralis™ OCT showed superior interobserver agreement for IRC and epiretinal membranes (ERM) (ICC(Stratus™): for IRC 0.61; for ERM 0.56; ICC(Spectralis™): for IRC 0.93; for ERM 0.84). Increased image resolution of Spectralis™ OCT did improve the inter-observer agreement for grading intraretinal cysts and epiretinal membranes but not for other retinal changes.
Resumo:
Tumor budding in colorectal cancer (CRC) is recognized as a valuable prognostic factor but its translation into daily histopathology practice has been delayed by lack of agreement on the optimal method of assessment. Within the context of the Swiss Association of Gastrointestinal Pathology (SAGIP), we performed a multicenter interobserver study on tumor budding, comparing hematoxylin and eosin (H&E) with pan-cytokeratin staining using a 10 high power field (10HPF) and hotspot (1HPF) method. Two serial sections of 50 TNM stage II-IV surgically treated CRC were stained for H&E and pan-cytokeratin. Tumor buds were scored by independent observers at six participating centers in Switzerland and Austria using the 10HPF and 1HPF method on a digital pathology platform. Pearson correlation (r) and intra-class correlation coefficients (ICC) comparing scores between centers were calculated. Three to four times more tumor buds were detected in pan-cytokeratin compared to H&E slides. Correlation coefficients for tumor budding counts between centers ranged from r = 0.46 to r = 0.91 for H&E and from r = 0.73 to r = 0.95 for pan-cytokeratin slides. Interobserver agreement across all centers was excellent for pan-cytokeratin [10HPF: ICC = 0.83 and 1HPF: ICC = 0.8]. In contrast, assessment of tumor budding on H&E slides reached only moderate agreement [10HPF: ICC = 0.58 and 1HPF: ICC = 0.49]. Based on previous literature and our findings, we recommend (1) pan-cytokeratin staining whenever possible, (2) 10HPF method for resection specimens, and (3) 1HPF method for limited material (preoperative biopsy or pT1). Since tumor budding counts can be used to determine probabilities of relevant outcomes and as such more optimally complement clinical decision making, we advocate the avoidance of cutoff scores.
Resumo:
BACKGROUND: The aim of this study was to develop a child-specific classification system for long bone fractures and to examine its reliability and validity on the basis of a prospective multicentre study. METHODS: Using the sequentially developed classification system, three samples of between 30 and 185 paediatric limb fractures from a pool of 2308 fractures documented in two multicenter studies were analysed in a blinded fashion by eight orthopaedic surgeons, on a total of 5 occasions. Intra- and interobserver reliability and accuracy were calculated. RESULTS: The reliability improved with successive simplification of the classification. The final version resulted in an overall interobserver agreement of κ = 0.71 with no significant difference between experienced and less experienced raters. CONCLUSIONS: In conclusion, the evaluation of the newly proposed classification system resulted in a reliable and routinely applicable system, for which training in its proper use may further improve the reliability. It can be recommended as a useful tool for clinical practice and offers the option for developing treatment recommendations and outcome predictions in the future.
Resumo:
Tumor budding is recognized by the World Health Organization as an additional prognostic factor in colorectal cancer but remains unreported in diagnostic work due to the absence of a standardized scoring method. This study aims to assess the most prognostic and reproducible scoring systems for tumor budding in colorectal cancer. Tumor budding on pancytokeratin-stained whole tissue sections from 105 well-characterized stage II patients was scored by 3 observers using 7 methods: Hase, Nakamura, Ueno, Wang (conventional and rapid method), densest high-power field, and 10 densest high-power fields. The predictive value for clinicopathologic features, the prognostic significance, and interobserver variability of each scoring method was analyzed. Pancytokeratin staining allowed accurate evaluation of tumor buds. Interobserver agreement for 3 observers was excellent for densest high-power field (intraclass correlation coefficient, 0.83) and 10 densest high-power fields (intraclass correlation coefficient, 0.91). Agreement was moderate to substantial for the conventional Wang method (κ = 0.46-0.62) and moderate for the rapid method (κ = 0.46-0.58). For Nakamura, moderate agreement (κ = 0.41-0.52) was reached, whereas concordance was fair to moderate for Ueno (κ = 0.39-0.56) and Hase (κ = 0.29-0.51). The Hase, Ueno, densest high-power field, and 10 densest high-power field methods identified a significant association of tumor budding with tumor border configuration. In multivariate analysis, only tumor budding as evaluated in densest high-power field and 10 densest high-power fields had significant prognostic effects on patient survival (P < .01), with high prognostic accuracy over the full 10-year follow-up. Scoring tumor buds in 10 densest high-power fields is a promising method to identify stage II patients at high risk for recurrence in daily diagnostics; it is highly reproducible, accounts for heterogeneity, and has a strong predictive value for adverse outcome.
Resumo:
Puppa G, Senore C, Sheahan K, Vieth M, Lugli A, Zlobec I, Pecori S, Wang L M, Langner C, Mitomi H, Nakamura T, Watanabe M, Ueno H, Chasle J, Conley S A, Herlin P, Lauwers G Y & Risio M (2012) Histopathology Diagnostic reproducibility of tumour budding in colorectal cancer: a multicentre, multinational study using virtual microscopy Aims: Despite the established prognostic relevance of tumour budding in colorectal cancer, the reproducibility of the methods reported for its assessment has not yet been determined, limiting its use and reporting in routine pathology practice. Methods and results: A morphometric system within telepathology was devised to evaluate the reproducibility of the various methods published for the assessment of tumour budding in colorectal cancer. Five methods were selected to evaluate the diagnostic reproducibility among 10 investigators, using haematoxylin and eosin (H&E) and AE1-3 cytokeratin-immunostained, whole-slide digital scans from 50 pT1-pT4 colorectal cancers. The overall interobserver agreement was fair for all methods, and increased to moderate for pT1 cancers. The intraobserver agreement was also fair for all methods and moderate for pT1 cancers. Agreement was dependent on the participants' experience with tumour budding reporting and performance time. Cytokeratin immunohistochemistry detected a higher percentage of tumour budding-positive cases with all methods compared to H&E-stained slides, but did not influence agreement levels. Conclusions: An overall fair level of diagnostic agreement for tumour budding in colorectal cancer was demonstrated, which was significantly higher in early cancer and among experienced gastrointestinal pathologists. Cytokeratin immunostaining facilitated detection of budding cancer cells, but did not result in improved interobserver agreement.
Resumo:
PURPOSE: To prospectively determine the accuracy of 1.5 Tesla (T) and 3 T magnetic resonance angiography (MRA) versus digital subtraction angiography (DSA) in the depiction of infrageniculate arteries in patients with symptomatic peripheral arterial disease. PATIENTS AND METHODS: A prospective 1.5 T, 3 T MRA, and DSA comparison was used to evaluate 360 vessel segments in 10 patients (15 limbs) with chronic symptomatic peripheral arterial disease. Selective DSA was performed within 30 days before both MRAs. The accuracy of 1.5 T and 3 T MRA was compared with DSA as the standard of reference by consensus agreement of 2 experienced readers. Signal-to-noise ratios (SNR) and signal-difference-to-noise ratios (SDNRs) were quantified. RESULTS: No significant difference in overall image quality, sufficiency for diagnosis, depiction of arterial anatomy, motion artifacts, and venous overlap was found comparing 1.5 T with 3 T MRA (P > 0.05 by Wilcoxon signed rank and as by Cohen k test). Overall sensitivity of 1.5 and 3 T MRA for detection of significant arterial stenosis was 79% and 82%, and specificity was 87% and 87% for both modalities, respectively. Interobserver agreement was excellent k > 0.8, P < 0.05) for 1.5 T as well as for 3 T MRA. SNR and SDNR were significantly increased using the 3 T system (average increase: 36.5%, P < 0.032 by t test, and 38.5%, P < 0.037 respectively). CONCLUSIONS: Despite marked improvement of SDNR, 3 T MRA does not yet provide a significantly higher accuracy in diagnostic imaging of atherosclerotic lesions below the knee joint as compared with 1.5 T MRA.
Resumo:
REASONS FOR PERFORMING STUDY: Although endoscopic scoring of the tracheal septum thickness is used as a diagnostic tool for evaluation of lower airway disease, its clinical relevance and reliability have never been critically assessed in the horse. OBJECTIVES: To investigate if septum thickness scores (STS) are reliable and serve as a clinically useful indicator of lower airway disease status and/or inflammation. METHODS: The variance of STS attributable to the horse, observer and changes over time was determined. The distribution of STS in a population of clinically normal horses and correlations of STS with age, gender, as well as mucus accumulation and cell differentials of tracheobronchial secretions and bronchoalveolar lavage fluid were investigated. Effects of altered pulmonary ventilation, induced by different drugs, on STS were assessed. Finally, STS of horses affected with recurrent airway obstruction (RAO) were compared to those of clinically normal horses. RESULTS: Recorded STS showed excellent intra- and satisfactory interobserver agreement Established clinical, endoscopic and cytological measures of lower airway inflammation, i.e. mucus accumulation scores and airway neutrophilia, did not correlate with STS. In horses age > or = 10 years, septum scores were significantly higher (P = 0.022) than in younger horses. Septum thickness scores did not differ significantly between clinically normal and RAO-affected horses both in exacerbation and in remission. Horses with markedly increased breathing effort (i.e. with metacholine- or lobeline hydrochloride-challenge), often differed markedly (up to 1.9 scores), but the average of end-inspiratory and end-expiratory STS did not differ from baseline STS. CONCLUSIONS AND CLINICAL RELEVANCE: Endoscopic STS are a reproducible measure, but STS did not correlate with clinical, endoscopic and cytological findings indicative of RAO or inflammatory airway disease.
Resumo:
PURPOSE: To evaluate the diagnostic accuracy of in situ postmortem multislice computed tomography (MSCT) and magnetic resonance imaging (MRI) in the detection of primary traumatic extra-axial hemorrhage. MATERIALS AND METHODS: Thirty forensic neurotrauma cases and 10 nontraumatic controls who underwent both in situ postmortem cranial MSCT and MR imaging before autopsy were retrospectively reviewed. Both imaging modalities were analyzed in view of their accuracy, sensitivity, and specificity concerning the detection of extra-axial hemorrhage. Statistical significance was calculated using the McNemar test. kappa values for interobserver agreement were calculated for extra-axial hemorrhage types and to quantify the agreement between both modalities as well as MRI, CT, and forensics, respectively. RESULTS: Analysis of the detection of hemorrhagic localizations showed an accuracy, sensitivity, and specificity of 89%, 82%, and 92% using CT, and 90%, 83%, and 94% using MRI, respectively. MRI was more sensitive than CT in the detection of subarachnoid hemorrhagic localizations (P = 0.001), whereas no significant difference resulted from the detection of epidural and subdural hemorrhagic findings (P = 0.248 and P = 0.104, respectively). Interobserver agreement for all extra-axial hemorrhage types was substantial (CT kappa = 0.76; MRI kappa = 0.77). The agreement of both modalitites was almost perfect (readers 1 and 2 kappa = 0.88). CONCLUSION: CT and MRI are of comparable potential as forensic diagnostic tools for traumatic extra-axial hemorrhage. Not only of forensic, but also of clinical interest is the observation that most thin blood layers escape the radiological evaluation.
Resumo:
This study compares MRI and MDCT for endoleak detection after endovascular repair of abdominal aortic aneurysms (EVAR). Forty-three patients with previous EVAR underwent both MRI (2D T1-FFE unenhanced and contrast-enhanced; 3D triphasic contrast-enhanced) and 16-slice MDCT (unenhanced and biphasic contrast-enhanced) within 1 week of each other for endoleak detection. MRI was performed by using a high-relaxivity contrast medium (gadobenate dimeglumine, MultiHance). Two blinded, independent observers evaluated MRI and MDCT separately. Consensus reading of MRI and MDCT studies was defined as reference standard. Sensitivity, specificity, and accuracy were calculated and Cohen's k statistics were used to estimate agreement between readers. Twenty endoleaks were detected in 18 patients at consensus reading (12 type II and 8 indeterminate endoleaks). Sensitivity, specificity, and accuracy for endoleak detection were 100%, 92%, and 96%, respectively, for reader 1 (95%, 81%, 87% for reader 2) for MRI and 55%, 100%, and 80% for reader 1 (60%, 100%, 82% for reader 2) for MDCT. Interobserver agreement was excellent for MDCT (k = 0.96) and good for MRI (k = 0.81). MRI with the use of a high-relaxivity contrast agent is significantly superior in the detection of endoleaks after EVAR compared with MDCT. MRI may therefore become the preferred technique for patient follow-up after EVAR.
Resumo:
BACKGROUND/AIM: To compare the ability of confocal scanning laser tomography (CSLT), scanning laser polarimetry (SLP) and optical coherence tomography (OCT) in recognising localised retinal nerve fibre layer (RNFL) defects. METHODS: 51 eyes from 43 patients with glaucoma were identified by two observers as having RNFL defects visible on optic disc photographs. 51 eyes of 32 normal subjects were used as controls. Three masked observers evaluated CSLT, SLP and OCT images to determine subjectively the presence of localised RNFL defects. RESULTS: Interobserver agreement was highest with OCT, followed by SLP and CSLT (mean kappa: 0.83, 0.69 and 0.64, respectively). RNFL defects were identified in 58.8% of CSLT, 66.7% of SLP and 54.9% of OCT (p = 0.02 between SLP and OCT) by at least two observers. In the controls, 94.1% of CSLT, 84.3% of SLP and 94.1% of OCT scans, respectively, were rated as normal (p = 0.02 between CSLT and SLP, and SLP and OCT). CONCLUSION: Approximately 20-40% of localised RNFL defects identified by colour optic disc photographs are not detected by CSLT, SPL or OCT. SLP showed a higher number of false-positive results than the other techniques, but also had a higher proportion of correctly identified RNFL defects in the glaucoma population.
Resumo:
PURPOSE: To prospectively assess the diagnostic accuracy of nonenhanced three-dimensional (3D) steady-state free precession (SSFP) magnetic resonance (MR) angiography for detection of renal artery stenosis (RAS), with breath-hold contrast material-enhanced MR angiography performed as the reference standard. MATERIALS AND METHODS: The study was local ethics committee approved; all patients gave written informed consent. Fifty-three patients (30 male, 23 female; mean age, 58 years) with arterial hypertension and suspected of having RAS were examined with 1.5-T 3D SSFP renal MR angiography. Stenosis grade, maximal visible vessel length, and subjective image quality were compared. Sensitivity, specificity, accuracy, and negative predictive value (NPV) were calculated on artery-by-artery and patient-by-patient bases. The significance of the results was assessed with the paired two-sided t test for continuous variables and with the marginal homogeneity test for categorical variables. Cohen kappa statistics were used to estimate interobserver agreement. RESULTS: One hundred eight renal arteries with 20 significant (>or=50%) stenoses were detected with contrast-enhanced MR angiography. At artery-by-artery analysis, sensitivity, specificity, accuracy, and NPV of nonenhanced SSFP MR angiography for RAS detection were 100%, 93%, 94%, and 100%, respectively, for observer 1 and 95%, 95%, 95%, and 99%, respectively, for observer 2. Corresponding patient-by-patient values were 100%, 92%, 94%, and 100%, respectively, for observer 1 and 100%, 95%, 96%, and 100%, respectively, for observer 2. Overestimation of stenosis grade with SSFP MR angiography resulted in six and four false-positive findings for readers 1 and 2, respectively. Mean maximal visible lengths of the renal arteries were 69.9 mm at contrast-enhanced MR angiography and 61.1 mm at SSFP MR angiography (P<.001). Both techniques yielded good to excellent image quality. CONCLUSION: Slab-selective inversion-prepared 3D SSFP MR angiography had high sensitivity, specificity, accuracy, and NPV for RAS detection, without the need for contrast material. However, RAS severity was overestimated in some patients.
Resumo:
BACKGROUND: Lymph node staging of bladder or prostate cancer using conventional imaging is limited. Newer approaches such as ultrasmall superparamagnetic particles of iron oxide (USPIO) and diffusion-weighted magnetic resonance imaging (DW-MRI) have inconsistent diagnostic accuracy and are difficult to interpret. OBJECTIVE: To assess whether combined USPIO and DW-MRI (USPIO-DW-MRI) improves staging of normal-sized lymph nodes in bladder and/or prostate cancer patients. DESIGN, SETTING, AND PARTICIPANTS: Twenty-one consecutive patients with bladder and/or prostate cancer were enrolled between May and October 2008. One patient was excluded secondary to bone metastases detected on DW-MRI with subsequent abstention from surgery. INTERVENTION: Patients preoperatively underwent 3-T MRI before and after administration of lymphotropic USPIO using conventional MRI sequences combined with DW-MRI. Surgery consisted of extended pelvic lymphadenectomy and resection of primary tumors. MEASUREMENTS: Diagnostic accuracies of the new combined USPIO-DW-MRI approach compared with the "classic" reading method evaluating USPIO images without and with DW-MRI versus histopathology were evaluated. Duration of the two reading methods was noted for each patient. RESULTS AND LIMITATIONS: Diagnostic accuracy (90% per patient or per pelvic side) was comparable for the classic and the USPIO-DW-MRI reading method, while time of analysis with 80 min (range 45-180 min) for the classic and 13 min (range 5-90 min) for the USPIO-DW-MRI method was significantly shorter (p<0.0001). Interobserver agreement (three blinded readers) was high with a kappa value of 0.75 and 0.84, respectively. Histopathological analysis showed metastases in 26 of 802 analyzed lymph nodes (3.2%). Of these, 24 nodes (92%) were correctly diagnosed as positive on USPIO-DW-MRI. In two patients, one micrometastasis each (1.0x0.2 mm; 0.7x0.4 mm) was missed in all imaging studies. CONCLUSIONS: USPIO-DW-MRI is a fast and accurate method for detecting pelvic lymph node metastases, even in normal-sized nodes of bladder or prostate cancer patients.
Resumo:
PURPOSE: To prospectively determine reproducibility of magnetic resonance (MR) angiography and MR spectroscopy of deoxymyoglobin in assessment of collateral vessels and tissue perfusion in patients with critical limb ischemia (CLI) and to follow changes in patients undergoing intramuscular vascular endothelial growth factor (pVEGF)-C gene therapy, percutaneous transluminal angioplasty, supervised exercise training, or no therapy. MATERIALS AND METHODS: Study and gene therapy protocols were approved, and all patients gave written informed consent. To determine repeatability and reproducibility, seven patients underwent MR angiography and five underwent MR spectroscopy. The techniques were used to judge disease progress in 12 other patients with or without therapy: MR angiography to help determine change in visualization of collateral vessels and MR spectroscopy to help assess change in perfusion at proximal and distal calf levels. MR angiographic results were subjectively analyzed by three blinded readers. Intraobserver variability was expressed as 95% confidence interval (CI) (n=7); interobserver variability, as kappa statistic (n=15). Reexamination variability of MR spectroscopy was given as 95% CI for subsequent recovery times, and correlation with disease extent was calculated with Kendall taub rank correlation. Fisher-Yates test was used to correlate changes with pressure measurements and clinical course. RESULTS: Intraobserver and interobserver concordance was sensitive for detection of collateral vessels. Intraobserver agreement was 85.7% (95% CI: 42.1%, 99.6%). Interobserver agreement was high for small collateral vessels (kappa=0.74, P <.001) and fair for large collateral vessels (kappa=0.36, P=.002). MR spectroscopy was reproducible (95% CI: +/-26 seconds for proximal, +/-21 seconds for distal) and showed a correlation with disease extent (proximal calf, taub=0.84, P <.001; distal calf, taub=0.68, P=.04). Small collateral vessels increased over time (P=.04) but did not correlate with pressure measurements and clinical course. Recovery time correlated with clinical course (proximal calf, P=.03; distal calf, P=.005). CONCLUSION: MR angiography and MR spectroscopy of deoxymyoglobin can help document changes in visualization of collateral vessels and tissue perfusion in patients with CLI.
Resumo:
PURPOSE: To determine if multi–detector row computed tomography (CT) can replace conventional radiography and be performed alone in severe trauma patients for the depiction of thoracolumbar spine fractures. MATERIALS AND METHODS: One hundred consecutive severe trauma patients who underwent conventional radiography of the thoracolumbar spine as well as thoracoabdominal multi–detector row CT were prospectively identified. Conventional radiographs were reviewed independently by three radiologists and two orthopedic surgeons; CT images were reviewed by three radiologists. Reviewers were blinded both to one another’s reviews and to the results of initial evaluation. Presence, location, and stability of fractures, as well as quality of reviewed images, were assessed. Statistical analysis was performed to determine sensitivity and interobserver agreement for each procedure, with results of clinical and radiologic follow-up as the standard of reference. The time to perform each examination and the radiation dose involved were evaluated. A resource cost analysis was performed. RESULTS: Sixty-seven fractured vertebrae were diagnosed in 26 patients. Twelve patients had unstable spine fractures. Mean sensitivity and interobserver agreement, respectively, for detection of unstable fractures were 97.2% and 0.951 for multi–detector row CT and 33.3% and 0.368 for conventional radiography. The median times to perform a conventional radiographic and a multi–detector row CT examination, respectively, were 33 and 40 minutes. Effective radiation doses at conventional radiography of the spine and thoracoabdominal multi–detector row CT, respectively, were 6.36 mSv and 19.42 mSv. Multi–detector row CT enabled identification of 146 associated traumatic lesions. The costs of conventional radiography and multi–detector row CT, respectively, were $145 and $880 per patient. CONCLUSION: Multi–detector row CT is a better examination for depicting spine fractures than conventional radiography. It can replace conventional radiography and be performed alone in patients who have sustained severe trauma.