Anthropomorphic model observer performance in three-dimensional detection task for low-contrast computed tomography.

X-ray medical imaging is increasingly becoming three-dimensional (3-D). The dose to the population and its management are of special concern in computed tomography (CT). Task-based methods with model observers to assess the dose-image quality trade-off are promising tools, but they still need to be validated for real volumetric images. The purpose of the present work is to evaluate anthropomorphic model observers in 3-D detection tasks for low-contrast CT images. We scanned a low-contrast phantom containing four types of signals at three dose levels and used two reconstruction algorithms. We implemented a multislice model observer based on the channelized Hotelling observer (msCHO) with anthropomorphic channels and investigated different internal noise methods. We found a good correlation for all tested model observers. These results suggest that the msCHO can be used as a relevant task-based method to evaluate low-contrast detection for CT and optimize scan protocols to lower dose in an efficient way.

STUDY OF THE EFFECTS OF TOTAL MODULATION TRANSFER FUNCTION CHANGES ON OBSERVER PERFORMANCE USING CLINICAL MAMMOGRAMS

The main goal of this study was to relate physical changes in image quality measured by Modulation Transfer Function (MTF) to diagnostic accuracy.^ One Hundred and Fifty Kodak Min-R screen/film combination conventional craniocaudal mammograms obtained with the Pfizer Microfocus Mammographic system were selected from the files of the Department of Radiology, at M.D. Anderson Hospital and Tumor Institute.^ The mammograms included 88 cases with a variety of benign diagnosis and 62 cases with a variety of malignant biopsy diagnosis. The average age of the patient population was 55 years old. 70 cases presented calcifications with 30 cases having calcifications smaller than 0.5mm. 46 cases presented irregular bordered masses larger than 1 cm. 30 cases presented smooth bordered masses with 20 larger than 1 cm.^ Four separated copies of the original images were made each having a different change in the MTF using a defocusing technique whereby copies of the original were obtained by light exposure through different thicknesses (spacing) of transparent film base.^ The mammograms were randomized, and evaluated by three experienced mammographers for the degree of visibility of various anatomical breast structures and pathological lesions (masses and calicifications), subjective image quality, and mammographic interpretation.^ 3,000 separate evaluations were anayzed by several statistical techniques including Receiver Operating Characteristic curve analysis, McNemar test for differences between proportions and the Landis et al. method of agreement weighted kappa for ordinal categorical data.^ Results from the statistical analysis show: (1) There were no statistical significant differences in the diagnostic accuracy of the observers when diagnosing from mammograms with the same MTF. (2) There were no statistically significant differences in diagnostic accuracy for each observer when diagnosing from mammograms with the different MTF's used in the study. (3) There statistical significant differences in detail visibility between the copies and the originals. Detail visibility was better in the originals. (4) Feature interpretations were not significantly different between the originals and the copies. (5) Perception of image quality did not affect image interpretation.^ Continuation and improvement of this research ca be accomplished by: using a case population more sensitive to MTF changes, i.e., asymptomatic women with minimum breast cancer, more observers (including less experienced radiologists and experienced technologists) must collaborate in the study, and using a minimum of 200 benign and 200 malignant cases.^

Pre-operative tractography of the facial nerve in vestibular schwannomas: inter-observer agreement with surgical findings

Pre-operative diffusion tensor (DT) tractography is currently employed in our institutions. We use it to predict the course of the facial nerve (FN) in the vicinity of vestibular schwannomas (VS) of the cerebellopontine angle (CPA). In this study we were interested to assess the inter-observer reproducibility of this method. Two Neuroradiologists (PMGP and TT) determined independently the location of the FN by tractography and compared the results with in-vivo findings of microsurgery of VS.

Lesion detection performance in an anthropomorphic chest phantom: comparative analysis of low-dose CT data on two hybrid imaging systems

Introduction: multimodality environment; requirement for greater understanding of the imaging technologies used, the limitations of these technologies, and how to best interpret the results; dose optimization; introduction of new techniques; current practice and best practice; incidental findings, in low-dose CT images obtained as part of the hybrid imaging process, are an increasing phenomenon with advancing CT technology; resultant ethical and medico-legal dilemmas; understanding limitations of these procedures important when reporting images and recommending follow-up; free-response observer performance study was used to evaluate lesion detection in low-dose CT images obtained during attenuation correction acquisitions for myocardial perfusion imaging, on two hybrid imaging systems.

Derivation of an observer model adapted to irregular signals based on convolution channels.

Anthropomorphic model observers are mathe- matical algorithms which are applied to images with the ultimate goal of predicting human signal detection and classification accuracy across varieties of backgrounds, image acquisitions and display conditions. A limitation of current channelized model observers is their inability to handle irregularly-shaped signals, which are common in clinical images, without a high number of directional channels. Here, we derive a new linear model observer based on convolution channels which we refer to as the "Filtered Channel observer" (FCO), as an extension of the channelized Hotelling observer (CHO) and the nonprewhitening with an eye filter (NPWE) observer. In analogy to the CHO, this linear model observer can take the form of a single template with an external noise term. To compare with human observers, we tested signals with irregular and asymmetrical shapes spanning the size of lesions down to those of microcalfications in 4-AFC breast tomosynthesis detection tasks, with three different contrasts for each case. Whereas humans uniformly outperformed conventional CHOs, the FCO observer outperformed humans for every signal with only one exception. Additive internal noise in the models allowed us to degrade model performance and match human performance. We could not match all the human performances with a model with a single internal noise component for all signal shape, size and contrast conditions. This suggests that either the internal noise might vary across signals or that the model cannot entirely capture the human detection strategy. However, the FCO model offers an efficient way to apprehend human observer performance for a non-symmetric signal.

A method to determine the impact of reduced visual function on nodule detection performance

Purpose - In this study we aim to validate a method to assess the impact of reduced visual function and observer performance concurrently with a nodule detection task. Materials and methods - Three consultant radiologists completed a nodule detection task under three conditions: without visual defocus (0.00 Dioptres; D), and with two different magnitudes of visual defocus (−1.00 D and −2.00 D). Defocus was applied with lenses and visual function was assessed prior to each image evaluation. Observers evaluated the same cases on each occasion; this comprised of 50 abnormal cases containing 1–4 simulated nodules (5, 8, 10 and 12 mm spherical diameter, 100 HU) placed within a phantom, and 25 normal cases (images containing no nodules). Data was collected under the free-response paradigm and analysed using Rjafroc. A difference in nodule detection performance would be considered significant at p < 0.05. Results - All observers had acceptable visual function prior to beginning the nodule detection task. Visual acuity was reduced to an unacceptable level for two observers when defocussed to −1.00 D and for one observer when defocussed to −2.00 D. Stereoacuity was unacceptable for one observer when defocussed to −2.00 D. Despite unsatisfactory visual function in the presence of defocus we were unable to find a statistically significant difference in nodule detection performance (F(2,4) = 3.55, p = 0.130). Conclusion - A method to assess visual function and observer performance is proposed. In this pilot evaluation we were unable to detect any difference in nodule detection performance when using lenses to reduce visual function.

Image quality in diagnostic radiology

This chapter provides a theoretical background about image quality in diagnostic radiology. Digital image representation and also image quality evaluation methods are here discussed. An overview of methods for quality evaluation of diagnostic imaging procedures is provided. Digital image representation and primary physical image quality parameters are also discussed, including objective image quality measurements and observer performance methods.

The influence of experience and training in a group of novice observers: a jackknife alternative free-response receiver operating characteristic analysis

Purpose - The study evaluates the pre- and post-training lesion localisation ability of a group of novice observers. Parallels are drawn with the performance of inexperienced radiographers taking part in preliminary clinical evaluation (PCE) and ‘red-dot’ systems, operating within radiography practice. Materials and methods - Thirty-four novice observers searched 92 images for simulated lesions. Pre-training and post-training evaluations were completed following the free-response the receiver operating characteristic (FROC) method. Training consisted of observer performance methodology, the characteristics of the simulated lesions and information on lesion frequency. Jackknife alternative FROC (JAFROC) and highest rating inferred ROC analyses were performed to evaluate performance difference on lesion-based and case-based decisions. The significance level of the test was set at 0.05 to control the probability of Type I error. Results - JAFROC analysis (F(3,33) = 26.34, p < 0.0001) and highest-rating inferred ROC analysis (F(3,33) = 10.65, p = 0.0026) revealed a statistically significant difference in lesion detection performance. The JAFROC figure-of-merit was 0.563 (95% CI 0.512,0.614) pre-training and 0.677 (95% CI 0.639,0.715) post-training. Highest rating inferred ROC figure-of-merit was 0.728 (95% CI 0.701,0.755) pre-training and 0.772 (95% CI 0.750,0.793) post-training. Conclusions - This study has demonstrated that novice observer performance can improve significantly. This study design may have relevance in the assessment of inexperienced radiographers taking part in PCE or commenting scheme for trauma.

Distributed active traction control system applied to the RoboCup middle size league

This work addresses the problem of traction control in mobile wheeled robots in the particular case of the RoboCup Middle Size League (MSL). The slip control problem is formulated using simple friction models for ISePorto Team robots with a differential wheel configuration. Traction was also characterized experimentally in the MSL scenario for relevant game events. This work proposes a hierarchical traction control architecture which relies in local slip detection and control at each wheel, with relevant information being relayed to a higher level responsible for global robot motion control. A dedicated one axis control embedded hardware subsystem allowing complex local control, high frequency current sensing and odometric information procession was developed. This local axis control board is integrated in a distributed system using CAN bus communications. The slipping observer was implemented in the axis control hardware nodes integrated in the ISePorto robots and was used to control and detect loss of for traction. %and to detect the ball in the kicking device. An external vision system was used to perform a qualitative analysis of the slip detection and observer performance results are presented.

Development of model observers applied to 3D breast tomosynthesis microcalcifications and masses

The development of model observers for mimicking human detection strategies has followed from symmetric signals in simple noise to increasingly complex backgrounds. In this study we implement different model observers for the complex task of detecting a signal in a 3D image stack. The backgrounds come from real breast tomosynthesis acquisitions and the signals were simulated and reconstructed within the volume. Two different tasks relevant to the early detection of breast cancer were considered: detecting an 8 mm mass and detecting a cluster of microcalcifications. The model observers were calculated using a channelized Hotelling observer (CHO) with dense difference-of-Gaussian channels, and a modified (Partial prewhitening [PPW]) observer which was adapted to realistic signals which are not circularly symmetric. The sustained temporal sensitivity function was used to filter the images before applying the spatial templates. For a frame rate of five frames per second, the only CHO that we calculated performed worse than the humans in a 4-AFC experiment. The other observers were variations of PPW and outperformed human observers in every single case. This initial frame rate was a rather low speed and the temporal filtering did not affect the results compared to a data set with no human temporal effects taken into account. We subsequently investigated two higher speeds at 5, 15 and 30 frames per second. We observed that for large masses, the two types of model observers investigated outperformed the human observers and would be suitable with the appropriate addition of internal noise. However, for microcalcifications both only the PPW observer consistently outperformed the humans. The study demonstrated the possibility of using a model observer which takes into account the temporal effects of scrolling through an image stack while being able to effectively detect a range of mass sizes and distributions.

Should 3K zoom function be used for detection of pneumothorax in cesium iodide/amorphous silicon flat-panel detector radiographs presented on 1K-matrix soft copies?

The purpose of the study was to evaluate observer performance in the detection of pneumothorax with cesium iodide and amorphous silicon flat-panel detector radiography (CsI/a-Si FDR) presented as 1K and 3K soft-copy images. Forty patients with and 40 patients without pneumothorax diagnosed on previous and subsequent digital storage phosphor radiography (SPR, gold standard) had follow-up chest radiographs with CsI/a-Si FDR. Four observers confirmed or excluded the diagnosis of pneumothorax according to a five-point scale first on the 1K soft-copy image and then with help of 3K zoom function (1K monitor). Receiver operating characteristic (ROC) analysis was performed for each modality (1K and 3K). The area under the curve (AUC) values for each observer were 0.7815, 0.7779, 0.7946 and 0.7066 with 1K-matrix soft copies and 0.8123, 0.7997, 0.8078 and 0.7522 with 3K zoom. Overall detection of pneumothorax was better with 3K zoom. Differences between the two display methods were not statistically significant in 3 of 4 observers (p-values between 0.13 and 0.44; observer 4: p = 0.02). The detection of pneumothorax with 3K zoom is better than with 1K soft copy but not at a statistically significant level. Differences between both display methods may be subtle. Still, our results indicate that 3K zoom should be employed in clinical practice.

Epidemiologic and methodological issues in serial measurements of blood pressure: The blood pressure study in Mexican children

The Blood Pressure Study in Mexican Children (BPSMC) is a short term longitudinal study of serial blood pressure collected in three observation periods by standardized examinations of 233 female children, 10 to 12 years of age, enrolled in public and private primary schools in Tlalpan, Mexico. Study objectives were: (1) to describe from baseline information the distribution and relationship of blood pressure to age and selected anthropometric factors, as well as to compare the BPSMC results with other blood pressure studies, (2) to examine the sources and amount of variation present in serial blood pressure of 123 children, and (3) to evaluate observer performance by means of intra- and inter-observer variability.^ Stepwise regression results from baseline revealed that of all anthropometric factors and age, weight was the best predictor for blood pressure.^ The results of serial blood pressure measurements show that, besides the known sources of blood pressure variability (subject, day, reading), the physiologic event of menarche has an important bearing upon the variability and characterization of blood pressure in young girls. The assessment of the effects of blood pressure variability and reliability upon the design and analysis of epidemiologic studies, became apparent among post-menarcheal girls; where blood pressure measurements taken from them have low reliability. Research is needed to propose alternatives for assessing blood pressure during puberty.^ Finally, observer performance of blood pressure and anthropometry were evaluated. Anthropometric measurements had reliabilities in excess of R = 0.96. Acceptable reliabilities (R = 0.88 to 0.95) were obtained for systolic and diastolic (phase 4 and 5) blood pressures. The BPSMC showed a 50 percent decrease in measurement error from the first to the third observation periods. ^

The process of basic training, applied training, maintaining the performance of an observer

In the field of observational methodology the observer is obviously a central figure, and close attention should be paid to the process through which he or she acquires, applies, and maintains the skills required. Basic training in how to apply the operational definitions of categories and the rules for coding, coupled with the opportunity to use the observation instrument in real-life situations, can have a positive effect in terms of the degree of agreement achieved when one evaluates intra- and inter-observer reliability. Several authors, including Arias, Argudo, & Alonso (2009) and Medina and Delgado (1999), have put forward proposals for the process of basic and applied training in this context. Reid y De Master (1982) focuses on the observer's performance and how to maintain the acquired skills, it being argued that periodic checks are needed after initial training because an observer may, over time, become less reliable due to the inherent complexity of category systems. The purpose of this subsequent training is to maintain acceptable levels of observer reliability. Various strategies can be used to this end, including providing feedback about those categories associated with a good reliability index, or offering re-training in how to apply those that yield lower indices. The aim of this study is to develop a performance-based index that is capable of assessing an observer's ability to produce reliable observations in conjunction with other observers.

Comparative study of power converter topologies and control strategies for the harmonic performance of variable-speed wind turbine generator systems

Power converters play a vital role in the integration of wind power into the electrical grid. Variable-speed wind turbine generator systems have a considerable interest of application for grid connection at constant frequency. In this paper, comprehensive simulation studies are carried out with three power converter topologies: matrix, two-level and multilevel. A fractional-order control strategy is studied for the variable-speed operation of wind turbine generator systems. The studies are in order to compare power converter topologies and control strategies. The studies reveal that the multilevel converter and the proposed fractional-order control strategy enable an improvement in the power quality, in comparison with the other power converters using a classical integer-order control strategy. (C) 2010 Elsevier Ltd. All rights reserved.

Radiologists' vs. surgeons' reading performance in non traumatic acute abdomen CTs : P32

Purpose: Emergency room reading performances have been a point of interest in recent studies comparing radiologists to other physician groups. Our objective was to evaluate and compare the reading performances of radiologists and surgeons in an emergency room setting of non-traumatic abdominal CTs. Methods and materials: A total of ten readers representing four groups participated in this study: three senior radiologists and visceral surgeons, respectively, and two junior radiologists and surgeons, respectively. Each observer blindedly evaluated a total of 150 multi-slice acute abdominal CTs. CTs were chosen representing established proportions of acute abdomen pathologies in a Level I trauma centre from 2003 to 2005. Each answer was interpretated as right or wrong regarding pathology location, diagnosis and need for operation. Gold standard was the intraoperative result, and the clinical patient follow-up for non-operated patients. Significance was assumed at a p <.05 level. Results: Senior radiologists had a mean score of 2.38 ± 1.14, junior radiologists a score of 2.34 ± 1.14, whereas senior surgeons scored 2.07 ± 1.30 and junior surgeons 1.62 ± 1.42. No significant difference was found between the two radiologist groups, but results were significantly better for senior surgeons as compared to junior surgeons and better for the two radiologist groups as compared to each of the surgeon groups (all p <.05). Conclusion: Abdominal CT reading in an acute abdomen setting should continue to rely on an evaluation by a radiologist, whether senior or junior. Satisfying reading results can be achieved by senior visceral surgeons, but junior surgeons need more experience for a good reading performance.