How reliable is the monitoring of permanent vegetation plots? A test with multiple observers

Questions: A multiple plot design was developed for permanent vegetation plots. How reliable are the different methods used in this design and which changes can we measure? Location: Alpine meadows (2430 m a.s.l.) in the Swiss Alps. Methods: Four inventories were obtained from 40 m(2) plots: four subplots (0.4 m(2)) with a list of species, two 10m transects with the point method (50 points on each), one subplot (4 m2) with a list of species and visual cover estimates as a percentage and the complete plot (40 m(2)) with a list of species and visual estimates in classes. This design was tested by five to seven experienced botanists in three plots. Results: Whatever the sampling size, only 45-63% of the species were seen by all the observers. However, the majority of the overlooked species had cover < 0.1%. Pairs of observers overlooked 10-20% less species than single observers. The point method was the best method for cover estimate, but it took much longer than visual cover estimates, and 100 points allowed for the monitoring of only a very limited number of species. The visual estimate as a percentage was more precise than classes. Working in pairs did not improve the estimates, but one botanist repeating the survey is more reliable than a succession of different observers. Conclusion: Lists of species are insufficient for monitoring. It is necessary to add cover estimates to allow for subsequent interpretations in spite of the overlooked species. The choice of the method depends on the available resources: the point method is time consuming but gives precise data for a limited number of species, while visual estimates are quick but allow for recording only large changes in cover. Constant pairs of observers improve the reliability of the records.

The cognitive errors and coping patterns of child molesters as assessed by external observers: a pilot study

Cognitive errors (CE) and coping strategies (CS) are the focus of most cognitive-behavioral treatments for incarcerated child molesters. Several studies have reported differences in CEs and CSs between child molesters and controls. However, the vast majority of these studies assessed cognitive errors and coping using questionnaires, which are known to present a number of important limitations. This pilot study aimed to compare the CEs and CSs of N = 17 incarcerated child abusers and N = 12 controls using observer-rated methods, namely the Cognitive Error Rating Scale (CERS; Drapeau et al., 2005) and the Coping Action Pattern Rating Scale (CAPRS; Perry, Drapeau, & Dunkley, 2005). Results showed that child molesters presented more cognitive errors, in particular positive selective abstraction, and lower coping functioning, such as escape strategies. Treatment and research implications, including the use of observer-rated methods, are discussed.

Biased thinking assessed by external observers in borderline personality disorder

Objectives. Biased thinking (to some extent overlapping with the concepts of cognitive distortions and cognitive errors) is a key concept in cognitive therapy of Borderline Personality Disorder (BPD). Specific contents and cognitive processes related to BPD functioning are known. However, most studies are based on self-report measures which present a number of important limitations, in particular the difficulty in assessing non-conscious processes infused by affect. So far, no studies were conducted using valid observer-rated methodology addressing the question of biased thinking in BPD as it unfolds spontaneously in session. Design. This is a controlled interview study comparing two matched groups, BPD patients and healthy controls. Methods. A total of N= 25 clinical dynamic interviews with patients presenting with BPD were transcribed and rated using the Cognitive Errors Rating Scale (Drapeau, Perry, & Dunkley, 2008); their cognitive profiles were compared to those of N= 25 healthy controls who underwent the same procedure. Results. Overall, results indicated that no between-group difference in the frequency of specific biases was found. However, heightened levels of negative cognitive biases, in particular over-generalizing and fortune-telling, were associated with BPD. Furthermore, negative over-generalizing was associated with the number of BPD symptoms. Conclusions. These results have high levels of ecological validity and are promising for the refinement of cognitive theory of BPD. Clinical implications for assessment and intervention are discussed.

Mass detection on mammograms: influence of signal shape uncertainty on human and model observers.

We studied the influence of signal variability on human and model observers for detection tasks with realistic simulated masses superimposed on real patient mammographic backgrounds and synthesized mammographic backgrounds (clustered lumpy backgrounds, CLB). Results under the signal-known-exactly (SKE) paradigm were compared with signal-known-statistically (SKS) tasks for which the observers did not have prior knowledge of the shape or size of the signal. Human observers' performance did not vary significantly when benign masses were superimposed on real images or on CLB. Uncertainty and variability in signal shape did not degrade human performance significantly compared with the SKE task, while variability in signal size did. Implementation of appropriate internal noise components allowed the fit of model observers to human performance.

Development of model observers applied to 3D breast tomosynthesis microcalcifications and masses

The development of model observers for mimicking human detection strategies has followed from symmetric signals in simple noise to increasingly complex backgrounds. In this study we implement different model observers for the complex task of detecting a signal in a 3D image stack. The backgrounds come from real breast tomosynthesis acquisitions and the signals were simulated and reconstructed within the volume. Two different tasks relevant to the early detection of breast cancer were considered: detecting an 8 mm mass and detecting a cluster of microcalcifications. The model observers were calculated using a channelized Hotelling observer (CHO) with dense difference-of-Gaussian channels, and a modified (Partial prewhitening [PPW]) observer which was adapted to realistic signals which are not circularly symmetric. The sustained temporal sensitivity function was used to filter the images before applying the spatial templates. For a frame rate of five frames per second, the only CHO that we calculated performed worse than the humans in a 4-AFC experiment. The other observers were variations of PPW and outperformed human observers in every single case. This initial frame rate was a rather low speed and the temporal filtering did not affect the results compared to a data set with no human temporal effects taken into account. We subsequently investigated two higher speeds at 5, 15 and 30 frames per second. We observed that for large masses, the two types of model observers investigated outperformed the human observers and would be suitable with the appropriate addition of internal noise. However, for microcalcifications both only the PPW observer consistently outperformed the humans. The study demonstrated the possibility of using a model observer which takes into account the temporal effects of scrolling through an image stack while being able to effectively detect a range of mass sizes and distributions.

Diagnostic value of MRI for the detection of suspected placental invasion: Does it depend on observers' experience?

Purpose: To evaluate the diagnostic value of specific MR features for detection of suspected placental invasion according to observers' experience.Methods and Materials: Our study population included 25 pregnant women (mean age 35.16) investigated by prenatal MRI. In twelve out of them placental invasion was histopathologically proven, the 13 other women (52%) without placental invasion served as control group. Multiplanar T1- and T2-weighted sequences had been performed mostly without IV contrast injection (1.5 T). MR examinations of the two groups were rendered anonymous, mixed, then independently and retrospectively reviewed by two senior and two junior radiologists in view of 8 MR features indicating placentar invasion including the degree. Results were compared with surgical diagnosis (placenta normal/increta/accreta/percreta). Interobserver agrement between senior and junior readers were calculated. Stepwise logistic regression and receiver operating (ROC) curvers were performed.Results: Demographics between the two groups were not statistically different. Overall sensitivity and specificity for detecting placentar invasion was 90.9% and 75.0% for senior readers, and 81.8% and 61.8% for junior readers respectively. The most significant MR features indicating placentar invasion were T2 hypointense placental bands, followed by placenta praevia, focally interrupted myometrial border, posterior placental insertion, and heterogeneous placental signal. For each of the evaluated MR features the interobserver agreement kappa between the two senior readers was superior than that between the junior readers, ranging from bad (<0.4) to good (0.4-0.75).Conclusions: MRI can be a reliable and reproducible tool for detection of suspected placentar invasion, however very variable according to the observers' experience.

Image quality in CT: From physical measurements to model observers.

Evaluation of image quality (IQ) in Computed Tomography (CT) is important to ensure that diagnostic questions are correctly answered, whilst keeping radiation dose to the patient as low as is reasonably possible. The assessment of individual aspects of IQ is already a key component of routine quality control of medical x-ray devices. These values together with standard dose indicators can be used to give rise to 'figures of merit' (FOM) to characterise the dose efficiency of the CT scanners operating in certain modes. The demand for clinically relevant IQ characterisation has naturally increased with the development of CT technology (detectors efficiency, image reconstruction and processing), resulting in the adaptation and evolution of assessment methods. The purpose of this review is to present the spectrum of various methods that have been used to characterise image quality in CT: from objective measurements of physical parameters to clinically task-based approaches (i.e. model observer (MO) approach) including pure human observer approach. When combined together with a dose indicator, a generalised dose efficiency index can be explored in a framework of system and patient dose optimisation. We will focus on the IQ methodologies that are required for dealing with standard reconstruction, but also for iterative reconstruction algorithms. With this concept the previously used FOM will be presented with a proposal to update them in order to make them relevant and up to date with technological progress. The MO that objectively assesses IQ for clinically relevant tasks represents the most promising method in terms of radiologist sensitivity performance and therefore of most relevance in the clinical environment.

Iterative reconstruction in CT : using mathematical model observers to determine low dose images' trustworthiness

La tomodensitométrie (TDM) est une technique d'imagerie pour laquelle l'intérêt n'a cessé de croitre depuis son apparition au début des années 70. De nos jours, l'utilisation de cette technique est devenue incontournable, grâce entre autres à sa capacité à produire des images diagnostiques de haute qualité. Toutefois, et en dépit d'un bénéfice indiscutable sur la prise en charge des patients, l'augmentation importante du nombre d'examens TDM pratiqués soulève des questions sur l'effet potentiellement dangereux des rayonnements ionisants sur la population. Parmi ces effets néfastes, l'induction de cancers liés à l'exposition aux rayonnements ionisants reste l'un des risques majeurs. Afin que le rapport bénéfice-risques reste favorable au patient il est donc nécessaire de s'assurer que la dose délivrée permette de formuler le bon diagnostic tout en évitant d'avoir recours à des images dont la qualité est inutilement élevée. Ce processus d'optimisation, qui est une préoccupation importante pour les patients adultes, doit même devenir une priorité lorsque l'on examine des enfants ou des adolescents, en particulier lors d'études de suivi requérant plusieurs examens tout au long de leur vie. Enfants et jeunes adultes sont en effet beaucoup plus sensibles aux radiations du fait de leur métabolisme plus rapide que celui des adultes. De plus, les probabilités des évènements auxquels ils s'exposent sont également plus grandes du fait de leur plus longue espérance de vie. L'introduction des algorithmes de reconstruction itératifs, conçus pour réduire l'exposition des patients, est certainement l'une des plus grandes avancées en TDM, mais elle s'accompagne de certaines difficultés en ce qui concerne l'évaluation de la qualité des images produites. Le but de ce travail est de mettre en place une stratégie pour investiguer le potentiel des algorithmes itératifs vis-à-vis de la réduction de dose sans pour autant compromettre la qualité du diagnostic. La difficulté de cette tâche réside principalement dans le fait de disposer d'une méthode visant à évaluer la qualité d'image de façon pertinente d'un point de vue clinique. La première étape a consisté à caractériser la qualité d'image lors d'examen musculo-squelettique. Ce travail a été réalisé en étroite collaboration avec des radiologues pour s'assurer un choix pertinent de critères de qualité d'image. Une attention particulière a été portée au bruit et à la résolution des images reconstruites à l'aide d'algorithmes itératifs. L'analyse de ces paramètres a permis aux radiologues d'adapter leurs protocoles grâce à une possible estimation de la perte de qualité d'image liée à la réduction de dose. Notre travail nous a également permis d'investiguer la diminution de la détectabilité à bas contraste associée à une diminution de la dose ; difficulté majeure lorsque l'on pratique un examen dans la région abdominale. Sachant que des alternatives à la façon standard de caractériser la qualité d'image (métriques de l'espace Fourier) devaient être utilisées, nous nous sommes appuyés sur l'utilisation de modèles d'observateurs mathématiques. Nos paramètres expérimentaux ont ensuite permis de déterminer le type de modèle à utiliser. Les modèles idéaux ont été utilisés pour caractériser la qualité d'image lorsque des paramètres purement physiques concernant la détectabilité du signal devaient être estimés alors que les modèles anthropomorphes ont été utilisés dans des contextes cliniques où les résultats devaient être comparés à ceux d'observateurs humain, tirant profit des propriétés de ce type de modèles. Cette étude a confirmé que l'utilisation de modèles d'observateurs permettait d'évaluer la qualité d'image en utilisant une approche basée sur la tâche à effectuer, permettant ainsi d'établir un lien entre les physiciens médicaux et les radiologues. Nous avons également montré que les reconstructions itératives ont le potentiel de réduire la dose sans altérer la qualité du diagnostic. Parmi les différentes reconstructions itératives, celles de type « model-based » sont celles qui offrent le plus grand potentiel d'optimisation, puisque les images produites grâce à cette modalité conduisent à un diagnostic exact même lors d'acquisitions à très basse dose. Ce travail a également permis de clarifier le rôle du physicien médical en TDM: Les métriques standards restent utiles pour évaluer la conformité d'un appareil aux requis légaux, mais l'utilisation de modèles d'observateurs est inévitable pour optimiser les protocoles d'imagerie. -- Computed tomography (CT) is an imaging technique in which interest has been quickly growing since it began to be used in the 1970s. Today, it has become an extensively used modality because of its ability to produce accurate diagnostic images. However, even if a direct benefit to patient healthcare is attributed to CT, the dramatic increase in the number of CT examinations performed has raised concerns about the potential negative effects of ionising radiation on the population. Among those negative effects, one of the major risks remaining is the development of cancers associated with exposure to diagnostic X-ray procedures. In order to ensure that the benefits-risk ratio still remains in favour of the patient, it is necessary to make sure that the delivered dose leads to the proper diagnosis without producing unnecessarily high-quality images. This optimisation scheme is already an important concern for adult patients, but it must become an even greater priority when examinations are performed on children or young adults, in particular with follow-up studies which require several CT procedures over the patient's life. Indeed, children and young adults are more sensitive to radiation due to their faster metabolism. In addition, harmful consequences have a higher probability to occur because of a younger patient's longer life expectancy. The recent introduction of iterative reconstruction algorithms, which were designed to substantially reduce dose, is certainly a major achievement in CT evolution, but it has also created difficulties in the quality assessment of the images produced using those algorithms. The goal of the present work was to propose a strategy to investigate the potential of iterative reconstructions to reduce dose without compromising the ability to answer the diagnostic questions. The major difficulty entails disposing a clinically relevant way to estimate image quality. To ensure the choice of pertinent image quality criteria this work was continuously performed in close collaboration with radiologists. The work began by tackling the way to characterise image quality when dealing with musculo-skeletal examinations. We focused, in particular, on image noise and spatial resolution behaviours when iterative image reconstruction was used. The analyses of the physical parameters allowed radiologists to adapt their image acquisition and reconstruction protocols while knowing what loss of image quality to expect. This work also dealt with the loss of low-contrast detectability associated with dose reduction, something which is a major concern when dealing with patient dose reduction in abdominal investigations. Knowing that alternative ways had to be used to assess image quality rather than classical Fourier-space metrics, we focused on the use of mathematical model observers. Our experimental parameters determined the type of model to use. Ideal model observers were applied to characterise image quality when purely objective results about the signal detectability were researched, whereas anthropomorphic model observers were used in a more clinical context, when the results had to be compared with the eye of a radiologist thus taking advantage of their incorporation of human visual system elements. This work confirmed that the use of model observers makes it possible to assess image quality using a task-based approach, which, in turn, establishes a bridge between medical physicists and radiologists. It also demonstrated that statistical iterative reconstructions have the potential to reduce the delivered dose without impairing the quality of the diagnosis. Among the different types of iterative reconstructions, model-based ones offer the greatest potential, since images produced using this modality can still lead to an accurate diagnosis even when acquired at very low dose. This work has clarified the role of medical physicists when dealing with CT imaging. The use of the standard metrics used in the field of CT imaging remains quite important when dealing with the assessment of unit compliance to legal requirements, but the use of a model observer is the way to go when dealing with the optimisation of the imaging protocols.

Intraobserver and interobserver variability of ascending aorta diameter measurements as assessed by ECG-gated MDCT : automatic versus manual measurements : P15

Purpose: Revolutionary endovascular treatments are on the verge of being available for management of ascending aortic diseases. Morphometric measurements of the ascending aorta have already been done with ECG-gated MDCT to help such therapeutic development. However the reliability of these measurements remains unknown. The objective of this work was to compare the intraobserver and interobserver variability of CAD (computer aided diagnosis) versus manual measurements in the ascending aorta. Methods and materials: Twenty-six consecutive patients referred for ECG-gated CT thoracic angiography (64-row CT scanner) were evaluated. Measurements of the maximum and minimum ascending aorta diameters at mid-distance between the brachiocephalic artery and the aortic valve were obtained automatically with a commercially available CAD and manually by two observers separately. Both observers repeated the measurements during a different session at least one month after the first measurements. Intraclass coefficients as well the Bland and Altman method were used for comparison between measurements. Two-paired t-test was used to determine the significance of intraobserver and interobserver differences (alpha = 0.05). Results: There is a significant difference between CAD and manual measurements in the maximum diameter (p = 0.004) for the first observer, whereas the difference was significant for minimum diameter between the second observer and the CAD (p <0.001). Interobserver variability showed a weak agreement when measurements were done manually. Intraobserver variability was lower with the CAD compared to the manual measurements (limits of variability: from -0.7 to 0.9 mm for the former and from -1.2 to 1.3 mm for the latter). Conclusion: In order to improve reproductibility of measurements whenever needed, pre- and post-therapeutic management of the ascending aorta may benefit from follow-up done by a unique observer with the help of CAD.

Binding under Conflict Conditions: State-Space Analysis of Multivariate EEG Synchronization.

Real-world objects are often endowed with features that violate Gestalt principles. In our experiment, we examined the neural correlates of binding under conflict conditions in terms of the binding-by-synchronization hypothesis. We presented an ambiguous stimulus ("diamond illusion") to 12 observers. The display consisted of four oblique gratings drifting within circular apertures. Its interpretation fluctuates between bound ("diamond") and unbound (component gratings) percepts. To model a situation in which Gestalt-driven analysis contradicts the perceptually explicit bound interpretation, we modified the original diamond (OD) stimulus by speeding up one grating. Using OD and modified diamond (MD) stimuli, we managed to dissociate the neural correlates of Gestalt-related (OD vs. MD) and perception-related (bound vs. unbound) factors. Their interaction was expected to reveal the neural networks synchronized specifically in the conflict situation. The synchronization topography of EEG was analyzed with the multivariate S-estimator technique. We found that good Gestalt (OD vs. MD) was associated with a higher posterior synchronization in the beta-gamma band. The effect of perception manifested itself as reciprocal modulations over the posterior and anterior regions (theta/beta-gamma bands). Specifically, higher posterior and lower anterior synchronization supported the bound percept, and the opposite was true for the unbound percept. The interaction showed that binding under challenging perceptual conditions is sustained by enhanced parietal synchronization. We argue that this distributed pattern of synchronization relates to the processes of multistage integration ranging from early grouping operations in the visual areas to maintaining representations in the frontal networks of sensory memory.

Choledocholithiasis: repetitive thick-slab single-shot projection magnetic resonance cholangiopancreaticography versus endoscopic ultrasonography.

This prospective study compares repetitive thick-slab single-shot projection magnetic resonance cholangiopancreatography (MRCP) with endoscopic ultrasonography (EUS) for the detection of choledocholithiasis. Fifty-seven consecutive patients (36 women, mean age 61) referred for suspected choledocholithiasis underwent MRCP, followed by EUS. Each procedure was performed by different operators blinded to the results of the other investigation. MR technique included a turbo spin-echo T2-weighted axial sequence with selective fat saturation (SPIR/TSE, TE=70 ms, TR=1,600 ms), followed by coronal dynamic MRCP. The same thick-slab slice was sequentially acquired 12 times as breath-hold single-shot projection imaging (SSh, TE=900 ms, TE=8,000 ms) centred on the common bile duct (CBD). Two experienced radiologists independently and blindly evaluated MR images for the detection of CBD stones. Their inter-observer agreement kappa was determined. Secondly, the two observers read MR images in consensus again. CBD stones were demonstrated in 18 out of 57 patients (31.6 %) and confirmed by endoscopic retrograde cholangiography (ERCP, n=17) or intraoperative cholangiography (n=1). Clinical follow-up served as the "gold standard" in patients with negative results without following invasive procedure (n=28). Sensitivity, specificity, accuracy, positive and negative predictive value for MRCP resulting from consensus reading were 94.9%, 94.4%, 94.7%, 97.4% and 89.5%, respectively. Corresponding values of EUS were 97.4%, 94.4%, 96.5%, 97.4% and 94.4%. Inter-observer agreement kappa was 0.81. Repetitive thick-slab single-shot projection MRCP is an accurate non-invasive imaging modality for suspected choledocholithiasis and should be increasingly used to select those patients who require a subsequent therapeutic procedure, namely ERCP.

Direct magnetic resonance arthrography of the wrist with axial traction: A feasibility study to assess joint cartilage.

PURPOSE: To assess the impact of axial traction during acquisition of direct magnetic resonance (MR) arthrography of the wrist with regard to joint space width and amount of contrast material between the opposing cartilage surfaces. MATERIALS AND METHODS: Fifteen consecutive patients (12 male, mean age 38.1 years) were included in this Institutional Review Board-approved prospective study. Three-compartment wrist MR arthrographies were performed between October and December 2009 on a 3 T unit using a fat-suppressed T1-weighted isotropic high-resolution volumetric interpolated breathhold examination (VIBE) sequence in the coronal plane, with and without axial traction (3 kg). Two radiologists measured radiocarpal (radioscaphoid, radiolunate) and midcarpal (lunocapitate, hamatolunate) joint space widths, with and without traction, and assessed the amount of contrast material between the opposing cartilage surfaces using a three-point scale: 0 = absence, 1 = partial, 2 = complete. RESULTS: With traction, joint space width increased significantly at the radioscaphoid (Delta = 0.78 mm, P < 0.01), radiolunate (Delta = 0.18 mm, P < 0.01), and lunocapitate (Delta = 0.45 mm, P < 0.01) spaces, and both observers detected significantly more contrast material between the cartilage surfaces. At the hamatolunate space, the differences in joint space width (Delta = 0.14 mm, P = 0.54) and amount of contrast material were not significant. CONCLUSION: Direct wrist MR arthrography with axial traction of 3 kg increases joint space width at the radiocarpal and lunocapitate spaces, and prompts better coverage of the articular cartilage by the contrast material. J. Magn. Reson. Imaging 2011;. (c) 2011 Wiley-Liss, Inc.

Pedicle screw insertion: robotic assistance versus conventional C-arm fluoroscopy.

Bone-mounted robotic guidance for pedicle screw placement has been recently introduced, aiming at increasing accuracy. The aim of this prospective study was to compare this novel approach with the conventional fluoroscopy assisted freehand technique (not the two- or three-dimensional fluoroscopy-based navigation). Two groups were compared: 11 patients, constituting the robotical group, were instrumented with 64 pedicle screws; 23 other patients, constituting the fluoroscopic group, were also instrumented with 64 pedicle screws. Screw position was assessed by two independent observers on postoperative CT-scans using the Rampersaud A to D classification. No neurological complications were noted. Grade A (totally within pedicle margins) accounted for 79% of the screws in the robotically assisted and for 83% of the screws in the fluoroscopic group respectively (p = 0.8). Grade C and D screws, considered as misplacements, accounted for 4.7% of all robotically inserted screws and 7.8% of the fluoroscopically inserted screws (p = 0.71). The current study did not allow to state that robotically assisted screw placement supersedes the conventional fluoroscopy assisted technique, although the literature is more optimistic about the former.