Development of model observers applied to 3D breast tomosynthesis microcalcifications and masses

The development of model observers for mimicking human detection strategies has followed from symmetric signals in simple noise to increasingly complex backgrounds. In this study we implement different model observers for the complex task of detecting a signal in a 3D image stack. The backgrounds come from real breast tomosynthesis acquisitions and the signals were simulated and reconstructed within the volume. Two different tasks relevant to the early detection of breast cancer were considered: detecting an 8 mm mass and detecting a cluster of microcalcifications. The model observers were calculated using a channelized Hotelling observer (CHO) with dense difference-of-Gaussian channels, and a modified (Partial prewhitening [PPW]) observer which was adapted to realistic signals which are not circularly symmetric. The sustained temporal sensitivity function was used to filter the images before applying the spatial templates. For a frame rate of five frames per second, the only CHO that we calculated performed worse than the humans in a 4-AFC experiment. The other observers were variations of PPW and outperformed human observers in every single case. This initial frame rate was a rather low speed and the temporal filtering did not affect the results compared to a data set with no human temporal effects taken into account. We subsequently investigated two higher speeds at 5, 15 and 30 frames per second. We observed that for large masses, the two types of model observers investigated outperformed the human observers and would be suitable with the appropriate addition of internal noise. However, for microcalcifications both only the PPW observer consistently outperformed the humans. The study demonstrated the possibility of using a model observer which takes into account the temporal effects of scrolling through an image stack while being able to effectively detect a range of mass sizes and distributions.

A 2D/3D image analysis system to track fluorescently labeled structures in rod-shaped cells: application to measure spindle pole asymmetry during mitosis.

BACKGROUND: The yeast Schizosaccharomyces pombe is frequently used as a model for studying the cell cycle. The cells are rod-shaped and divide by medial fission. The process of cell division, or cytokinesis, is controlled by a network of signaling proteins called the Septation Initiation Network (SIN); SIN proteins associate with the SPBs during nuclear division (mitosis). Some SIN proteins associate with both SPBs early in mitosis, and then display strongly asymmetric signal intensity at the SPBs in late mitosis, just before cytokinesis. This asymmetry is thought to be important for correct regulation of SIN signaling, and coordination of cytokinesis and mitosis. In order to study the dynamics of organelles or large protein complexes such as the spindle pole body (SPB), which have been labeled with a fluorescent protein tag in living cells, a number of the image analysis problems must be solved; the cell outline must be detected automatically, and the position and signal intensity associated with the structures of interest within the cell must be determined. RESULTS: We present a new 2D and 3D image analysis system that permits versatile and robust analysis of motile, fluorescently labeled structures in rod-shaped cells. We have designed an image analysis system that we have implemented as a user-friendly software package allowing the fast and robust image-analysis of large numbers of rod-shaped cells. We have developed new robust algorithms, which we combined with existing methodologies to facilitate fast and accurate analysis. Our software permits the detection and segmentation of rod-shaped cells in either static or dynamic (i.e. time lapse) multi-channel images. It enables tracking of two structures (for example SPBs) in two different image channels. For 2D or 3D static images, the locations of the structures are identified, and then intensity values are extracted together with several quantitative parameters, such as length, width, cell orientation, background fluorescence and the distance between the structures of interest. Furthermore, two kinds of kymographs of the tracked structures can be established, one representing the migration with respect to their relative position, the other representing their individual trajectories inside the cell. This software package, called "RodCellJ", allowed us to analyze a large number of S. pombe cells to understand the rules that govern SIN protein asymmetry. CONCLUSIONS: "RodCell" is freely available to the community as a package of several ImageJ plugins to simultaneously analyze the behavior of a large number of rod-shaped cells in an extensive manner. The integration of different image-processing techniques in a single package, as well as the development of novel algorithms does not only allow to speed up the analysis with respect to the usage of existing tools, but also accounts for higher accuracy. Its utility was demonstrated on both 2D and 3D static and dynamic images to study the septation initiation network of the yeast Schizosaccharomyces pombe. More generally, it can be used in any kind of biological context where fluorescent-protein labeled structures need to be analyzed in rod-shaped cells. AVAILABILITY: RodCellJ is freely available under http://bigwww.epfl.ch/algorithms.html, (after acceptance of the publication).

Temporal SNR characteristics in segmented 3D-EPI at 7T.

Three-dimensional segmented echo planar imaging (3D-EPI) is a promising approach for high-resolution functional magnetic resonance imaging, as it provides an increased signal-to-noise ratio (SNR) at similar temporal resolution to traditional multislice 2D-EPI readouts. Recently, the 3D-EPI technique has become more frequently used and it is important to better understand its implications for fMRI. In this study, the temporal SNR characteristics of 3D-EPI with varying numbers of segments are studied. It is shown that, in humans, the temporal variance increases with the number of segments used to form the EPI acquisition and that for segmented acquisitions, the maximum available temporal SNR is reduced compared to single shot acquisitions. This reduction with increased segmentation is not found in phantom data and thus likely due to physiological processes. When operating in the thermal noise dominated regime, fMRI experiments with a motor task revealed that the 3D variant outperforms the 2D-EPI in terms of temporal SNR and sensitivity to detect activated brain regions. Thus, the theoretical SNR advantage of a segmented 3D-EPI sequence for fMRI only exists in a low SNR situation. However, other advantages of 3D-EPI, such as the application of parallel imaging techniques in two dimensions and the low specific absorption rate requirements, may encourage the use of the 3D-EPI sequence for fMRI in situations with higher SNR.

Creación de una demo 3D mediante gráficos procedurales

Aquest projecte consisteix en el desenvolupament d’una demo 3D utilitzant exclusivament gràfics procedurals per tal d’avaluar la seva viabilitat en aplicacions més complexes com els videojocs. En aquesta aplicació es genera un terreny aleatori explorable amb vegetació i textures creades proceduralment.

Intracellular nanomanipulation by a photonic-force microscope with real-time acquisition of a 3D stiffness matrix.

A traditional photonic-force microscope (PFM) results in huge sets of data, which requires tedious numerical analysis. In this paper, we propose instead an analog signal processor to attain real-time capabilities while retaining the richness of the traditional PFM data. Our system is devoted to intracellular measurements and is fully interactive through the use of a haptic joystick. Using our specialized analog hardware along with a dedicated algorithm, we can extract the full 3D stiffness matrix of the optical trap in real time, including the off-diagonal cross-terms. Our system is also capable of simultaneously recording data for subsequent offline analysis. This allows us to check that a good correlation exists between the classical analysis of stiffness and our real-time measurements. We monitor the PFM beads using an optical microscope. The force-feedback mechanism of the haptic joystick helps us in interactively guiding the bead inside living cells and collecting information from its (possibly anisotropic) environment. The instantaneous stiffness measurements are also displayed in real time on a graphical user interface. The whole system has been built and is operational; here we present early results that confirm the consistency of the real-time measurements with offline computations.

Patient-specific computational hemodynamics of intracranial aneurysms from 3D rotational angiography and CT angiography: an in vivo reproducibility study

Patient-specific simulations of the hemodynamics in intracranial aneurysms can be constructed by using image-based vascular models and CFD techniques. This work evaluates the impact of the choice of imaging technique on these simulations

Temporal diffeomorphic free-form deformation: application to motion and strain estimation from 3D echocardiography

This paper presents a new registration algorithm, called Temporal Di eomorphic Free Form Deformation (TDFFD), and its application to motion and strain quanti cation from a sequence of 3D ultrasound (US) images. The originality of our approach resides in enforcing time consistency by representing the 4D velocity eld as the sum of continuous spatiotemporal B-Spline kernels. The spatiotemporal displacement eld is then recovered through forward Eulerian integration of the non-stationary velocity eld. The strain tensor iscomputed locally using the spatial derivatives of the reconstructed displacement eld. The energy functional considered in this paper weighs two terms: the image similarity and a regularization term. The image similarity metric is the sum of squared di erences between the intensities of each frame and a reference one. Any frame in the sequence can be chosen as reference. The regularization term is based on theincompressibility of myocardial tissue. TDFFD was compared to pairwise 3D FFD and 3D+t FFD, bothon displacement and velocity elds, on a set of synthetic 3D US images with di erent noise levels. TDFFDshowed increased robustness to noise compared to these two state-of-the-art algorithms. TDFFD also proved to be more resistant to a reduced temporal resolution when decimating this synthetic sequence. Finally, this synthetic dataset was used to determine optimal settings of the TDFFD algorithm. Subsequently, TDFFDwas applied to a database of cardiac 3D US images of the left ventricle acquired from 9 healthy volunteers and 13 patients treated by Cardiac Resynchronization Therapy (CRT). On healthy cases, uniform strain patterns were observed over all myocardial segments, as physiologically expected. On all CRT patients, theimprovement in synchrony of regional longitudinal strain correlated with CRT clinical outcome as quanti ed by the reduction of end-systolic left ventricular volume at follow-up (6 and 12 months), showing the potential of the proposed algorithm for the assessment of CRT.

Magnetization transfer-based 3D visualization of foot peripheral nerves.

PURPOSE: To investigate magnetization transfer (MT) effects as a new source of contrast for imaging and tracking of peripheral foot nerves. MATERIALS AND METHODS: Two sets of 3D spoiled gradient-echo images acquired with and without a saturation pulse were used to generate MT ratio (MTR) maps of 260 μm in-plane resolution for eight volunteers at 3T. Scan parameters were adjusted to minimize signal loss due to T2 dephasing, and a dedicated coil was used to improve the inherently low signal-to-noise ratio of small voxels. Resulting MTR values in foot nerves were compared with those in surrounding muscle tissue. RESULTS: Average MTR values for muscle (45.5 ± 1.4%) and nerve (21.4 ± 3.1%) were significantly different (P < 0.0001). In general, the difference in MTR values was sufficiently large to allow for intensity-based segmentation and tracking of foot nerves in individual subjects. This procedure was termed MT-based 3D visualization. CONCLUSION: The MTR serves as a new source of contrast for imaging of peripheral foot nerves and provides a means for high spatial resolution tracking of these structures. The proposed methodology is directly applicable on standard clinical MR scanners and could be applied to systemic pathologies, such as diabetes.

Apoyo a pantallas periféricas multiusuario: detección de presencias y gestión de la interacción

En este proyecto se han implementado dos sistemas: un sistema de gestión ytratamiento de la interacción multiusuario y un sistema de input mediante WebCam para lalocalización de usuarios, el cual se comunica con el sistema de gestión a través de XML. Se ha intentado conseguir un nivel de abstracción elevado de cara a que los futuros sistemas de interacción puedan añadir las funcionalidades implementadas para este proyecto.La idea nace de la limitación vigente de los sistemas interactivos que utilizan pantallasmultitouch ya que no existe ningún sistema que gestione a los múltiples usuarios que puedan interactuar al mismo tiempo en ellas. Se ha analizado el sistema de Vogel, en el cual se han intentado mejorar y solucionar ciertos aspectos de la interacción multiusuario.Se han diseñado e implementado dos métodos para tratar la gestión de la interacciónmultiusuario: sistema de elementos interactivos instanciables así como un sistema de cola (queue) dentro de los propios elementos interactivos. Todo ello basado en la idea de las áreasde interacción de los usuarios la cual es posible gracias al sistema de detección de presencias.Así pues, a través de este proyecto final de carrera se quiere mostrar que la interacciónmultiusuario en los sistemas interactivos periféricos puede gestionarse a través de diferentes métodos y de este modo mejorar la experiencia de los usuarios durante todo el proceso de interacción.

3D-partikkelit aloittelijoille : tarkastelussa 3D-Kalevala-projekti

Opinnäytteeni teososana on 3D-Kalevala projektinimellä tunnetun animaation partikkeliefektit. Tarkastelen tarkemmin elokuvan Lumi-, Kylä-, Paja- ja Luola-kohtauksia. 3D-Kalevala on tietokoneella tehty animaatio, joka kertoo Suomen kansalliseepoksen Kalevalan päähenkilöstä Väinämöisestä. Elokuvassa vanha Väinämöinen muistelee nuoruutensa tapahtumia. 3D-Kalevala-projekti käynnistettiin vuonna 2003, mutta sen alkuperäiset tekijät eivät saaneet sitä valmiiksi, ja projektin teko keskeytettiin vuonna 2005. Vuoden 2006 keväällä projektiin perustettiin uusi kahden verkkoviestinnän opiskelijan projektiryhmä, jonka tehtävänä oli saada elokuva valmiiksi vuoden 2007 kevääseen mennessä. Kun aloitimme projektin tekemisen, olin kolmiulotteisessa mallinnuksessa aloittelija. Tästä johtuen opinnäytteen kirjallinen osa on opas aloittelijoille partikkelien maailmaan. Selvitän raportissani miten elokuvan partikkeliefektit rakennettiin, mitä niiden tekeminen minulta vaati ja miten ne loppujen lopuksi mielestäni onnistuivat. Elokuvan efektit tehtiin 3D Studio Max-ohjelman versiolla 6.0, ja tämän takia kirjoitankin efektien rakentamisesta kyseisen ohjelman keinoin. Projektin suuruuden vuoksi molemmat tekijät pääsivät tekemään monenlaisia töitä, mutta päävastuualueet olivat selvät. Minun osani oli tehdä elokuvaan efektejä. Partikkeliefektit ovat proseduraalisia efektejä, joiden avulla on mahdollista tehdä aidon näköisiä luonnonilmiöitä, kuten tulta, savua, kipinöitä ja veden roiskeita. Koska partikkeliefektit mallintavat reaalimaailman ilmiöitä, on tekijän hyvä olla kiinnostunut selvittämään ilmiöiden käyttäytymistä luonnossa. Raportoin myös projektin aikana huomaamistani hyvistä tavoista opiskella itsenäisesti partikkelien rakentamiseen käytettyjä tekniikoita. On hyvä lukea 3D Studio Maxin tasokasta käyttöohjesovellusta, tutustua Internetissä löytyviin 3D-aiheisiin foorumeihin, käydä aiheesta tutoriaaleja läpi sekä tutustua ohjelman ominaisuuksiin kokeilemalla ja tutkimalla itsenäisesti. Elokuvan efektit onnistuivat mielestäni kiitettävästi ottaen huomioon lähtötasoni. Löysin tapoja kehittää itseäni ja helppoja keinoja toteuttaa realistista jälkeä efektien rakentamisessa. Toivon, että raportistani olisi jollekin 3D-partikkeliefekteistä kiinnostuneelle hyötyä.

Keskeytyneen uusmediatuotannon jatkaminen : kohteena 3D-Kalevala

Opinnäytetyöni aiheena on keskeytyneen uusmediatuotannon jatkaminen. Monimuototyön työosana toteutettiin 7-minuuttinen 3D animaatio, joka kertoo Suomen kansalliseepoksen Kalevalan taruhahmosta Väinämöisestä, muistelemassa menneitä. Projekti käynnistettiin alun perin vuonna 2003, mutta resurssien vähetessä se keskeytyi vuoden 2005 loppupuolella. Keväällä 2006 projekti käynnistettiin uuden projektiryhmän voimin, jossa olin itse mukana vastaten muun muassa tuotannonohjauksesta ja hahmoanimoinneista. Uusi projektiryhmä oli henkilöstöresursseiltaan pieni, joten vastuualueet olivat monipuolisia. Keskeytyneen projektin jatkamisen ja haltuunoton haasteellisuus sai minut kiinnostumaan tutkia aihetta tarkemmin. Tuotannonohjaajana vastasin hyvin pitkälle tuotannon uudesta käynnistämisestä ja projektin saattamisesta vihdoin loppuun. Keskeytyneen projektin haltuunotto oli tilanteena kaikille uusi, mikä heijastui vaikeuksina uudelleen käynnistettyyn tuotantoon. Raportin tarkoituksena ei ole olla projektinhallinnallinen käsikirja, sillä käsittelen vain tämän projektin jatkolle oleellisina pidettyjä asioita. Projekti toivottavasti kuitenkin antaa kuvan huolellisen projektinhallinnan ja onnistuneen tuotannonohjauksen tärkeydestä. Jokainen keskeytynyt projekti ei ole aina välttämättä elvytettävissä - ainakaan alkuperäisessä muodossaan. Projektin jatkamista tulisi katsoa aina tapauskohtaisesti. Keskeytymiseen on useimmiten syynsä, joten ongelmien selvittäminen ja niihin puuttuminen on tärkeää ennen jatkopäätöksen tekemistä. Myös projektityöskentelytavat kehittyvät ja pohdin työssäni uusien projektinhallintatapojen, kuten wikien käyttöä projektinhallinnan työkaluna ja projektiyhteisön välistä viestintää edistävänä työkaluna.

Comparison between standard radiography and spiral CT with 3D reconstruction in the evaluation, classification and management of tibial plateau fractures.

The aim of this study was to compare the diagnostic efficiency of plain film and spiral CT examinations with 3D reconstructions of 42 tibial plateau fractures and to assess the accuracy of these two techniques in the pre-operative surgical plan in 22 cases. Forty-two tibial plateau fractures were examined with plain film (anteroposterior, lateral, two obliques) and spiral CT with surface-shaded-display 3D reconstructions. The Swiss AO-ASIF classification system of bone fracture from Muller was used. In 22 cases the surgical plans and the sequence of reconstruction of the fragments were prospectively determined with both techniques, successively, and then correlated with the surgical reports and post-operative plain film. The fractures were underestimated with plain film in 18 of 42 cases (43%). Due to the spiral CT 3D reconstructions, and precise pre-operative information, the surgical plans based on plain film were modified and adjusted in 13 cases among 22 (59%). Spiral CT 3D reconstructions give a better and more accurate demonstration of the tibial plateau fracture and allows a more precise pre-operative surgical plan.

Ammonium alters creatine transport and synthesis in a 3D culture of developing brain cells, resulting in secondary cerebral creatine deficiency.

Hyperammonemic disorders in pediatric patients lead to poorly understood irreversible effects on the developing brain that may be life-threatening. We showed previously that some of these NH4+-induced irreversible effects might be due to impairment of axonal growth that can be protected under ammonium exposure by creatine co-treatment. The aim of the present work was thus to analyse how the genes of arginine:glycine amidinotransferase (AGAT) and guanidinoacetate methyltransferase (GAMT), allowing creatine synthesis, as well as of the creatine transporter SLC6A8, allowing creatine uptake into cells, are regulated in rat brain cells under NH4+ exposure. Reaggregated brain cell three-dimensional cultures exposed to NH4Cl were used as an experimental model of hyperammonemia in the developing central nervous system (CNS). We show here that NH4+ exposure differentially alters AGAT, GAMT and SLC6A8 regulation, in terms of both gene expression and protein activity, in a cell type-specific manner. In particular, we demonstrate that NH4+ exposure decreases both creatine and its synthesis intermediate, guanidinoacetate, in brain cells, probably through the inhibition of AGAT enzymatic activity. Our work also suggests that oligodendrocytes are major actors in the brain in terms of creatine synthesis, trafficking and uptake, which might be affected by hyperammonemia. Finally, we show that NH4+ exposure induces SLC6A8 in astrocytes. This suggests that hyperammonemia increases blood-brain barrier permeability for creatine. This is normally limited due to the absence of SLC6A8 from the astrocyte feet lining microcapillary endothelial cells, and thus creatine supplementation may protect the developing CNS of hyperammonemic patients.