Fully automatic X-ray image segmentation via joint estimation of image displacements.

We propose a new method for fully-automatic landmark detection and shape segmentation in X-ray images. Our algorithm works by estimating the displacements from image patches to the (unknown) landmark positions and then integrating them via voting. The fundamental contribution is that, we jointly estimate the displacements from all patches to multiple landmarks together, by considering not only the training data but also geometric constraints on the test image. The various constraints constitute a convex objective function that can be solved efficiently. Validated on three challenging datasets, our method achieves high accuracy in landmark detection, and, combined with statistical shape model, gives a better performance in shape segmentation compared to the state-of-the-art methods.

A new approach to detect structural differences in lung parenchyma using digital image analysis

Morphometric investigations using a point and intersection counting strategy in the lung often are not able to reveal the full set of morphologic changes. This happens particularly when structural modifications are not expressed in terms of volume density changes and when rough and fine surface density alterations cancel each other at different magnifications. Making use of digital image processing, we present a methodological approach that allows to easily and quickly quantify changes of the geometrical properties of the parenchymal lung structure and reflects closely the visual appreciation of the changes. Randomly sampled digital images from light microscopic sections of lung parenchyma are filtered, binarized, and skeletonized. The lung septa are thus represented as a single-pixel wide line network with nodal points and end points and the corresponding internodal and end segments. By automatically counting the number of points and measuring the lengths of the skeletal segments, the lung architecture can be characterized and very subtle structural changes can be detected. This new methodological approach to lung structure analysis is highly sensitive to morphological changes in the parenchyma: it detected highly significant quantitative alterations in the structure of lungs of rats treated with a glucocorticoid hormone, where the classical morphometry had partly failed.

Sustained attention in children with two etiologies of early hydrocephalus.

Several studies have shown that children with spina bifida meningomyelocele (SBM) and hydrocephalus have attention problems on parent ratings and difficulties in stimulus orienting associated with a posterior brain attention system. Less is known about response control and inhibition associated with an anterior brain attention system. Using the Gordon Vigilance Task (Gordon, 1983), we studied error rate, reaction time, and performance over time for sustained attention, a key anterior attention function, in 101 children with SBM, 17 with aqueductal stenosis (AS; another condition involving congenital hydrocephalus), and 40 typically developing controls (NC). In SBM, we investigated the relation between cognitive attention and parent ratings of inattention and hyperactivity and explored the impact of medical variables. Children with SBM did not differ from AS or NC groups on measures of sustained attention, but they committed more errors and responded more slowly. Approximately one-third of the SBM group had attention symptoms, although parent attention ratings were not associated with task performance. Hydrocephalus does not account for the attention profile of children with SBM, which also reflects the distinctive brain dysmorphologies associated with this condition.

Thoracic radiotherapy treatment planning with cine PET/CT

Purpose: Respiratory motion causes substantial uncertainty in radiotherapy treatment planning. Four-dimensional computed tomography (4D-CT) is a useful tool to image tumor motion during normal respiration. Treatment margins can be reduced by targeting the motion path of the tumor. The expense and complexity of 4D-CT, however, may be cost-prohibitive at some facilities. We developed an image processing technique to produce images from cine CT that contain significant motion information without 4D-CT. The purpose of this work was to compare cine CT and 4D-CT for the purposes of target delineation and dose calculation, and to explore the role of PET in target delineation of lung cancer. Methods: To determine whether cine CT could substitute 4D-CT for small mobile lung tumors, we compared target volumes delineated by a physician on cine CT and 4D-CT for 27 tumors with intrafractional motion greater than 1 cm. We assessed dose calculation by comparing dose distributions calculated on respiratory-averaged cine CT and respiratory-averaged 4D-CT using the gamma index. A threshold-based PET segmentation model of size, motion, and source-to-background was developed from phantom scans and validated with 24 lung tumors. Finally, feasibility of integrating cine CT and PET for contouring was assessed on a small group of larger tumors. Results: Cine CT to 4D-CT target volume ratios were (1.05±0.14) and (0.97±0.13) for high-contrast and low-contrast tumors respectively which was within intraobserver variation. Dose distributions on cine CT produced good agreement (< 2%/1 mm) with 4D-CT for 71 of 73 patients. The segmentation model fit the phantom data with R2 = 0.96 and produced PET target volumes that matched CT better than 6 published methods (-5.15%). Application of the model to more complex tumors produced mixed results and further research is necessary to adequately integrate PET and cine CT for delineation. Conclusions: Cine CT can be used for target delineation of small mobile lesions with minimal differences to 4D-CT. PET, utilizing the segmentation model, can provide additional contrast. Additional research is required to assess the efficacy of complex tumor delineation with cine CT and PET. Respiratory-averaged cine CT can substitute respiratory-averaged 4D-CT for dose calculation with negligible differences.

Diffusion tensor imaging of cocaine-treated rodents.

Studies in cocaine-dependent human subjects have shown differences in white matter on diffusion tensor imaging (DTI) compared with non-drug-using controls. It is not known whether the differences in fractional anisotropy (FA) seen on DTI in white matter regions of cocaine-dependent humans result from a pre-existing predilection for drug use or purely from cocaine abuse. To study the effect of cocaine on brain white matter, DTI was performed on 24 rats after continuous infusion of cocaine or saline for 4 weeks, followed by brain histology. Voxel-based morphometry analysis showed an 18% FA decrease in the splenium of the corpus callosum (CC) in cocaine-treated animals relative to saline controls. On histology, significant increase in neurofilament expression (125%) and decrease in myelin basic protein (40%) were observed in the same region in cocaine-treated animals. This study supports the hypothesis that chronic cocaine use alters white matter integrity in human CC. Unlike humans, where the FA in the genu differed between cocaine users and non-users, the splenium was affected in rats. These differences between rodent and human findings could be due to several factors that include differences in the brain structure and function between species and/or the dose, timing, and duration of cocaine administration.

3D visualization of HIV virions by cryoelectron tomography.

The structure of the human immunodeficiency virus (HIV) and some of its components have been difficult to study in three-dimensions (3D) primarily because of their intrinsic structural variability. Recent advances in cryoelectron tomography (cryo-ET) have provided a new approach for determining the 3D structures of the intact virus, the HIV capsid, and the envelope glycoproteins located on the viral surface. A number of cryo-ET procedures related to specimen preservation, data collection, and image processing are presented in this chapter. The techniques described herein are well suited for determining the ultrastructure of bacterial and viral pathogens and their associated molecular machines in situ at nanometer resolution.

Perfusion in rat brain at 7 T with arterial spin labeling using FAIR-TrueFISP and QUIPSS.

Measurement of perfusion in longitudinal studies allows for the assessment of tissue integrity and the detection of subtle pathologies. In this work, the feasibility of measuring brain perfusion in rats with high spatial resolution using arterial spin labeling is reported. A flow-sensitive alternating recovery sequence, coupled with a balanced gradient fast imaging with steady-state precession readout section was used to minimize ghosting and geometric distortions, while achieving high signal-to-noise ratio. The quantitative imaging of perfusion using a single subtraction method was implemented to address the effects of variable transit delays between the labeling of spins and their arrival at the imaging slice. Studies in six rats at 7 T showed good perfusion contrast with minimal geometric distortion. The measured blood flow values of 152.5+/-6.3 ml/100 g per minute in gray matter and 72.3+/-14.0 ml/100 g per minute in white matter are in good agreement with previously reported values based on autoradiography, considered to be the gold standard.

Quantification of the spatiotemporal microstructural organization of the human brain association, projection and commissural pathways across the lifespan using diffusion tensor tractography.

Using diffusion tensor tractography, we quantified the microstructural changes in the association, projection, and commissural compact white matter pathways of the human brain over the lifespan in a cohort of healthy right-handed children and adults aged 6-68 years. In both males and females, the diffusion tensor radial diffusivity of the bilateral arcuate fasciculus, inferior longitudinal fasciculus, inferior fronto-occipital fasciculus, uncinate fasciculus, corticospinal, somatosensory tracts, and the corpus callosum followed a U-curve with advancing age; fractional anisotropy in the same pathways followed an inverted U-curve. Our study provides useful baseline data for the interpretation of data collected from patients.

Cryo-EM model of the bullet-shaped vesicular stomatitis virus.

Vesicular stomatitis virus (VSV) is a bullet-shaped rhabdovirus and a model system of negative-strand RNA viruses. Through direct visualization by means of cryo-electron microscopy, we show that each virion contains two nested, left-handed helices: an outer helix of matrix protein M and an inner helix of nucleoprotein N and RNA. M has a hub domain with four contact sites that link to neighboring M and N subunits, providing rigidity by clamping adjacent turns of the nucleocapsid. Side-by-side interactions between neighboring N subunits are critical for the nucleocapsid to form a bullet shape, and structure-based mutagenesis results support this description. Together, our data suggest a mechanism of VSV assembly in which the nucleocapsid spirals from the tip to become the helical trunk, both subsequently framed and rigidified by the M layer.

Organization of hue selectivity in macaque V2 thin stripes.

V2 has long been recognized to contain functionally distinguishable compartments that are correlated with the stripelike pattern of cytochrome oxidase activity. Early electrophysiological studies suggested that color, direction/disparity, and orientation selectivity were largely segregated in the thin, thick, and interstripes, respectively. Subsequent studies revealed a greater degree of homogeneity in the distribution of response properties across stripes, yet color-selective cells were still found to be most prevalent in the thin stripes. Optical recording studies have demonstrated that thin stripes contain both color-preferring and luminance-preferring modules. These thin stripe color-preferring modules contain spatially organized hue maps, whereas the luminance-preferring modules contain spatially organized luminance-change maps. In this study, the neuronal basis of these hue maps was determined by characterizing the selectivity of neurons for isoluminant hues in multiple penetrations within previously characterized V2 thin stripe hue maps. The results indicate that neurons within the superficial layers of V2 thin stripe hue maps are organized into columns whose aggregated hue selectivity is closely related to the hue selectivity of the optically defined hue maps. These data suggest that thin stripes contain hue maps not simply because of their moderate percentage of hue-selective neurons, but because of the columnar and tangential organization of hue selectivity.

Progressive Image Denoising

Image denoising continues to be an active research topic. Although state-of-the-art denoising methods are numerically impressive and approch theoretical limits, they suffer from visible artifacts.While they produce acceptable results for natural images, human eyes are less forgiving when viewing synthetic images. At the same time, current methods are becoming more complex, making analysis, and implementation difficult. We propose image denoising as a simple physical process, which progressively reduces noise by deterministic annealing. The results of our implementation are numerically and visually excellent. We further demonstrate that our method is particularly suited for synthetic images. Finally, we offer a new perspective on image denoising using robust estimators.

Graphical Model-Based Vertebra Identification from X-Ray Image(s)

Automated identification of vertebrae from X-ray image(s) is an important step for various medical image computing tasks such as 2D/3D rigid and non-rigid registration. In this chapter we present a graphical model-based solution for automated vertebra identification from X-ray image(s). Our solution does not ask for a training process using training data and has the capability to automatically determine the number of vertebrae visible in the image(s). This is achieved by combining a graphical model-based maximum a posterior probability (MAP) estimate with a mean-shift based clustering. Experiments conducted on simulated X-ray images as well as on a low-dose low quality X-ray spinal image of a scoliotic patient verified its performance.

Automatic X-ray landmark detection and shape segmentation via data-driven joint estimation of image displacements

In this paper, we propose a new method for fully-automatic landmark detection and shape segmentation in X-ray images. To detect landmarks, we estimate the displacements from some randomly sampled image patches to the (unknown) landmark positions, and then we integrate these predictions via a voting scheme. Our key contribution is a new algorithm for estimating these displacements. Different from other methods where each image patch independently predicts its displacement, we jointly estimate the displacements from all patches together in a data driven way, by considering not only the training data but also geometric constraints on the test image. The displacements estimation is formulated as a convex optimization problem that can be solved efficiently. Finally, we use the sparse shape composition model as the a priori information to regularize the landmark positions and thus generate the segmented shape contour. We validate our method on X-ray image datasets of three different anatomical structures: complete femur, proximal femur and pelvis. Experiments show that our method is accurate and robust in landmark detection, and, combined with the shape model, gives a better or comparable performance in shape segmentation compared to state-of-the art methods. Finally, a preliminary study using CT data shows the extensibility of our method to 3D data.