Automatic object segmentation of unstructured scenes using colour and depth maps

This study presents a segmentation pipeline that fuses colour and depth information to automatically separate objects of interest in video sequences captured from a quadcopter. Many approaches assume that cameras are static with known position, a condition which cannot be preserved in most outdoor robotic applications. In this study, the authors compute depth information and camera positions from a monocular video sequence using structure from motion and use this information as an additional cue to colour for accurate segmentation. The authors model the problem similarly to standard segmentation routines as a Markov random field and perform the segmentation using graph cuts optimisation. Manual intervention is minimised and is only required to determine pixel seeds in the first frame which are then automatically reprojected into the remaining frames of the sequence. The authors also describe an automated method to adjust the relative weights for colour and depth according to their discriminative properties in each frame. Experimental results are presented for two video sequences captured using a quadcopter. The quality of the segmentation is compared to a ground truth and other state-of-the-art methods with consistently accurate results.

GrabCutSFM : how 3D information improves unsupervised object segmentation

In this paper, we present an unsupervised graph cut based object segmentation method using 3D information provided by Structure from Motion (SFM), called Grab- CutSFM. Rather than focusing on the segmentation problem using a trained model or human intervention, our approach aims to achieve meaningful segmentation autonomously with direct application to vision based robotics. Generally, object (foreground) and background have certain discriminative geometric information in 3D space. By exploring the 3D information from multiple views, our proposed method can segment potential objects correctly and automatically compared to conventional unsupervised segmentation using only 2D visual cues. Experiments with real video data collected from indoor and outdoor environments verify the proposed approach.

Nonparametric semantic segmentation for 3D street scenes

In this paper we propose a method to generate a large scale and accurate dense 3D semantic map of street scenes. A dense 3D semantic model of the environment can significantly improve a number of robotic applications such as autonomous driving, navigation or localisation. Instead of using offline trained classifiers for semantic segmentation, our approach employs a data-driven, nonparametric method to parse scenes which easily scale to a large environment and generalise to different scenes. We use stereo image pairs collected from cameras mounted on a moving car to produce dense depth maps which are combined into a global 3D reconstruction using camera poses from stereo visual odometry. Simultaneously, 2D automatic semantic segmentation using a nonparametric scene parsing method is fused into the 3D model. Furthermore, the resultant 3D semantic model is improved with the consideration of moving objects in the scene. We demonstrate our method on the publicly available KITTI dataset and evaluate the performance against manually generated ground truth.

Segmentation of cone-beam CT using a hidden Markov random field with informative priors

Purpose: Flat-detector, cone-beam computed tomography (CBCT) has enormous potential to improve the accuracy of treatment delivery in image-guided radiotherapy (IGRT). To assist radiotherapists in interpreting these images, we use a Bayesian statistical model to label each voxel according to its tissue type. Methods: The rich sources of prior information in IGRT are incorporated into a hidden Markov random field (MRF) model of the 3D image lattice. Tissue densities in the reference CT scan are estimated using inverse regression and then rescaled to approximate the corresponding CBCT intensity values. The treatment planning contours are combined with published studies of physiological variability to produce a spatial prior distribution for changes in the size, shape and position of the tumour volume and organs at risk (OAR). The voxel labels are estimated using the iterated conditional modes (ICM) algorithm. Results: The accuracy of the method has been evaluated using 27 CBCT scans of an electron density phantom (CIRS, Inc. model 062). The mean voxel-wise misclassification rate was 6.2%, with Dice similarity coefficient of 0.73 for liver, muscle, breast and adipose tissue. Conclusions: By incorporating prior information, we are able to successfully segment CBCT images. This could be a viable approach for automated, online image analysis in radiotherapy.

The role of vascular and hormonal genes in migraine susceptibility

Migraine is a primary headache disorder that involves both genetic and environmental components. Migraine is considered to be a polygenic disorder with a number of susceptibility genes having a minor but nonetheless significant impact on susceptibility. Migraine candidate gene studies have concentrated mainly on genes involved in neurotransmitter pathways, however evidence also exists for a role for alterations in vascular and hormonal function in migraine susceptibility. We present here a mini-review of genetic studies, investigating the potential role of vascular and hormonal gene variants, and discuss how vascular and hormonal dysfunction may impact on migraine susceptibility. We propose that the potential role of vascular and hormonal genes in this disorder warrants further investigation.

Electrospinning and crosslinking of low-molecular-weight poly(trimethylene carbonate-co-L-lactide) as an elastomeric scaffold for vascular engineering

The growth of suitable tissue to replace natural blood vessels requires a degradable scaffold material that is processable into porous structures with appropriate mechanical and cell growth properties. This study investigates the fabrication of degradable, crosslinkable prepolymers of l-lactide-co-trimethylene carbonate into porous scaffolds by electrospinning. After crosslinking by γ-radiation, dimensionally stable scaffolds were obtained with up to 56% trimethylene carbonate incorporation. The fibrous mats showed Young’s moduli closely matching human arteries (0.4–0.8 MPa). Repeated cyclic extension yielded negligible change in mechanical properties, demonstrating the potential for use under dynamic physiological conditions. The scaffolds remained elastic and resilient at 30% strain after 84 days of degradation in phosphate buffer, while the modulus and ultimate stress and strain progressively decreased. The electrospun mats are mechanically superior to solid films of the same materials. In vitro, human mesenchymal stem cells adhered to and readily proliferated on the three-dimensional fiber network, demonstrating that these polymers may find use in growing artificial blood vessels in vivo.

Cross-linked poly(trimethylene carbonate-co-L-lactide) as a biodegradable, elastomeric scaffold for vascular engineering applications

A series of copolymers of trimethylene carbonate (TMC) and l-lactide (LLA) were synthesized and evaluated as scaffolds for the production of artificial blood vessels. The polymers were end-functionalized with acrylate, cast into films, and cross-linked using UV light. The mechanical, degradation, and biocompatibility properties were evaluated. High TMC polymers showed mechanical properties comparable to human arteries (Young’s moduli of 1.2–1.8 MPa and high elasticity with repeated cycling at 10% strain). Over 84 days degradation in PBS, the modulus and material strength decreased gradually. The polymers were nontoxic and showed good cell adhesion and proliferation over 7 days using human mesenchymal stem cells. When implanted into the rat peritoneal cavity, the polymers elicited formation of tissue capsules composed of myofibroblasts, resembling immature vascular smooth muscle cells. Thus, these polymers showed properties which were tunable and favorable for vascular tissue engineering, specifically, the growth of artificial blood vessels in vivo.

Segmentation of cone-beam CT using a hidden Markov random field with informative priors

Cone-beam computed tomography (CBCT) has enormous potential to improve the accuracy of treatment delivery in image-guided radiotherapy (IGRT). To assist radiotherapists in interpreting these images, we use a Bayesian statistical model to label each voxel according to its tissue type. The rich sources of prior information in IGRT are incorporated into a hidden Markov random field model of the 3D image lattice. Tissue densities in the reference CT scan are estimated using inverse regression and then rescaled to approximate the corresponding CBCT intensity values. The treatment planning contours are combined with published studies of physiological variability to produce a spatial prior distribution for changes in the size, shape and position of the tumour volume and organs at risk. The voxel labels are estimated using iterated conditional modes. The accuracy of the method has been evaluated using 27 CBCT scans of an electron density phantom. The mean voxel-wise misclassification rate was 6.2\%, with Dice similarity coefficient of 0.73 for liver, muscle, breast and adipose tissue. By incorporating prior information, we are able to successfully segment CBCT images. This could be a viable approach for automated, online image analysis in radiotherapy.

Invading edge vs. inner (edvin) patterns of vascularization : an interplay between angiogenic and vascular survival factors defines the clinical behaviour of non-small cell lung cancer

Neo-angiogenesis during neoplastic growth involves endothelial mitogenic and migration stimuli produced by cancer or tumour stromal cells. Although this active angiogenesis takes place in the tumour periphery, the process of vessel growth and survival in inner areas and its clinical role remain largely unexplored. The present study compared the microvessel score (MS) as well as the single endothelial cell score (ECS) in the invading edge and in inner areas of non-small cell lung carcinomas (NSCLCs). Three different patterns of vascular growth were distinguished: the edvin (edge vs. inner) type 1, where a low MS was observed in both peripheral and inner tumour areas; the edvin type 2, where a high MS was noted in the invading front but a low MS in inner areas; and the edvin type 3, where both peripheral and inner tumour areas had a high MS. The ECS was high in the invading edge in edvin type 2 and 3 cases and was sharply decreased in both types in inner areas, suggesting that endothelial cell migration is unlikely to contribute to the angiogenic process in areas away from the tumour front. Expression of the vascular endothelial growth factor (VEGF) and of thymidine phosphorylase (TP) was associated with a high MS in the invading edge. VEGF was associated with a high MS in inner areas (edvin 3), while TP expression was associated with edvin type 2, showing that VEGF (and not TP) contributes to the preservation of the inner vasculature. Both edvin type 2 and 3 cases showed an increased incidence of node metastasis, but edvin type 3 cases had a poorer prognosis, even in the N1-stage group. The present study suggests that tumour factors regulating angiogenesis and vascular survival are not identical. A possible method is reported to quantify these two parameters by comparing the MS in the invading edge and inner areas (edvin types). This observation may contribute to the evaluation of the effectiveness of different therapeutic approaches, namely vascular targeting vs. anti-angiogenesis. Copyright (C) 2000 John Wiley and Sons, Ltd.

Dynamic contrast-enhanced magnetic resonance imaging as a biomarker for the pharmacological response of PTK787/ZK 222584, an inhibitor of the vascular endothelial growth factor receptor tyrosine kinases, in patients with advanced colorectal cancer and liver metastases: Results from two phase I studies

Purpose: PTK787/ZK 222584 (PTK/ZK), an orally active inhibitor of vascular endothelial growth factor (VEGF) receptor tyrosine kinases, inhibits VEGF-mediated angiogenesis. The pharmacodynamic effects of PTK/ZK were evaluated by assessing changes in contrast-enhancement parameters of metastatic liver lesions using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) in patients with advanced colorectal cancer treated in two ongoing, dose-escalating phase I studies. Patients and Methods: Twenty-six patients had DCE-MRI performed at baseline, day 2, and at the end of each 28-day cycle. Doses of oral PTK/ZK ranged from 50 to 2000 mg once daily. Tumor permeability and vascularity were assessed by calculating the bidirectional transfer constant (Ki). The percentage of baseline Ki (% of baseline Ki) at each time point was compared with pharmacokinetic and clinical end points. Results: A significant negative correlation exists between the % of baseline Ki and increase in PTK/ZK oral dose and plasma levels (P = .01 for oral dose; P = .0001 for area under the plasma concentration curve at day 2). Patients with a best response of stable disease had a significantly greater reduction in Ki at both day 2 and at the end of cycle 1 compared with progressors (mean difference in % of baseline Ki, 47%, P = .004%; and 51%, P = .006; respectively). The difference in % of baseline Ki remained statistically significant after adjusting for baseline WHO performance status. Conclusion: These findings should help to define a biologically active dose of PTK/ZK. These results suggest that DCE-MRI may be a useful biomarker for defining the pharmacological response and dose of angiogenesis inhibitiors, such as PTK/ZK, for further clinical development. © 2003 by American Society of Clinical Oncology.

Expression patterns of vascular-specific promoters RolC and Sh in transgenic potatoes and their use in engineering PLRV-resistant plants

The expression patterns of GUS fusion constructs driven by the Agrobacterium rhizogenes RolC and the maize Sh (Shrunken: sucrose synthase-1) promoters were examined in transgenic potatoes (cv. Atlantic). RolC drove high-level gene expression in phloem tissue, bundle sheath cells and vascular parenchyma, but not in xylem or non-vascular tissues. Sh expression was exclusively confined to phloem tissue. Potato leafroll luteovirus (PLRV) replicates only in phloem tissues, and we show that when RolC is used to drive expression of the PLRV coat protein gene, virus-resistant lines can be obtained. In contrast, no significant resistance was observed when the Sh promoter was used.

Image segmentation and pose estimation of humans in video

This thesis introduces improved techniques towards automatically estimating the pose of humans from video. It examines a complete workflow to estimating pose, from the segmentation of the raw video stream to extract silhouettes, to using the silhouettes in order to determine the relative orientation of parts of the human body. The proposed segmentation algorithms have improved performance and reduced complexity, while the pose estimation shows superior accuracy during difficult cases of self occlusion.

Transit passenger segmentation using travel regularity mined from Smart Card transactions data

Transit passenger market segmentation enables transit operators to target different classes of transit users to provide customized information and services. The Smart Card (SC) data, from Automated Fare Collection system, facilitates the understanding of multiday travel regularity of transit passengers, and can be used to segment them into identifiable classes of similar behaviors and needs. However, the use of SC data for market segmentation has attracted very limited attention in the literature. This paper proposes a novel methodology for mining spatial and temporal travel regularity from each individual passenger’s historical SC transactions and segments them into four segments of transit users. After reconstructing the travel itineraries from historical SC transactions, the paper adopts the Density-Based Spatial Clustering of Application with Noise (DBSCAN) algorithm to mine travel regularity of each SC user. The travel regularity is then used to segment SC users by an a priori market segmentation approach. The methodology proposed in this paper assists transit operators to understand their passengers and provide them oriented information and services.

Vascular remodeling in the internal mammary artery graft and association with in situ endothelin-1 and receptor expression

BACKGROUND: The vasoconstricting peptide endothelin-1 (ET-1) has been associated with atherosclerotic cardiovascular disease, vascular smooth muscle cell (VSMC) growth stimulation, and intimal thickening. ET-1 binds 2 receptor subtypes, endothelin A and B, and the ETA receptor mediates vasoconstriction and VSMC growth. This study aims to quantitatively assess arterial remodeling variables and compare them with changes in ET-1, ETA, and ETB expression in the internal mammary artery (IMA). METHODS AND RESULTS: Specimens from 55 coronary artery disease (CAD) patients (45 men, 10 women; mean age 65 years) and 14 control IMA specimens (from 7 men and 7 women; mean age 45 years) were collected. IMA cross sections were assessed by histochemical and immunohistochemical staining methods to quantify the levels of medionecrosis, fibrosis, VSMC growth, ET-1, ETA, ETB, and macrophage infiltration. The percentage area of medionecrosis in the patients was almost double that in the controls (31.85+/-14.52% versus 17.10+/-9.96%, P=0.0006). Total and type 1 collagen was significantly increased compared with controls (65.8+/-18.3% versus 33.7+/-13.7%, P=0.07, and 14.2+/-10.0% versus 4.8+/-2.8%, P=0.01, respectively). Despite ACE and/or statin therapy, ET-1 expression and cell cycling were significantly elevated in the patient IMAs relative to the controls (46.27+/-18.46 versus 8.56+/-8.42, P=0.0001, and 37.29+/-12.88 versus 11.06+/-8.18, P=0.0001, respectively). ETA and ETB staining was elevated in the patient vessels (46.88+/-11.52% versus 18.58+/-7.65%, P=0.0001, and 42.98+/-7.08% versus 34.73+/-5.20%, P=0.0067, respectively). A mild presence of macrophages was noted in all sections. CONCLUSIONS: Elevated distribution of collagen indicative of fibrosis coupled with increased cell cycling and high levels of ET-1 and ETA expression in the absence of chronic inflammation suggests altered IMA VSMC regulation is fundamental to the remodeling process.

Prognostic impact of vascular and lymphovascular invasion in early lung cancer

Background The prognostic significance of vascular and lymphatic invasion in non-small-cell lung cancer is under continuous debate. We analyzed the effect of tumor aggressiveness (lymphatic and/or vessel invasion) on survival and relapse in stage I and II non-small-cell lung cancer. Methods We retrospectively analyzed prospectively collected data of 457 patients with stage I and II non-small-cell lung cancer from 1998 to 2008. Specimens were analyzed for intratumoral vascular invasion and lymphovascular space invasion. Overall survival and disease-free survival were estimated using the Kaplan-Meier method, and differences were determined by the logrank test. Cox regression analysis was performed to identify independent risk factors. Results: The incidence of intratumoral vascular invasion was 23.4%, and this correlated significantly with grade of differentiation, visceral pleural involvement, lymphovascular space invasion, and N status. The incidence of lymphovascular space invasion was 5.5%, and this correlated significantly with grade of differentiation, lymph nodes involved, and intratumoral vascular invasion. On multivariate analyses, intratumoral vascular invasion proved to be an significant independent risk factor for overall survival but not for disease-free survival. Lymphovascular space invasion was associated significantly with early tumor recurrence but not with overall survival. Conclusions: Vascular and lymphatic invasion can serve as independent prognostic factors in completely resected nonsmall- cell lung cancer. Intratumoral vascular invasion and lymphovascular space invasion in early stage non-small-cell lung cancer are important factors in overall survival and early tumor recurrence. Further large scale studies with more recent patient cohorts and refined histological techniques are warranted.