Selective combination of visual and thermal imaging for resilient localization in adverse conditions : day and night, smoke and fire

Long-term autonomy in robotics requires perception systems that are resilient to unusual but realistic conditions that will eventually occur during extended missions. For example, unmanned ground vehicles (UGVs) need to be capable of operating safely in adverse and low-visibility conditions, such as at night or in the presence of smoke. The key to a resilient UGV perception system lies in the use of multiple sensor modalities, e.g., operating at different frequencies of the electromagnetic spectrum, to compensate for the limitations of a single sensor type. In this paper, visual and infrared imaging are combined in a Visual-SLAM algorithm to achieve localization. We propose to evaluate the quality of data provided by each sensor modality prior to data combination. This evaluation is used to discard low-quality data, i.e., data most likely to induce large localization errors. In this way, perceptual failures are anticipated and mitigated. An extensive experimental evaluation is conducted on data sets collected with a UGV in a range of environments and adverse conditions, including the presence of smoke (obstructing the visual camera), fire, extreme heat (saturating the infrared camera), low-light conditions (dusk), and at night with sudden variations of artificial light. A total of 240 trajectory estimates are obtained using five different variations of data sources and data combination strategies in the localization method. In particular, the proposed approach for selective data combination is compared to methods using a single sensor type or combining both modalities without preselection. We show that the proposed framework allows for camera-based localization resilient to a large range of low-visibility conditions.

Localization of glucocorticoid receptors at postsynaptic membranes in the lateral amygdala

Glucocorticoids, released in high concentrations from the adrenal cortex during stressful experiences, bind to glucocorticoid receptors in nuclear and peri-nuclear sites in neuronal somata. Their classically known mode of action is to induce gene promoter receptors to alter gene transcription. Nuclear glucocorticoid receptors are particularly dense in brain regions crucial for memory, including memory of stressful experiences, such as the hippocampus and amygdala. While it has been proposed that glucocorticoids may also act via membrane bound receptors, the existence of the latter remains controversial. Using electron microscopy, we found glucocorticoid receptors localized to non-genomic sites in rat lateral amygdala, glia processes, presynaptic terminals, neuronal dendrites, and dendritic spines including spine organelles and postsynaptic membrane densities. The lateral nucleus of the amygdala is a region specifically implicated in the formation of memories for stressful experiences. These newly observed glucocorticoid receptor immunoreactive sites were in addition to glucocorticoid receptor immunoreactive signals observed using electron and confocal microscopy in lateral amygdala principal neuron and GABA neuron soma and nuclei, cellular domains traditionally associated with glucocorticoid immunoreactivity. In lateral amygdala, glucocorticoid receptors are thus also localized to non-nuclear-membrane translocation sites, particularly dendritic spines, where they show an affinity for postsynaptic membrane densities, and may have a specialized role in modulating synaptic transmission plasticity related to fear and emotional memory.

Towards training-free appearance-based localization : probabilistic models for whole-image descriptors

Whole image descriptors have recently been shown to be remarkably robust to perceptual change especially compared to local features. However, whole-image-based localization systems typically rely on heuristic methods for determining appropriate matching thresholds in a particular environment. These environment-specific tuning requirements and the lack of a meaningful interpretation of these arbitrary thresholds limits the general applicability of these systems. In this paper we present a Bayesian model of probability for whole-image descriptors that can be seamlessly integrated into localization systems designed for probabilistic visual input. We demonstrate this method using CAT-Graph, an appearance-based visual localization system originally designed for a FAB-MAP-style probabilistic input. We show that using whole-image descriptors as visual input extends CAT-Graph’s functionality to environments that experience a greater amount of perceptual change. We also present a method of estimating whole-image probability models in an online manner, removing the need for a prior training phase. We show that this online, automated training method can perform comparably to pre-trained, manually tuned local descriptor methods.

Loss of chromosomal integrity in human mammary epithelial cells subsequent to escape from senescence

The genomic changes that foster cancer can be either genetic or epigenetic in nature. Early studies focused on genetic changes and how mutational events contribute to changes in gene expression. These point mutations, deletions and amplifications are known to activate oncogenes and inactivate tumor suppressor genes. More recently, multiple epigenetic changes that can have a profound effect on carcinogenesis have been identified. These epigenetic events, such as the methylation of promoter sequences in genes, are under active investigation. In this review we will describe a methylation event that occurs during the propagation of human mammary epithelial cells (HMEC) in culture and detail the accompanying genetic alterations that have been observed.

An efficient and effective localization method for networked disjoint top-view cameras

Disjoint top-view networked cameras are among the most commonly utilized networks in many applications. One of the open questions for these cameras' study is the computation of extrinsic parameters (positions and orientations), named extrinsic calibration or localization of cameras. Current approaches either rely on strict assumptions of the object motion for accurate results or fail to provide results of high accuracy without the requirement of the object motion. To address these shortcomings, we present a location-constrained maximum a posteriori (LMAP) approach by applying known locations in the surveillance area, some of which would be passed by the object opportunistically. The LMAP approach formulates the problem as a joint inference of the extrinsic parameters and object trajectory based on the cameras' observations and the known locations. In addition, a new task-oriented evaluation metric, named MABR (the Maximum value of All image points' Back-projected localization errors' L2 norms Relative to the area of field of view), is presented to assess the quality of the calibration results in an indoor object tracking context. Finally, results herein demonstrate the superior performance of the proposed method over the state-of-the-art algorithm based on the presented MABR and classical evaluation metric in simulations and real experiments.

Soluble laminin and arginine-glycine-aspartic acid containing peptides differentially regulate type IV collagenase messenger RNA, activation, and localization in testicular cell culture

Rat testicular cells in culture produce several metalloproteinases including type IV collagenases (Sang et al. Biol Reprod 1990; 43:946-955, 956-964). We have now investigated the regulation of testicular cell type IV collagenase and other metalloprotemases in vitro. Soluble laminin stimulated Sertoli cell type IV collagenase mRNA levels. However, three peptides corresponding to different domains of the laminin molecule (CSRAKQAASIKVASADR, FALRGDNP, CLQDGDVRV) did not influence type IV collagenase mENA levels. Zyniographic analysis of medium collected from these cultures revealed that neither soluble laminin nor any of the peptides influenced 72-Wa type IV collagenase protein levels. However, peptide FALRGDNP resulted in both, a selective increase in two higher molecular-weight metalloprotemnases (83 kDa and 110 Wa and in an activation of the 72-Wa rat type IV collagenase. Interleukin-1, phorbol ester, testosterone, and FSH did not affect collagenase activation, lmmunocytochemical studies demonstrated that the addition of soluble laminin resulted in a redistribution of type IV collagenase from intracellular vesicles to the cell-substrate region beneath the cells. Peptide FALRGDNP induced a change from a vesicular to peripheral plasma membrane type of staining pattern. Zymography of plasma membrane preparations demonstrated triton-soluble gelatinases of 76 Wa, 83 Wa, and 110 Wa and a triton-insoluble gelatinase of 225 Wa, These results indicate that testicular cell type IV collagenase mRNA levels, enzyme activation, and distribution are influenced by laminin and RGD-containing peptides.

Localization of fibronectin in the rat testis : effects of serum and dibutyryl cyclic AMP on fibronectin deposition by peritubular myoid cells in culture

The peritubular zone of the rat testis has an extensive extracellular matrix (ECM). Fibronectin (FN) is distributed primarily in the basal lamina of the seminiferous tubule boundary tissue and is synthesized by peritubular myoid cells. Several extracellular changes are mediated by growth factors and these changes occur at the time of hormone mediated testicular development, particularly in the peritubular zone. The effects of serum or dibutyryl cyclic AMP (cAMP) on FN production by the mesenchymal peritubular myoid cells were evaluated. Rats of various ages (10, 15, 20, 40 and 80 days) were employed for immunofluorescent localization of rat testicular FN in frozen sections. In all age groups tested, FN was primarily present in a broad layer around each seminiferous tubule, and blood vessel, and in variable distribution throughout the interstitial stroma. By day 20 there was no clear distinction in FN staining between the peritubular zone and the interstitial tissue. This indicates an involvement of FN in the ECM developments which occur in the peritubular zone of the testis at this time. The peritubular myoid cells were isolated from 20-22 day old rat testis and cultured on glass coverslips. These cells were grown to confluence with 10% fetal calf serum (FCS) in medium until day 4 and then subcultured to have secondary monocultures maintained with or without serum. By means of immunofluorescence and cytochemistry using avidin-biotin peroxidase complex it was observed that peritubular myoid cells were positive for FN and most of the FN was localized in the perinuclear region. Subcultured peritubular myoid cells maintained for 4 days in medium containing FCS developed an extensive interconnecting FN matrix. In the presence of 0.5 mM cAMP in culture, FN became localized along the filamentous process of peritubular myoid cells and more prominently in the areas of triangulated multi-cell aggregates as well as on the surface of the contracted small spherical cells. The addition of cAMP in the presence of FCS, also caused a noticeable change in the staining pattern; FN was detected along the filamentous process developing into a complex network of cells encased in an extensive matrix. It would appear that the translocation of FN in the cytoplasmic extensions of peritubular myoid cells may be a direct consequence of morphological changes associated with metabolic regulation of cAMP. This may also be related to the puberty associated development of in vivo changes in the ECM produced by peritubular myoid cells.

An adaptive appearance-based map for long-term topological localization of mobile robots

"This work considers a mobile service robot which uses an appearance-based representation of its workplace as a map, where the current view and the map are used to estimate the current position in the environment. Due to the nature of real-world environments such as houses and offices, where the appearance keeps changing, the internal representation may become out of date after some time. To solve this problem the robot needs to be able to adapt its internal representation continually to the changes in the environment. This paper presents a method for creating an adaptive map for long-term appearance-based localization of a mobile robot using long-term and short-term memory concepts, with omni-directional vision as the external sensor."--publisher website

Simultaneous localization and planning on multiple map hypotheses

This paper presents a novel method to rank map hypotheses by the quality of localization they afford. The highest ranked hypothesis at any moment becomes the active representation that is used to guide the robot to its goal location. A single static representation is insufficient for navigation in dynamic environments where paths can be blocked periodically, a common scenario which poses significant challenges for typical planners. In our approach we simultaneously rank multiple map hypotheses by the influence that localization in each of them has on locally accurate odometry. This is done online for the current locally accurate window by formulating a factor graph of odometry relaxed by localization constraints. Comparison of the resulting perturbed odometry of each hypothesis with the original odometry yields a score that can be used to rank map hypotheses by their utility. We deploy the proposed approach on a real robot navigating a structurally noisy office environment. The configuration of the environment is physically altered outside the robots sensory horizon during navigation tasks to demonstrate the proposed approach of hypothesis selection.

Vision-based simultaneous localization and mapping in changing outdoor environments

For robots operating in outdoor environments, a number of factors, including weather, time of day, rough terrain, high speeds, and hardware limitations, make performing vision-based simultaneous localization and mapping with current techniques infeasible due to factors such as image blur and/or underexposure, especially on smaller platforms and low-cost hardware. In this paper, we present novel visual place-recognition and odometry techniques that address the challenges posed by low lighting, perceptual change, and low-cost cameras. Our primary contribution is a novel two-step algorithm that combines fast low-resolution whole image matching with a higher-resolution patch-verification step, as well as image saliency methods that simultaneously improve performance and decrease computing time. The algorithms are demonstrated using consumer cameras mounted on a small vehicle in a mixed urban and vegetated environment and a car traversing highway and suburban streets, at different times of day and night and in various weather conditions. The algorithms achieve reliable mapping over the course of a day, both when incrementally incorporating new visual scenes from different times of day into an existing map, and when using a static map comprising visual scenes captured at only one point in time. Using the two-step place-recognition process, we demonstrate for the first time single-image, error-free place recognition at recall rates above 50% across a day-night dataset without prior training or utilization of image sequences. This place-recognition performance enables topologically correct mapping across day-night cycles.

Topological localization using optical flow descriptors

We propose a topological localization method based on optical flow information. We analyse the statistical characteristics of the optical flow signal and demonstrate that the flow vectors can be used to identify and describe key locations in the environment. The key locations (nodes) correspond to significant scene changes and depth discontinuities. Since optical flow vectors contain position, magnitude and angle information, for each node, we extract low and high order statistical moments of the vectors and use them as descriptors for that node. Once a database of nodes and their corresponding optical flow features is created, the robot can perform topological localization by using the Mahalanobis distance between the current frame and the database. This is supported by field trials, which illustrate the repeatability of the proposed method for detecting and describing key locations in indoor and outdoor environments in challenging and diverse lighting conditions.

Chromosomal genotoxicity of nitrobenzene and benzonitrile

In order to investigate the chromosomal genotoxicity of nitrobenzene and benzonitrile, we studied the induction of micronuclei (MN) by these test compounds in V79 cells, as well as effects on the formation and stability of microtubules and on motor protein functions. No cytotoxicity was seen in V79 cell cultures in terms of Neutral red uptake after 18 h treatment with up to 1 mM nitrobenzene or 1 mM benzonitrile. Subsequently, a concentration range up to 100 μM was used in the experiments on induction of MN. Both test compounds exhibit a weak, but definitely positive test result compared to the solvent (DMSO) control. Minimal effect concentrations of nitrobenzene and benzonitrile appeared as low as 0.01 μM, and no-effect-concentrations were between 0.001 and 0.005 μM. Clearly enhanced MN rates were found at 0.1 μM and higher. Both, nitrobenzene and benzonitrile, induced mostly kinetochor (CREST)-positive micronuclei, thus characterising the chromosomal effects as aneugenic. In cell-free assays, a slight effect on tubulin assembly was observed at 1 mM nitrobenzene without addition of DMSO. Higher concentrations (5 mM) led to secondary effects. In presence of 1% DMSO, nitrobenzene exerted no detectable effect on tubulin assembly up to the solubility limit in water of about 15 mM. For benzonitrile in presence of DMSO, a clear dose-response of inhibition of tubulin assembly at 37°C was seen above the no-effect-concentration of 2 mM, with an IC50 of 13 mM and protein denaturation starting above a level of about 20 mM. The nature of the effects of nitrobenzene and benzonitrile on the association of tubulin to form microtubules was confirmed by electron microscopy. Treatment by either 5 mM nitrobenzene or 13 mM benzonitrile plus 1% DMSO left the microtubular structure intact whereas 5 mM nitrobenzene, in absence of DMSO, led to irregular cluster formations. The experiments demonstrate that both nitrobenzene and benzonitrile, in millimolar concentration ranges, may lead to interference with tubulin assembly in a cell-free system. The functionality of the tubulin-kinesin motor protein system was assessed using the microtubule gliding assay. Nitrobenzene affected the gliding velocity in a concentration-dependent manner, starting at about 7.5 μM and reaching complete inhibition of motility at 30 μM, whereas benzonitrile up to 200 μM did not affect the kinesin-driven gliding velocity. The micronucleus assay data demonstrate a chromosomal endpoint of genotoxicity of nitrobenzene and benzonitrile. Aneugenic effects of both compounds occur at remarkably low concentrations, with lowest-effect-concentrations being 0.1 μM. This points to the relevance of interactions with the cellular spindle apparatus.