Selective combination of visual and thermal imaging for resilient localization in adverse conditions : day and night, smoke and fire

Long-term autonomy in robotics requires perception systems that are resilient to unusual but realistic conditions that will eventually occur during extended missions. For example, unmanned ground vehicles (UGVs) need to be capable of operating safely in adverse and low-visibility conditions, such as at night or in the presence of smoke. The key to a resilient UGV perception system lies in the use of multiple sensor modalities, e.g., operating at different frequencies of the electromagnetic spectrum, to compensate for the limitations of a single sensor type. In this paper, visual and infrared imaging are combined in a Visual-SLAM algorithm to achieve localization. We propose to evaluate the quality of data provided by each sensor modality prior to data combination. This evaluation is used to discard low-quality data, i.e., data most likely to induce large localization errors. In this way, perceptual failures are anticipated and mitigated. An extensive experimental evaluation is conducted on data sets collected with a UGV in a range of environments and adverse conditions, including the presence of smoke (obstructing the visual camera), fire, extreme heat (saturating the infrared camera), low-light conditions (dusk), and at night with sudden variations of artificial light. A total of 240 trajectory estimates are obtained using five different variations of data sources and data combination strategies in the localization method. In particular, the proposed approach for selective data combination is compared to methods using a single sensor type or combining both modalities without preselection. We show that the proposed framework allows for camera-based localization resilient to a large range of low-visibility conditions.

Divergent outcomes following transcytosis of IgG targeting intracellular and extracellular chlamydial antigens

Antibodies can play a protective but non-essential role in natural chlamydial infections dependent on antigen specificity and antibody isotype. IgG is the dominant antibody in both male and female reproductive tract mucosal secretions, and is bi-directionally trafficked across epithelia by the neonatal Fc receptor (FcRn). Using physiologically relevant pH-polarized epididymal epithelia grown on Transwells®, IgG specifically targeting an extracellular chlamydial antigen; the Major Outer Membrane Protein (MOMP), enhanced uptake and translocation of infection at pH 6-6.5 but not at neutral pH. This was dependent on FcRn expression. Conversely, FcRn-mediated transport of IgG targeting the intracellular chlamydial inclusion membrane protein A (IncA), induced aberrant inclusion morphology, recruited autophagic proteins independent of lysosomes, and significantly reduced infection. Challenge of female mice with MOMP-specific IgG-opsonized C. muridarum delayed infection clearance but exacerbated oviduct occlusion. In male mice, MOMP-IgG elicited by immunization afforded no protection against testicular chlamydial infection, whereas; the transcytosis of IncA-IgG significantly reduced testicular chlamydial burden. Together these data show that the protective and pathological effects of IgG are dependent on FcRn-mediated transport as well as the specificity of IgG for intracellular or extracellular antigens.

Localization of glucocorticoid receptors at postsynaptic membranes in the lateral amygdala

Glucocorticoids, released in high concentrations from the adrenal cortex during stressful experiences, bind to glucocorticoid receptors in nuclear and peri-nuclear sites in neuronal somata. Their classically known mode of action is to induce gene promoter receptors to alter gene transcription. Nuclear glucocorticoid receptors are particularly dense in brain regions crucial for memory, including memory of stressful experiences, such as the hippocampus and amygdala. While it has been proposed that glucocorticoids may also act via membrane bound receptors, the existence of the latter remains controversial. Using electron microscopy, we found glucocorticoid receptors localized to non-genomic sites in rat lateral amygdala, glia processes, presynaptic terminals, neuronal dendrites, and dendritic spines including spine organelles and postsynaptic membrane densities. The lateral nucleus of the amygdala is a region specifically implicated in the formation of memories for stressful experiences. These newly observed glucocorticoid receptor immunoreactive sites were in addition to glucocorticoid receptor immunoreactive signals observed using electron and confocal microscopy in lateral amygdala principal neuron and GABA neuron soma and nuclei, cellular domains traditionally associated with glucocorticoid immunoreactivity. In lateral amygdala, glucocorticoid receptors are thus also localized to non-nuclear-membrane translocation sites, particularly dendritic spines, where they show an affinity for postsynaptic membrane densities, and may have a specialized role in modulating synaptic transmission plasticity related to fear and emotional memory.

Towards training-free appearance-based localization : probabilistic models for whole-image descriptors

Whole image descriptors have recently been shown to be remarkably robust to perceptual change especially compared to local features. However, whole-image-based localization systems typically rely on heuristic methods for determining appropriate matching thresholds in a particular environment. These environment-specific tuning requirements and the lack of a meaningful interpretation of these arbitrary thresholds limits the general applicability of these systems. In this paper we present a Bayesian model of probability for whole-image descriptors that can be seamlessly integrated into localization systems designed for probabilistic visual input. We demonstrate this method using CAT-Graph, an appearance-based visual localization system originally designed for a FAB-MAP-style probabilistic input. We show that using whole-image descriptors as visual input extends CAT-Graph’s functionality to environments that experience a greater amount of perceptual change. We also present a method of estimating whole-image probability models in an online manner, removing the need for a prior training phase. We show that this online, automated training method can perform comparably to pre-trained, manually tuned local descriptor methods.

Integrin αvβ3 upregulates integrin-linked kinase expression in human ovarian cancer cells via enhancement of ILK gene transcription

We previously showed that integrin alphavbeta3 overexpression and engagement by its ligand vitronectin increased adhesion, motility, and proliferation of human ovarian cancer cells. In search of differentially regulated genes involved in these tumor biological events, we previously identified the integrin-linked kinase (ILK) to be under control of alphavbeta3. In the present investigation we demonstrated significantly upregulated ILK protein as a function of alphavbeta3 in two ovarian cancer cell lines, OV-MZ-6 and OVCAR-3, and proved co-localization at the surface of alphavbeta3-overexpressing cells adherent to vitronectin. Increase of ILK protein was reflected by enhanced ILK promoter activity, an effect, which we further characterized with regard to transcriptional response elements involved. Abrogation of NF-kappaB/c-rel or p53 binding augmented ILK promoter activity and preserved induction by alphavbeta3. The AP1-mutant exhibited decreased promoter activity but was also still inducible by alphavbeta3. Disruption of the two DNA consensus motifs for Ets proteins led to divergent observations: mutation of the Ets motif at promoter position -462 bp did not significantly alter promoter activity but still allowed response to alphavbeta3. In contrast, disruption of the second Ets motif at position -85 bp did not only lead to slightly diminished promoter activity but also, in that case, abrogated ILK promoter induction by alphavbeta3. Subsequent co-transfection studies with ets-1 in the presence of the second Ets motif led to additional induction of ILK promoter activity. Taken together, these data suggest that ets-1 binding to the second Ets DNA motif strongly contributes to alphavbeta3-mediated ILK upregulation. By increasing ILK as an important integrin-proximal kinase, alphavbeta3 may promote its intracellular signaling and tumor biological processes arising thereof in favor of ovarian cancer metastasis.

Nedd4-2(NEDD4L) controls intracellular Na(+)-mediated activity of voltage-gated sodium channels in primary cortical neurons.

Nedd4-2, a HECT (homologous with E6-associated protein C-terminus)-type ubiquitin protein ligase, has been implicated in regulating several ion channels, including Navs (voltage-gated sodium channels). In Xenopus oocytes Nedd4-2 strongly inhibits the activity of multiple Navs. However, the conditions under which Nedd4-2 mediates native Nav regulation remain uncharacterized. Using Nedd4-2-deficient mice, we demonstrate in the present study that in foetal cortical neurons Nedd4-2 regulates Navs specifically in response to elevated intracellular Na(+), but does not affect steady-state Nav activity. In dorsal root ganglia neurons from the same mice, however, Nedd4-2 does not control Nav activities. The results of the present study provide the first physiological evidence for an essential function of Nedd4-2 in regulating Navs in the central nervous system.

An efficient and effective localization method for networked disjoint top-view cameras

Disjoint top-view networked cameras are among the most commonly utilized networks in many applications. One of the open questions for these cameras' study is the computation of extrinsic parameters (positions and orientations), named extrinsic calibration or localization of cameras. Current approaches either rely on strict assumptions of the object motion for accurate results or fail to provide results of high accuracy without the requirement of the object motion. To address these shortcomings, we present a location-constrained maximum a posteriori (LMAP) approach by applying known locations in the surveillance area, some of which would be passed by the object opportunistically. The LMAP approach formulates the problem as a joint inference of the extrinsic parameters and object trajectory based on the cameras' observations and the known locations. In addition, a new task-oriented evaluation metric, named MABR (the Maximum value of All image points' Back-projected localization errors' L2 norms Relative to the area of field of view), is presented to assess the quality of the calibration results in an indoor object tracking context. Finally, results herein demonstrate the superior performance of the proposed method over the state-of-the-art algorithm based on the presented MABR and classical evaluation metric in simulations and real experiments.

Effects of dissolved oxygen availability and culture biomass at induction upon the intracellular expression of monoamine oxidase by recombinant E. coli in fed batch bioprocesses

The effects of oxygen availability and induction culture biomass upon production of an industrially important monoamine oxidase (MAO) were investigated in fed-batch cultures of a recombinant E. coli. For each induction cell biomass 2 different oxygenation methods were used, aeration and oxygen enriched air. Induction at higher biomass levels increased the culture demand for oxygen, leading to fermentative metabolism and accumulation of high levels of acetate in the aerated cultures. Paradoxically, despite an almost eight fold increase in acetate accumulation to levels widely reported to be highly detrimental to protein production, when induction wet cell weight (WCW) rose from 100% to 137.5%, MAO specific activity in these aerated processes showed a 3 fold increase. By contrast, for oxygenated cultures induced at WCW's 100% and 137.5% specific activity levels were broadly similar, but fell rapidly after the maxima were reached. Induction at high biomass levels (WCW 175%) led to very low levels of specific MAO activity relative to induction at lower WCW's in both aerated and oxygenated cultures. Oxygen enrichment of these cultures was a useful strategy for boosting specific growth rates, but did not have positive effects upon specific enzyme activity. Based upon our findings, consideration of the amino acid composition of MAO and previous studies on related enzymes, we propose that this effect is due to oxidative damage to the MAO enzyme itself during these highly aerobic processes. Thus, the optimal process for MAO production is aerated, not oxygenated, and induced at moderate cell density, and clearly represents a compromise between oxygen supply effects on specific growth rate/induction cell density, acetate accumulation, and high specific MAO activity. This work shows that the negative effects of oxygen previously reported in free enzyme preparations, are not limited to these acellular environments but are also discernible in the sheltered environment of the cytosol of E. coli cells.

Assessment of gene expression of intracellular calcium channels, pumps and exchangers with epidermal growth factor-induced epithelial-mesenchymal transition in a breast cancer cell line

Background Epithelial-mesenchymal transition (EMT) is a process implicated in cancer metastasis that involves the conversion of epithelial cells to a more mesenchymal and invasive cell phenotype. In breast cancer cells EMT is associated with altered store-operated calcium influx and changes in calcium signalling mediated by activation of cell surface purinergic receptors. In this study, we investigated whether MDA-MB-468 breast cancer cells induced to undergo EMT exhibit changes in mRNA levels of calcium channels, pumps and exchangers located on intracellular calcium storing organelles, including the Golgi, mitochondria and endoplasmic reticulum (ER). Methods Epidermal growth factor (EGF) was used to induce EMT in MDA-MB-468 breast cancer cells. Serum-deprived cells were treated with EGF (50 ng/mL) for 12 h and gene expression was assessed using quantitative RT-PCR. Results and conclusions These data reveal no significant alterations in mRNA levels of the Golgi calcium pump secretory pathway calcium ATPases (SPCA1 and SPCA2), or the mitochondrial calcium uniporter (MCU) or Na+/Ca2+ exchanger (NCLX). However, EGF-induced EMT was associated with significant alterations in mRNA levels of specific ER calcium channels and pumps, including (sarco)-endoplasmic reticulum calcium ATPases (SERCAs), and inositol 1,4,5-trisphosphate receptor (IP3R) and ryanodine receptor (RYR) calcium channel isoforms. The most prominent change in gene expression between the epithelial and mesenchymal-like states was RYR2, which was enriched 45-fold in EGF-treated MDA-MB-468 cells. These findings indicate that EGF-induced EMT in breast cancer cells may be associated with major alterations in ER calcium homeostasis.

Localization of fibronectin in the rat testis : effects of serum and dibutyryl cyclic AMP on fibronectin deposition by peritubular myoid cells in culture

The peritubular zone of the rat testis has an extensive extracellular matrix (ECM). Fibronectin (FN) is distributed primarily in the basal lamina of the seminiferous tubule boundary tissue and is synthesized by peritubular myoid cells. Several extracellular changes are mediated by growth factors and these changes occur at the time of hormone mediated testicular development, particularly in the peritubular zone. The effects of serum or dibutyryl cyclic AMP (cAMP) on FN production by the mesenchymal peritubular myoid cells were evaluated. Rats of various ages (10, 15, 20, 40 and 80 days) were employed for immunofluorescent localization of rat testicular FN in frozen sections. In all age groups tested, FN was primarily present in a broad layer around each seminiferous tubule, and blood vessel, and in variable distribution throughout the interstitial stroma. By day 20 there was no clear distinction in FN staining between the peritubular zone and the interstitial tissue. This indicates an involvement of FN in the ECM developments which occur in the peritubular zone of the testis at this time. The peritubular myoid cells were isolated from 20-22 day old rat testis and cultured on glass coverslips. These cells were grown to confluence with 10% fetal calf serum (FCS) in medium until day 4 and then subcultured to have secondary monocultures maintained with or without serum. By means of immunofluorescence and cytochemistry using avidin-biotin peroxidase complex it was observed that peritubular myoid cells were positive for FN and most of the FN was localized in the perinuclear region. Subcultured peritubular myoid cells maintained for 4 days in medium containing FCS developed an extensive interconnecting FN matrix. In the presence of 0.5 mM cAMP in culture, FN became localized along the filamentous process of peritubular myoid cells and more prominently in the areas of triangulated multi-cell aggregates as well as on the surface of the contracted small spherical cells. The addition of cAMP in the presence of FCS, also caused a noticeable change in the staining pattern; FN was detected along the filamentous process developing into a complex network of cells encased in an extensive matrix. It would appear that the translocation of FN in the cytoplasmic extensions of peritubular myoid cells may be a direct consequence of morphological changes associated with metabolic regulation of cAMP. This may also be related to the puberty associated development of in vivo changes in the ECM produced by peritubular myoid cells.

Plasma-induced death of HepG2 cancer cells : intracellular effects of reactive species

Reports show that cold atmospheric-pressure plasmas can induce death of cancer cells in several minutes. However, very little is presently known about the mechanism of the plasma-induced death of cancer cells. In this paper, an atmospheric-pressure plasma plume is used to treat HepG2 cells. The experimental results show that the plasma can effectively control the intracellular concentrations of ROS, NO and lipid peroxide. It is shown that these concentrations are directly related to the mechanism of the HepG2 death, which involves several stages. First, the plasma generates NO species, which increases the NO concentration in the extracellular medium. Second, the intracellular NO concentration is increased due to the NO diffusion from the medium. Third, an increase in the intracellular NO concentration leads to the increase of the intracellular ROS concentration. Fourth, the increased oxidative stress results in more effective lipid peroxidation and consequently, cell injury. The combined action of NO, ROS and lipid peroxide species eventually results in the HepG2 cell death. The mechanism of death of human hepatocellular carcinoma cells (HepG2) induced by atmospheric-pressure room-temperature plasma, related to the plasma-controlled intracellular concentrations of reactive oxygen species (ROS), nitric oxide (NO) and lipid peroxide is revealed. Only 34.75 s are required to reduce the number of the viable HepG2 cells by 50%.

An adaptive appearance-based map for long-term topological localization of mobile robots

"This work considers a mobile service robot which uses an appearance-based representation of its workplace as a map, where the current view and the map are used to estimate the current position in the environment. Due to the nature of real-world environments such as houses and offices, where the appearance keeps changing, the internal representation may become out of date after some time. To solve this problem the robot needs to be able to adapt its internal representation continually to the changes in the environment. This paper presents a method for creating an adaptive map for long-term appearance-based localization of a mobile robot using long-term and short-term memory concepts, with omni-directional vision as the external sensor."--publisher website

Simultaneous localization and planning on multiple map hypotheses

This paper presents a novel method to rank map hypotheses by the quality of localization they afford. The highest ranked hypothesis at any moment becomes the active representation that is used to guide the robot to its goal location. A single static representation is insufficient for navigation in dynamic environments where paths can be blocked periodically, a common scenario which poses significant challenges for typical planners. In our approach we simultaneously rank multiple map hypotheses by the influence that localization in each of them has on locally accurate odometry. This is done online for the current locally accurate window by formulating a factor graph of odometry relaxed by localization constraints. Comparison of the resulting perturbed odometry of each hypothesis with the original odometry yields a score that can be used to rank map hypotheses by their utility. We deploy the proposed approach on a real robot navigating a structurally noisy office environment. The configuration of the environment is physically altered outside the robots sensory horizon during navigation tasks to demonstrate the proposed approach of hypothesis selection.

Vision-based simultaneous localization and mapping in changing outdoor environments

For robots operating in outdoor environments, a number of factors, including weather, time of day, rough terrain, high speeds, and hardware limitations, make performing vision-based simultaneous localization and mapping with current techniques infeasible due to factors such as image blur and/or underexposure, especially on smaller platforms and low-cost hardware. In this paper, we present novel visual place-recognition and odometry techniques that address the challenges posed by low lighting, perceptual change, and low-cost cameras. Our primary contribution is a novel two-step algorithm that combines fast low-resolution whole image matching with a higher-resolution patch-verification step, as well as image saliency methods that simultaneously improve performance and decrease computing time. The algorithms are demonstrated using consumer cameras mounted on a small vehicle in a mixed urban and vegetated environment and a car traversing highway and suburban streets, at different times of day and night and in various weather conditions. The algorithms achieve reliable mapping over the course of a day, both when incrementally incorporating new visual scenes from different times of day into an existing map, and when using a static map comprising visual scenes captured at only one point in time. Using the two-step place-recognition process, we demonstrate for the first time single-image, error-free place recognition at recall rates above 50% across a day-night dataset without prior training or utilization of image sequences. This place-recognition performance enables topologically correct mapping across day-night cycles.