Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard CCD camera and a ToF camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time of light information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localization. Further development of these methods will make it possible to identify objects and their position in the real world, and to use this information to prevent possible collisions between the robot and such objects.

Visual sensor fusion for active security in robotic industrial environments

This work presents a method of information fusion involving data captured by both a standard charge-coupled device (CCD) camera and a time-of-flight (ToF) camera to be used in the detection of the proximity between a manipulator robot and a human. Both cameras are assumed to be located above the work area of an industrial robot. The fusion of colour images and time-of-flight information makes it possible to know the 3D localization of objects with respect to a world coordinate system. At the same time, this allows to know their colour information. Considering that ToF information given by the range camera contains innacuracies including distance error, border error, and pixel saturation, some corrections over the ToF information are proposed and developed to improve the results. The proposed fusion method uses the calibration parameters of both cameras to reproject 3D ToF points, expressed in a common coordinate system for both cameras and a robot arm, in 2D colour images. In addition to this, using the 3D information, the motion detection in a robot industrial environment is achieved, and the fusion of information is applied to the foreground objects previously detected. This combination of information results in a matrix that links colour and 3D information, giving the possibility of characterising the object by its colour in addition to its 3D localisation. Further development of these methods will make it possible to identify objects and their position in the real world and to use this information to prevent possible collisions between the robot and such objects.

Pose Refinement of Active Models using Forces in 3D

A new algorithm is described for refining the pose of a model of a rigid object, to conform more accurately to the image structure. Elemental 3D forces are considered to act on the model. These are derived from directional derivatives of the image local to the projected model features. The convergence properties of the algorithm is investigated and compared to a previous technique. Its use in a video sequence of a cluttered outdoor traffic scene is also illustrated and assessed.

A Newton method for pose refinement of 3D models

Different optimization methods can be employed to optimize a numerical estimate for the match between an instantiated object model and an image. In order to take advantage of gradient-based optimization methods, perspective inversion must be used in this context. We show that convergence can be very fast by extrapolating to maximum goodness-of-fit with Newton's method. This approach is related to methods which either maximize a similar goodness-of-fit measure without use of gradient information, or else minimize distances between projected model lines and image features. Newton's method combines the accuracy of the former approach with the speed of convergence of the latter.

The indoor localization system using vision for multiple mobile robots

This paper presents the development of an indoor localization system using camera vision. The localization system has a capability to determine 2D coordinate (x, y) for a team of mobile robots, Miabot. The experimental results show that the system outperforms our existing sonar localizer both in accuracy and a precision.

Cue combination for 3D location judgements

Cue combination rules have often been applied to the perception of surface shape but not to judgements of object location. Here, we used immersive virtual reality to explore the relationship between different cues to distance. Participants viewed a virtual scene and judged the change in distance of an object presented in two intervals, where the scene changed in size between intervals (by a factor of between 0.25 and 4). We measured thresholds for detecting a change in object distance when there were only 'physical' (stereo and motion parallax) or 'texture-based' cues (independent of the scale of the scene) and used these to predict biases in a distance matching task. Under a range of conditions, in which the viewing distance and position of the tarte relative to other objects was varied, the ration of 'physical' to 'texture-based' thresholds was a good predictor of biases in the distance matching task. The cue combination approach, which successfully accounts for our data, relies on quite different principles from those underlying geometric reconstruction.

Localization of eIF4A-III in the nucleolus and splicing speckles is an indicator of plant stress

The mechanisms of long-term adaptation to low oxygen environment are quite well studied, but little is known about the sensing of oxygen shortage, the signal transduction and the short-term effects of hypoxia in plant cells. We have found that an RNA helicase eIF4A-III, a putative component of the Exon Junction Complex, rapidly changes its pattern of localisation in the plant nucleus under hypoxic conditions. In normal cell growth conditions GFP- eIF4A-III was mainly nucleoplasmic, but in hypoxia stress conditions it moved to the nucleolus and splicing speckles. This transition occurred within 15-20 min in Arabidopsis culture cells and seedling root cells, but took more than 2 h in tobacco BY-2 culture cells. Inhibition of respiration, transcription or phosphorylation in cells and ethanol treatment had similar effects to hypoxia. The most likely consequence is that a certain mRNA population will remain bound to the eIF4A-III and other mRNA processing proteins, rather than being transported from the nucleus to the cytoplasm, and thus its translation will be suspended.

The point-source method for 3D reconstructions for the Helmholtz and Maxwell equations

We use the point-source method (PSM) to reconstruct a scattered field from its associated far field pattern. The reconstruction scheme is described and numerical results are presented for three-dimensional acoustic and electromagnetic scattering problems. We give new proofs of the algorithms, based on the Green and Stratton-Chu formulae, which are more general than with the former use of the reciprocity relation. This allows us to handle the case of limited aperture data and arbitrary incident fields. Both for 3D acoustics and electromagnetics, numerical reconstructions of the field for different settings and with noisy data are shown. For shape reconstruction in acoustics, we develop an appropriate strategy to identify areas with good reconstruction quality and combine different such regions into one joint function. Then, we show how shapes of unknown sound-soft scatterers are found as level curves of the total reconstructed field.

A 3D stochastic cloud model for investigating the radiative properties of inhomogeneous cirrus clouds

(From author). Comments: First 3D stochastic/fractal model of cirrus; first detailed analysis & explanation of power spectra of ice water content, including first observations of 50-km scale break and mixing-induced steepening of spectrum; first demonstration of the potential effect of wind shear on radiative fluxes by changing fall-streak orientation. Has spawned work on the effect of 3D photon transport on the radiative effects of cirrus clouds.

Stereo and motion parallax cues in human 3D vision: can they vanish without a trace?

In an immersive virtual reality environment, subjects fail to notice when a scene expands or contracts around them, despite correct and consistent information from binocular stereopsis and motion parallax, resulting in gross failures of size constancy (A. Glennerster, L. Tcheang, S. J. Gilson, A. W. Fitzgibbon, & A. J. Parker, 2006). We determined whether the integration of stereopsis/motion parallax cues with texture-based cues could be modified through feedback. Subjects compared the size of two objects, each visible when the room was of a different size. As the subject walked, the room expanded or contracted, although subjects failed to notice any change. Subjects were given feedback about the accuracy of their size judgments, where the “correct” size setting was defined either by texture-based cues or (in a separate experiment) by stereo/motion parallax cues. Because of feedback, observers were able to adjust responses such that fewer errors were made. For texture-based feedback, the pattern of responses was consistent with observers weighting texture cues more heavily. However, for stereo/motion parallax feedback, performance in many conditions became worse such that, paradoxically, biases moved away from the point reinforced by the feedback. This can be explained by assuming that subjects remap the relationship between stereo/motion parallax cues and perceived size or that they develop strategies to change their criterion for a size match on different trials. In either case, subjects appear not to have direct access to stereo/motion parallax cues.

Factors required for the uridylylation of the foot-and-mouth disease virus 3B1, 3B2, and 3B3 peptides by the RNA-dependent RNA polymerase (3D(pol)) in vitro

The 5' terminus of picornavirus genomic RNA is covalently linked to the virus-encoded peptide 313 (VTg). Foot-and-mouth disease virus (FMDV) is unique in encoding and using 3 distinct forms of this peptide. These peptides each act as primers for RNA synthesis by the virus-encoded RNA polymerase 3D(pol). To act as the primer for positive-strand RNA synthesis, the 3B peptides have to be uridylylated to form VPgpU(pU). For certain picornaviruses, it has been shown that this reaction is achieved by the 3D(pol) in the presence of the 3CD precursor plus an internal RNA sequence termed a cis-acting replication element (cre). The FMDV ere has been identified previously to be within the 5' untranslated region, whereas all other picornavirus cre structures are within the viral coding region. The requirements for the in vitro uridylylation of each of the FMDV 313 peptides has now been determined, and the role of the FMDV ere (also known as the 3B-uridylylation site, or bus) in this reaction has been analyzed. The poly(A) tail does not act as a significant template for FMDV 3B uridylylation.

A conserved basic loop in hepatitis C virus p7 protein is required for amantadine-sensitive ion channel activity in mammalian cells but is dispensable for localization to mitochondria

We previously identified the function of the hepatitis C virus (HCV) p7 protein as an ion channel in artificial lipid bilayers and demonstrated that this in vitro activity is inhibited by amantadine. Here we show that the ion channel activity of HCV p7 expressed in mammalian cells can substitute for that of influenza virus M2 in a cell-based assay. This was also the case for the p7 from the related virus, bovine viral diarrhoea virus (BVDV). Moreover, amantadine was shown to abrogate HCV p7 function in this assay at a concentration that specifically inhibits M2. Mutation of a conserved basic loop located between the two predicted trans-membrane alpha helices rendered HCV p7 non-functional as an ion channel. The intracellular localization of p7 was unaffected by this mutation and was found to overlap significantly with membranes associated with mitochondria. Demonstration of p7 ion channel activity in cellular membranes and its inhibition by amantadine affirm the protein as a target for future anti-viral chemotherapy.

Immunohistochemical localization of inhibin/activin alpha, beta(A) and beta(B) subunits and follistatin in bovine oocytes during in vitro maturation and fertilization

The aim of this study was to evaluate the distribution of inhibin/activin alpha, beta(A) and beta(B) subunits and follistatin in immature oocytes and in matured oocytes before and after IVF. Denuded oocytes were submitted to a whole-mount immunofluorescence procedure. Specimens were imaged and fluorescent intensities quantified by scanning laser confocal microscopy. Immunoreactivity for inhibin alpha subunit (both alpha(C) and pro-alpha. regions), abundant in the ooplasm of immature oocytes, decreased after maturation (a 68% and 88% decrease, respectively; P < 0.001), but increased after IVF by 2- and 5.7-fold, respectively (P < 0.01). Intense staining for PA was detected in immature oocytes (predominantly in the outer ooplasm and zona pellucida) but after maturation and fertilization it was localized mainly in the zona pellucida, perivitelline space and oolemma. Immunoreactivity for RA in the ooplasm decreased by 58% after maturation (P < 0.001) but increased again by 75% after fertilization (P < 0.01). Immunoreactivity for beta(B) was localized mainly in the zona pellucida and did not change after maturation. However, immurloreactivity for beta(B) was not detected in the zona pellucida after fertilization, but remained unchanged in unfertilized oocytes. Immunoreactivity for follistatin was detected in the ooplasm and zona pellucida of immature oocytes but decreased progressively in the ooplasm after maturation (a 63% decrease; P < 0.001) and did not change after IVF. Examination of partially denuded cumulus-oocyte complexes confirmed abundant expression of alpha(C), pro-alpha, beta(A) and follistatin immunoreactivity in cumulus cells, whereas beta(B) subunit staining was weak or absent in cumulus cells, but intense in the zona pellucida. In conclusion, the present study shows that qualitative and quantitative changes in the distribution of inhibin/activin subunits and follistatin accompany oocyte maturation and fertilization. The possibility, indicated by these observations, that activin A and activin B may play distinct roles in bovine oocyte maturation and fertilization warrants further study.