Special issue on robot vision

The International Journal of Robotics Research (IJRR) has a long history of publishing the state-of-the-art in the field of robotic vision. This is the fourth special issue devoted to the topic. Previous special issues were published in 2012 (Volume 31, No. 4), 2010 (Volume 29, Nos 2–3) and 2007 (Volume 26, No. 7, jointly with the International Journal of Computer Vision). In a closely related field was the special issue on Visual Servoing published in IJRR, 2003 (Volume 22, Nos 10–11). These issues nicely summarize the highlights and progress of the past 12 years of research devoted to the use of visual perception for robotics.

A simulator evaluation of effects of assistive technologies on driver cognitive load at railway level crossings

Intelligent Transport Systems (ITS) have the potential to substantially reduce the number of crashes caused by human errors at railway levels crossings. However, such systems could overwhelm drivers, generate different types of driver errors and have negative effects on safety at level crossing. The literature shows an increasing interest for new ITS for increasing driver situational awareness at level crossings, as well as evaluations of such new systems on compliance. To our knowledge, the potential negative effects of such technologies have not been comprehensively evaluated yet. This study aimed at assessing the effect of different ITS interventions, designed to enhance driver behaviour at railway crossings, on driver’s cognitive loads. Fifty eight participants took part in a driving simulator study in which three ITS devices were tested: an in-vehicle visual ITS, an in-vehicle audio ITS, and an on-road valet system. Driver cognitive load was objectively and subjectively assessed for each ITS intervention. Objective data were collected from a heart rate monitor and an eye tracker, while subjective data was collected with the NASA-TLX questionnaire. Overall, results indicated that the three trialled technologies did not result in significant changes in cognitive load while approaching crossings.

Design and evaluation of decision and control strategies for autonomous vision-based see and avoid systems

This paper details the design and performance assessment of a unique collision avoidance decision and control strategy for autonomous vision-based See and Avoid systems. The general approach revolves around re-positioning a collision object in the image using image-based visual servoing, without estimating range or time to collision. The decision strategy thus involves determining where to move the collision object, to induce a safe avoidance manuever, and when to cease the avoidance behaviour. These tasks are accomplished by exploiting human navigation models, spiral motion properties, expected image feature uncertainty and the rules of the air. The result is a simple threshold based system that can be tuned and statistically evaluated by extending performance assessment techniques derived for alerting systems. Our results demonstrate how autonomous vision-only See and Avoid systems may be designed under realistic problem constraints, and then evaluated in a manner consistent to aviation expectations.

Posicionamento dinâmico utilizando controle a estrutura variável e servovisão.

Neste trabalho é apresentado o desenvolvimento de um sistema de posicionamento dinâmico para uma pequena embarcação baseado em controle a estrutura variável com realimentação por visão computacional. Foram investigadas, na literatura, diversas técnicas desenvolvidas e escolheu-se o controle a estrutura variável devido, principalmente, ao modo de acionamento dos propulsores presentes no barco utilizado para os experimentos. Somando-se a isto, foi considerada importante a robustez que a técnica de controle escolhida apresenta, pois o modelo utilizado conta com incerteza em sua dinâmica. É apresentado ainda o projeto da superfície de deslizamento para realizar o controle a estrutura variável. Como instrumento de medição optou-se por utilizar técnicas de visão computacional em imagens capturadas a partir de uma webcam. A escolha por este tipo de sistema deve-se a alta precisão das medições aliada ao seu baixo custo. São apresentadas simulações e experimentos com controle a estrutura variável em tempo discreto utilizando a integral do erro da posição visando eliminar o erro em regime. Para realizar o controle que demanda o estado completo, são comparados quatro estimadores de estado realizados em tempo discreto: derivador aproximado; observador assintótico com uma frequência de amostragem igual a da câmera; observador assintótico com uma frequência de amostragem maior que a da câmera; e filtro de Kalman.

基于视觉伺服的输电线巡检机器人抓线控制

巡检机器人在越障时,需要完成机器人手臂的准确抓线控制.结合输电线的几何特征和摄像机成像原理,提出了一种基于单摄像机的立体视觉方法来确定输电线的位置和姿态.基于该定位方法及视觉伺服理论,建立机械手抓线伺服控制模型.利用自行研制的巡检机器人进行了视觉伺服抓线实验;实验结果验证了该方法的有效性.

输电线路巡检机器人越障控制研究

介绍了超高压输电线路巡检机器人越障控制方法。根据巡检作业任务的要求,采用遥控与局部自主控制相结合的方法,实现了巡检机器人沿线行走及跨越障碍的功能。采用基于单目摄像头定位和视觉伺服的方法,实现了巡检机器人的自主越障控制。实验结果表明,该机器人可沿线行走并自主跨越障碍,从而验证了控制系统设计的有效性与合理性。

视觉伺服分类及其动态过程

对视觉伺服进行了综述性的介绍,系统地介绍了机器人视觉伺服控制的发展历史以及现状·从控制模型给出了视觉伺服控制系统的分类·针对两种最基本的分类方式基于位置的视觉伺服和基于图像的视觉伺服进行了重点介绍·对于视觉系统和图像特征的选取问题进行了讨论,此外还对视觉伺服系统的动态过程进行了分析,指出视觉系统的延时是目前伺服控制的研究所面临的最大问题·对未来视觉伺服研究的方向进行了总结·

模型无关的无定标视觉伺服控制

本文首先介绍了视觉伺服的一般原理 .然后提出了一种模型无关的无定标视觉伺服控制方法 ,在这种方法中不需要机器人模型和摄像机模型 ,应用方差最小化的原理推导出了模型无关的无定标视觉伺服控制律 .此外还给出了图像雅可比矩阵的递推公式 .文章最后通过一个轨线跟踪的仿真实验验证了算法的正确性和有效性

Vision-Based Assisted Teleoperation for Inspection Tasks with a Small ROV

It is well-known that ROVs require human intervention to guarantee the success of their assignment, as well as the equipment safety. However, as its teleoperation is quite complex to perform, there is a need for assisted teleoperation. This study aims to take on this challenge by developing vision-based assisted teleoperation maneuvers, since a standard camera is present in any ROV. The proposed approach is a visual servoing solution, that allows the user to select between several standard image processing methods and is applied to a 3-DOF ROV. The most interesting characteristic of the presented system is the exclusive use of the camera data to improve the teleoperation of an underactuated ROV. It is demonstrated through the comparison and evaluation of standard implementations of different vision methods and the execution of simple maneuvers to acquire experimental results, that the teleoperation of a small ROV can be drastically improved without the need to install additional sensors.

Getting in touch: segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging.

Whether the somatosensory system, like its visual and auditory counterparts, is comprised of parallel functional pathways for processing identity and spatial attributes (so-called what and where pathways, respectively) has hitherto been studied in humans using neuropsychological and hemodynamic methods. Here, electrical neuroimaging of somatosensory evoked potentials (SEPs) identified the spatio-temporal mechanisms subserving vibrotactile processing during two types of blocks of trials. What blocks varied stimuli in their frequency (22.5 Hz vs. 110 Hz) independently of their location (left vs. right hand). Where blocks varied the same stimuli in their location independently of their frequency. In this way, there was a 2x2 within-subjects factorial design, counterbalancing the hand stimulated (left/right) and trial type (what/where). Responses to physically identical somatosensory stimuli differed within 200 ms post-stimulus onset, which is within the same timeframe we previously identified for audition (De Santis, L., Clarke, S., Murray, M.M., 2007. Automatic and intrinsic auditory "what" and "where" processing in humans revealed by electrical neuroimaging. Cereb Cortex 17, 9-17.). Initially (100-147 ms), responses to each hand were stronger to the what than where condition in a statistically indistinguishable network within the hemisphere contralateral to the stimulated hand, arguing against hemispheric specialization as the principal basis for somatosensory what and where pathways. Later (149-189 ms) responses differed topographically, indicative of the engagement of distinct configurations of brain networks. A common topography described responses to the where condition irrespective of the hand stimulated. By contrast, different topographies accounted for the what condition and also as a function of the hand stimulated. Parallel, functionally specialized pathways are observed across sensory systems and may be indicative of a computationally advantageous organization for processing spatial and identity information.

ON THE NATURE OF THE PROTOTYPE LUMINOUS BLUE VARIABLE AG CARINAE. II. WITNESSING A MASSIVE STAR EVOLVING CLOSE TO THE EDDINGTON AND BISTABILITY LIMITS

We show that the significantly different effective temperatures (T(eff)) achieved by the luminous blue variable AG Carinae during the consecutive visual minima of 1985-1990 (T(eff) similar or equal to 22,800 K) and 2000-2001 (T(eff) similar or equal to 17,000 K) place the star on different sides of the bistability limit, which occurs in line-driven stellar winds around T(eff) similar to 21,000 K. Decisive evidence is provided by huge changes in the optical depth of the Lyman continuum in the inner wind as T(eff) changes during the S Dor cycle. These changes cause different Fe ionization structures in the inner wind. The bistability mechanism is also related to the different wind parameters during visual minima: the wind terminal velocity was 2-3 times higher and the mass-loss rate roughly two times smaller in 1985-1990 than in 2000-2003. We obtain a projected rotational velocity of 220 +/- 50 km s(-1) during 1985-1990 which, combined with the high luminosity (L(star) = 1.5 x 10(6) L(circle dot)), puts AG Car extremely close to the Eddington limit modified by rotation (Omega Gamma limit): for an inclination angle of 90 degrees, Gamma(Omega) greater than or similar to 1.0 for M(circle dot) less than or similar to 60. Based on evolutionary models and mass budget, we obtain an initial mass of similar to 100 M(circle dot) and a current mass of similar to 60-70 M(circle dot) for AG Car. Therefore, AG Car is close to, if not at, the Omega Gamma limit during visual minimum. Assuming M = 70 M(circle dot), we find that Gamma(Omega) decreases from 0.93 to 0.72 as AG Car expands toward visual maximum, suggesting that the star is not above the Eddington limit during maximum phases.

Necessary and sufficient condition for generalized passivity, passification and application to multivariable adaptive systems

Recently, a generalized passivity concept for linear multivariable systems was obtained which allows circumventing the restrictiveness of the usual passivity concept. The latter is associated with the classical SPR (Strictly Positive Real) condition whereas the new concept of passivity is associated with the so called WSPR condition and its advantage in multivariable systems is that it does not require a restrictive symmetry condition of SPR systems. As a result, it allows the design of multivariable adaptive control that, unlike some existing factorization approaches, does not imply in additional overparameterization of the adaptive controller. In this paper, we complete a previously established WSPR sufficient condition and prove that it is also necessary. We also propose some methods of passification by either premultiplying the system output tracking error vector or the system input vector by an adequate passifying matrix multiplier, so that the resulting input/output transfer function becomes WSPR. The efficiency of our proposals are illustrated by simulation utilizing a well known robotics adaptive visual servoing problem. © 2011 IFAC.

Qualidade microbiológica e ocorrência de leveduras em leite pasteurizado tipos A, B e C

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Avaliação do desempenho de argamassas com adição de cinza do bagaço de cana-de-açúcar

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Decomposition and reformulation of integer linear programming problems

This thesis deals with an investigation of Decomposition and Reformulation to solve Integer Linear Programming Problems. This method is often a very successful approach computationally, producing high-quality solutions for well-structured combinatorial optimization problems like vehicle routing, cutting stock, p-median and generalized assignment . However, until now the method has always been tailored to the specific problem under investigation. The principal innovation of this thesis is to develop a new framework able to apply this concept to a generic MIP problem. The new approach is thus capable of auto-decomposition and autoreformulation of the input problem applicable as a resolving black box algorithm and works as a complement and alternative to the normal resolving techniques. The idea of Decomposing and Reformulating (usually called in literature Dantzig and Wolfe Decomposition DWD) is, given a MIP, to convexify one (or more) subset(s) of constraints (slaves) and working on the partially convexified polyhedron(s) obtained. For a given MIP several decompositions can be defined depending from what sets of constraints we want to convexify. In this thesis we mainly reformulate MIPs using two sets of variables: the original variables and the extended variables (representing the exponential extreme points). The master constraints consist of the original constraints not included in any slaves plus the convexity constraint(s) and the linking constraints(ensuring that each original variable can be viewed as linear combination of extreme points of the slaves). The solution procedure consists of iteratively solving the reformulated MIP (master) and checking (pricing) if a variable of reduced costs exists, and in which case adding it to the master and solving it again (columns generation), or otherwise stopping the procedure. The advantage of using DWD is that the reformulated relaxation gives bounds stronger than the original LP relaxation, in addition it can be incorporated in a Branch and bound scheme (Branch and Price) in order to solve the problem to optimality. If the computational time for the pricing problem is reasonable this leads in practice to a stronger speed up in the solution time, specially when the convex hull of the slaves is easy to compute, usually because of its special structure.