Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Working memory load improves early stages of independent visual processing.

Increasing evidence suggests that working memory and perceptual processes are dynamically interrelated due to modulating activity in overlapping brain networks. However, the direct influence of working memory on the spatio-temporal brain dynamics of behaviorally relevant intervening information remains unclear. To investigate this issue, subjects performed a visual proximity grid perception task under three different visual-spatial working memory (VSWM) load conditions. VSWM load was manipulated by asking subjects to memorize the spatial locations of 6 or 3 disks. The grid was always presented between the encoding and recognition of the disk pattern. As a baseline condition, grid stimuli were presented without a VSWM context. VSWM load altered both perceptual performance and neural networks active during intervening grid encoding. Participants performed faster and more accurately on a challenging perceptual task under high VSWM load as compared to the low load and the baseline condition. Visual evoked potential (VEP) analyses identified changes in the configuration of the underlying sources in one particular period occurring 160-190 ms post-stimulus onset. Source analyses further showed an occipito-parietal down-regulation concurrent to the increased involvement of temporal and frontal resources in the high VSWM context. Together, these data suggest that cognitive control mechanisms supporting working memory may selectively enhance concurrent visual processing related to an independent goal. More broadly, our findings are in line with theoretical models implicating the engagement of frontal regions in synchronizing and optimizing mnemonic and perceptual resources towards multiple goals.

Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Beaming into the rat world: enabling real-time intereaction between rat and human each at their own scale

Immersive virtual reality (IVR) typically generates the illusion in participants that they are in the displayed virtual scene where they can experience and interact in events as if they were really happening. Teleoperator (TO) systems place people at a remote physical destination embodied as a robotic device, and where typically participants have the sensation of being at the destination, with the ability to interact with entities there. In this paper, we show how to combine IVR and TO to allow a new class of application. The participant in the IVR is represented in the destination by a physical robot (TO) and simultaneously the remote place and entities within it are represented to the participant in the IVR. Hence, the IVR participant has a normal virtual reality experience, but where his or her actions and behaviour control the remote robot and can therefore have physical consequences. Here, we show how such a system can be deployed to allow a human and a rat to operate together, but the human interacting with the rat on a human scale, and the rat interacting with the human on the rat scale. The human is represented in a rat arena by a small robot that is slaved to the human"s movements, whereas the tracked rat is represented to the human in the virtual reality by a humanoid avatar. We describe the system and also a study that was designed to test whether humans can successfully play a game with the rat. The results show that the system functioned well and that the humans were able to interact with the rat to fulfil the tasks of the game. This system opens up the possibility of new applications in the life sciences involving participant observation of and interaction with animals but at human scale.

Generació d’un entorn virtual de treball per un robot Stäubli TX60

L’objectiu del treball és emular virtualment l’entorn de treball del robot Stäubli Tx60 quehi ha al laboratori de robòtica de la UdG (dins les possibilitats que ofereix el software adquirit).Aquest laboratori intenta reproduir un entorn industrial de treball en el qual es realitzal’assemblatge d’un conjunt de manera cent per cent automatitzada.En una primera fase, s’ha dissenyat en tres dimensions tot l’entorn de treball que hi hadisponible al laboratori a través del software CAD SolidWorks. Cada un dels conjuntsque conformen l’estació de treball s’ha dissenyat de manera independent.Posteriorment s’introdueixen tots els elements dissenyats dins el software StäubliRobotics Suite 2013. Amb tot l’anterior, cal remarcar que l’objectiu principal del treball consta de duesetapes. Inicialment es dissenya el model 3D de l’entorn de treball a través del software SolidWorks i s’introdueix dins el software Stäubli Robotics Suite 2013. Enuna segona etapa, es realitza un manual d’ús del nou software de robòtica

Microstructure of the superior longitudinal fasciculus predicts stimulation-induced interference with on-line motor control.

A cortical visuomotor network, comprising the medial intraparietal sulcus (mIPS) and the dorsal premotor area (PMd), encodes the sensorimotor transformations required for the on-line control of reaching movements. How information is transmitted between these two regions and which pathways are involved, are less clear. Here, we use a multimodal approach combining repetitive transcranial magnetic stimulation (rTMS) and diffusion tensor imaging (DTI) to investigate whether structural connectivity in the 'reaching' circuit is associated to variations in the ability to control and update a movement. We induced a transient disruption of the neural processes underlying on-line motor adjustments by applying 1Hz rTMS over the mIPS. After the stimulation protocol, participants globally showed a reduction of the number of corrective trajectories during a reaching task that included unexpected visual perturbations. A voxel-based analysis revealed that participants exhibiting higher fractional anisotropy (FA) in the second branch of the superior longitudinal fasciculus (SLF II) suffered less rTMS-induced behavioral impact. These results indicate that the microstructural features of the white matter bundles within the parieto-frontal 'reaching' circuit play a prominent role when action reprogramming is interfered. Moreover, our study suggests that the structural alignment and cohesion of the white matter tracts might be used as a predictor to characterize the extent of motor impairments.

Contextual factors multiplex to control multisensory processes.

This study analyzed high-density event-related potentials (ERPs) within an electrical neuroimaging framework to provide insights regarding the interaction between multisensory processes and stimulus probabilities. Specifically, we identified the spatiotemporal brain mechanisms by which the proportion of temporally congruent and task-irrelevant auditory information influences stimulus processing during a visual duration discrimination task. The spatial position (top/bottom) of the visual stimulus was indicative of how frequently the visual and auditory stimuli would be congruent in their duration (i.e., context of congruence). Stronger influences of irrelevant sound were observed when contexts associated with a high proportion of auditory-visual congruence repeated and also when contexts associated with a low proportion of congruence switched. Context of congruence and context transition resulted in weaker brain responses at 228 to 257 ms poststimulus to conditions giving rise to larger behavioral cross-modal interactions. Importantly, a control oddball task revealed that both congruent and incongruent audiovisual stimuli triggered equivalent non-linear multisensory interactions when congruence was not a relevant dimension. Collectively, these results are well explained by statistical learning, which links a particular context (here: a spatial location) with a certain level of top-down attentional control that further modulates cross-modal interactions based on whether a particular context repeated or changed. The current findings shed new light on the importance of context-based control over multisensory processing, whose influences multiplex across finer and broader time scales.

Visual SLAM for 3D large-scale seabed acquisition employing underwater vehicles

This paper presents a novel technique to align partial 3D reconstructions of the seabed acquired by a stereo camera mounted on an autonomous underwater vehicle. Vehicle localization and seabed mapping is performed simultaneously by means of an Extended Kalman Filter. Passive landmarks are detected on the images and characterized considering 2D and 3D features. Landmarks are re-observed while the robot is navigating and data association becomes easier but robust. Once the survey is completed, vehicle trajectory is smoothed by a Rauch-Tung-Striebel filter obtaining an even better alignment of the 3D views and yet a large-scale acquisition of the seabed

Protocolo de comunicación trabajador-robot mediante imágenes

La idea del proyecto viene del concepto de “fábricas del futuro”, donde las barreras entre robots y humanos se rompen para que la colaboración entre ambos sea como en un equipo. Para la realización de este proyecto se ha utilizado el brazo robótico IRB120 de la marca ABB de 6 Grados de libertad, Matlab y el software Robot Studio. El Objetivo principal de este proyecto es establecer el protocolo de comunicación trabajador-robot mediante imágenes. El trabajador debería poder controlar el robot mediante dibujos realizados en la mesa de trabajo. En el desarrollo de la comunicación trabajador-robot cabe distinguir tres partes: · El análisis y tratamiento de imágenes para el cual se ha utilizado el software Matlab. · Transmisión de los datos desde Matlab al robot. · Programación de las acciones a realizar por el robot mediante el software “Robot Studio”. Con el protocolo de comunicación desarrollado y las imágenes realizadas por el trabajador el robot es capaz de detectar lo siguiente: · la herramienta que debe utilizar (rotulador, boli o ventosa) · si lo que tiene que dibujar en la mesa de trabajo son puntos o trazo continuo. · la localización de los puntos o del trazo continuo en la mesa de trabajo. Se ha alcanzado el objetivo propuesto con éxito, el protocolo de comunicación trabajador-robot mediante imágenes ha sido establecido. Mediante el análisis y tratamiento de imágenes se puede conseguir la información necesaria para que el robot pueda ejecutar las acciones requeridas por el trabajador.

Effects of neurotrophins on synaptic protein expression in the visual cortex of dark reared rats.

Total lack of visual experience [dark rearing (DR)] is known to prolong the critical period and delay development of sensory functions in mammalian visual cortex. Recent results show that neurotrophins (NTs) counteract the effects of DR on functional properties of visual cortical cells and exert a strong control on critical period duration. NTs are known to modulate the development and synaptic efficacy of neurotransmitter systems that are affected by DR. However, it is still unknown whether the actions of NTs in dark-reared animals involve interaction with neurotransmitter systems. We have studied the effects of DR on the expression of key molecules in the glutamatergic and GABAergic systems in control and NT-treated animals. We have found that DR reduced the expression of the NMDA receptor 2A subunit and its associated protein PSD-95 (postsynaptic density-95), of GRIP (AMPA glutamate receptor interacting protein), and of the biosynthetic enzyme GAD (glutamic acid decarboxylase). Returning dark-reared animals to light for 2 hr restored normal expression of the above-mentioned proteins almost completely. NT treatment specifically counteracts DR effects; NGF acts primarily on the NMDA system, whereas BDNF acts primarily on the GABAergic system. Finally, the action of NT4 seems to involve both excitatory and inhibitory systems. These data demonstrate that different NTs counteract DR effects by modulating the expression of key molecules of the excitatory and inhibitory neurotransmitter systems

Nonlinear dynamics and control of multibody systems

The dynamics of flexible systems, such as robot manipulators , mechanical chains or multibody systems in general, is becoming increasingly important in engineering. This article deals with some nonlinearities that arise in the study of dynamics and control of multibody systems in connection to large rotations. Specifically, a numerical scheme that adresses the conservation of fundamental constants is presented in order to analyse the control-structure interaction problems.

A Test Bed Applied Mobile Robot Navigation

It is presented a test bed applied to studies on dynamics, control, and navigation of mobile robots. A cargo ship scale model was chosen, which can be radio-controlled or operated autonomously through an embedded control system. A control program, which manages on board mission execution, is implemented on a microcontroller. Navigation is based on an electronic compass, which includes automatic compensation for pitch and roll motions. Heading control loop is based on this sensor, and on a rudder positioning system. A propulsion control system is also implemented. Typical manoeuvres as the turning test and "zig-zag", were implemented and tested. They are included on a manoeuvre library, and can be accessed independently or in combined modes. The embedded system is also in charge of signal acquisition and storing during the missions. It is possible to analyse experiments on identification of ship dynamics, control, and navigation, through the data transferred to a PC by serial communication. Navigation is going to be improved by including inertial sensors on board, and a DGPS. Preliminary tests are aimed to ship identification, and manoeuvrability, using free model tests. Future steps include extending this system for developing other mobile robots as, ROVs, AUVs, and aerial vehicles.

Dual light barrier method for six degrees of freedom tool center point calibration of an industrial robot

Tool center point calibration is a known problem in industrial robotics. The major focus of academic research is to enhance the accuracy and repeatability of next generation robots. However, operators of currently available robots are working within the limits of the robot´s repeatability and require calibration methods suitable for these basic applications. This study was conducted in association with Stresstech Oy, which provides solutions for manufacturing quality control. Their sensor, based on the Barkhausen noise effect, requires accurate positioning. The accuracy requirement admits a tool center point calibration problem if measurements are executed with an industrial robot. Multiple possibilities are available in the market for automatic tool center point calibration. Manufacturers provide customized calibrators to most robot types and tools. With the handmade sensors and multiple robot types that Stresstech uses, this would require great deal of labor. This thesis introduces a calibration method that is suitable for all robots which have two digital input ports free. It functions with the traditional method of using a light barrier to detect the tool in the robot coordinate system. However, this method utilizes two parallel light barriers to simultaneously measure and detect the center axis of the tool. Rotations about two axes are defined with the center axis. The last rotation about the Z-axis is calculated for tools that have different width of X- and Y-axes. The results indicate that this method is suitable for calibrating the geometric tool center point of a Barkhausen noise sensor. In the repeatability tests, a standard deviation inside robot repeatability was acquired. The Barkhausen noise signal was also evaluated after recalibration and the results indicate correct calibration. However, future studies should be conducted using a more accurate manipulator, since the method employs the robot itself as a measuring device.

The control of deliberate waiting strategies in a stop-signal task

To inhibit an ongoing flow of thoughts or actions has been largely considered to be a crucial executive function, and the stop-signal paradigm makes inhibitory control measurable. Stop-signal tasks usually combine two concurrent tasks, i.e., manual responses to a primary task (go-task) are occasionally countermanded by a stimulus which signals participants to inhibit their response in that trial (stop-task). Participants are always instructed not to wait for the stop-signal, since waiting strategies cause the response times to be unstable, invalidating the data. The aim of the present study was to experimentally control the strategies of waiting deliberately for the stop-signal in a stop-task by means of an algorithm that measured the variation in the reaction times to go-stimuli on-line, and displayed a warning legend urging participants to be faster when their reaction times were more than two standard deviations of the mean. Thirty-four university students performed a stop-task with go- and stop-stimuli, both of which were delivered in the visual modality and were lateralized within the visual field. The participants were divided into two groups (group A, without the algorithm, vs group B, with the algorithm). Group B exhibited lower variability of reaction times to go-stimuli, whereas no significant between-group differences were found in any of the measures of inhibitory control, showing that the algorithm succeeded in controlling the deliberate waiting strategies. Differences between deliberate and unintentional waiting strategies, and anxiety as a probable factor responsible for individual differences in deliberate waiting behavior, are discussed.

Design of traction transmission and suspension systems for an omni-directional mobile robot

This project aims to design and manufacture a mobile robot with two Universal Robot UR10 mainly used indoors. In order to obtain omni-directional maneuverability, the mobile robot is constructed with Mecanum wheels. The Mecanum wheel can move in any direction with a series of rollers attached to itself. These rollers are angled at 45º about the hub’s circumference. This type of wheels can be used in both driving and steering with their any-direction property. This paper is focused on the design of traction system and suspension system, and the velocity control of Mecanum wheels in the close-loop control system. The mechanical design includes selection of bearing housing, couplers which are act as connection between shafts, motor parts, and other needed components. The 3D design software SolidWorks is utilized to assemble all the components in order to get correct tolerance. The driving shaft is designed based on assembled structure via the software as well. The design of suspension system is to compensate the assembly error of Mecanum wheels to guarantee the stability of the robot. The control system of motor drivers is realized through the Robot Operating System (ROS) on Ubuntu Linux. The purpose of inverse kinematics is to obtain the relationship among the movements of all Mecanum wheels. Via programming and interacting with the computer, the robot could move with required speed and direction.