Biologically-inspired robust motion segmentation using mutual information

This paper presents a neuroscience inspired information theoretic approach to motion segmentation. Robust motion segmentation represents a fundamental first stage in many surveillance tasks. As an alternative to widely adopted individual segmentation approaches, which are challenged in different ways by imagery exhibiting a wide range of environmental variation and irrelevant motion, this paper presents a new biologically-inspired approach which computes the multivariate mutual information between multiple complementary motion segmentation outputs. Performance evaluation across a range of datasets and against competing segmentation methods demonstrates robust performance.

Association learning for emotional harbinger cues: When do previous emotional associations impair and when do they facilitate subsequent learning of new associations?

Neutral cues that predict emotional events (emotional harbingers) acquire emotional properties and attract attention. Given the importance of emotional harbingers for future survival, it is desirable to flexibly learn new facts about emotional harbingers when needed. However, recent research revealed that it is harder to learn new associations for emotional harbingers than cues that predict non-emotional events (neutral harbingers). In the current study, we addressed whether this impaired association learning for emotional harbingers is altered by one’s awareness of the contingencies between cues and emotional outcomes. Across 3 studies, we found that one’s awareness of the contingencies determines subsequent association learning of emotional harbingers. Emotional harbingers produced worse association learning than neutral harbingers when people were not aware of the contingencies between cues and emotional outcomes, but produced better association learning when people were aware of the contingencies. These results suggest that emotional harbingers do not always suffer from impaired association learning and can show facilitated learning depending on one’s contingency awareness.

Humans use predictive kinematic models to calibrate visual cues to three-dimensional surface slant

When the sensory consequences of an action are systematically altered our brain can recalibrate the mappings between sensory cues and properties of our environment. This recalibration can be driven by both cue conflicts and altered sensory statistics, but neither mechanism offers a way for cues to be calibrated so they provide accurate information about the world, as sensory cues carry no information as to their own accuracy. Here, we explored whether sensory predictions based on internal physical models could be used to accurately calibrate visual cues to 3D surface slant. Human observers played a 3D kinematic game in which they adjusted the slant of a surface so that a moving ball would bounce off the surface and through a target hoop. In one group, the ball’s bounce was manipulated so that the surface behaved as if it had a different slant to that signaled by visual cues. With experience of this altered bounce, observers recalibrated their perception of slant so that it was more consistent with the assumed laws of kinematics and physical behavior of the surface. In another group, making the ball spin in a way that could physically explain its altered bounce eliminated this pattern of recalibration. Importantly, both groups adjusted their behavior in the kinematic game in the same way, experienced the same set of slants and were not presented with low-level cue conflicts that could drive the recalibration. We conclude that observers use predictive kinematic models to accurately calibrate visual cues to 3D properties of world.

Dynamic distributed lanes: motion planning for multiple autonomous vehicles

Unorganized traffic is a generalized form of travel wherein vehicles do not adhere to any predefined lanes and can travel in-between lanes. Such travel is visible in a number of countries e.g. India, wherein it enables a higher traffic bandwidth, more overtaking and more efficient travel. These advantages are visible when the vehicles vary considerably in size and speed, in the absence of which the predefined lanes are near-optimal. Motion planning for multiple autonomous vehicles in unorganized traffic deals with deciding on the manner in which every vehicle travels, ensuring no collision either with each other or with static obstacles. In this paper the notion of predefined lanes is generalized to model unorganized travel for the purpose of planning vehicles travel. A uniform cost search is used for finding the optimal motion strategy of a vehicle, amidst the known travel plans of the other vehicles. The aim is to maximize the separation between the vehicles and static obstacles. The search is responsible for defining an optimal lane distribution among vehicles in the planning scenario. Clothoid curves are used for maintaining a lane or changing lanes. Experiments are performed by simulation over a set of challenging scenarios with a complex grid of obstacles. Additionally behaviours of overtaking, waiting for a vehicle to cross and following another vehicle are exhibited.

The role of the harmonic vector average in motion integration

The local speeds of object contours vary systematically with the cosine of the angle between the normal component of the local velocity and the global object motion direction. An array of Gabor elements whose speed changes with local spatial orientation in accordance with this pattern can appear to move as a single surface. The apparent direction of motion of plaids and Gabor arrays has variously been proposed to result from feature tracking, vector addition and vector averaging in addition to the geometrically correct global velocity as indicated by the intersection of constraints (IOC) solution. Here a new combination rule, the harmonic vector average (HVA), is introduced, as well as a new algorithm for computing the IOC solution. The vector sum can be discounted as an integration strategy as it increases with the number of elements. The vector average over local vectors that vary in direction always provides an underestimate of the true global speed. The HVA, however, provides the correct global speed and direction for an unbiased sample of local velocities with respect to the global motion direction, as is the case for a simple closed contour. The HVA over biased samples provides an aggregate velocity estimate that can still be combined through an IOC computation to give an accurate estimate of the global velocity, which is not true of the vector average. Psychophysical results for type II Gabor arrays show perceived direction and speed falls close to the IOC direction for Gabor arrays having a wide range of orientations but the IOC prediction fails as the mean orientation shifts away from the global motion direction and the orientation range narrows. In this case perceived velocity generally defaults to the HVA.

Motion of the dayside polar cap boundary during substorm cycles: II. Generation of poleward-moving events and polar cap patches by pulses in the magnetopause reconnection rate

Using data from the EISCAT (European Incoherent Scatter) VHF and CUTLASS (Co-operative UK Twin- Located Auroral Sounding System) HF radars, we study the formation of ionospheric polar cap patches and their relationship to the magnetopause reconnection pulses identified in the companion paper by Lockwood et al. (2005). It is shown that the poleward-moving, high-concentration plasma patches observed in the ionosphere by EISCAT on 23 November 1999, as reported by Davies et al. (2002), were often associated with corresponding reconnection rate pulses. However, not all such pulses generated a patch and only within a limited MLT range (11:00–12:00 MLT) did a patch result from a reconnection pulse. Three proposed mechanisms for the production of patches, and of the concentration minima that separate them, are analysed and evaluated: (1) concentration enhancement within the patches by cusp/cleft precipitation; (2) plasma depletion in the minima between the patches by fast plasma flows; and (3) intermittent injection of photoionisation-enhanced plasma into the polar cap. We devise a test to distinguish between the effects of these mechanisms. Some of the events repeat too frequently to apply the test. Others have sufficiently long repeat periods and mechanism (3) is shown to be the only explanation of three of the longer-lived patches seen on this day. However, effect (2) also appears to contribute to some events. We conclude that plasma concentration gradients on the edges of the larger patches arise mainly from local time variations in the subauroral plasma, via the mechanism proposed by Lockwood et al. (2000).

Motion of the dayside polar cap boundary during substorm cycles: I. Observations of pulses in the magnetopause reconnection rate

Using data from the EISCAT (European Incoherent Scatter) VHF radar and DMSP (Defense Meteorological Satellite Program) spacecraft passes, we study the motion of the dayside open-closed field line boundary during two substorm cycles. The satellite data show that the motions of ion and electron temperature boundaries in EISCAT data, as reported by Moen et al. (2004), are not localised around the radar; rather, they reflect motions of the open-closed field line boundary at all MLT throughout the dayside auroral ionosphere. The boundary is shown to erode equatorward when the IMF points southward, consistent with the effect of magnetopause reconnection. During the substorm expansion and recovery phases, the dayside boundary returns poleward, whether the IMF points northward or southward. However, the poleward retreat was much faster during the substorm for which the IMF had returned to northward than for the substorm for which the IMF remained southward – even though the former substorm is much the weaker of the two. These poleward retreats are consistent with the destruction of open flux at the tail current sheet. Application of a new analysis of the peak ion energies at the equatorward edge of the cleft/cusp/mantle dispersion seen by the DMSP satellites identifies the dayside reconnection merging gap to extend in MLT from about 9.5 to 15.5 h for most of the interval. Analysis of the boundary motion, and of the convection velocities seen near the boundary by EISCAT, allows calculation of the reconnection rate (mapped down to the ionosphere) from the flow component normal to the boundary in its own rest frame. This reconnection rate is not, in general, significantly different from zero before 06:45 UT (MLT<9.5 h) – indicating that the X line footprint expands over the EISCAT field-of-view to earlier MLT only occasionally and briefly. Between 06:45 UT and 12:45UT (9.5

Low-energy ion outflows from the ionosphere during a major polar cap expansion — evidence for equatorward motion of inverted-V structures

Data from the Dynamics Explorer 1 satellite and the EISCAT and Sondrestrom incoherent scatter radars, have allowed a study of low-energy ion outflows from the ionosphere into the magnetosphere during a rapid expansion of the polar cap. From the combined radar data, a 200kV increase in cross-cap potential is estimated. The upflowing ions show “X” signatures in the pitch angle-time spectrograms in the expanding midnight sector of the auroral oval. These signatures reveal low-energy (below about 60eV), light-ion beams sandwiched between two regions of ion conics and are associated with inverted-V electron precipitation. The lack of mass dispersion of the poleward edge of the event, despite great differences in the times of flight, reflects the equatorward expansion of the acceleration regions at velocities similar to those of the antisunward convection. In addition, a transient burst of upflow of 0+ is observed within the cap, possibly due to enhanced Joule heating during the event.

The role of statistical learning in the acquisition of motion event construal in a second language

Learning to talk about motion in a second language is very difficult because it involves restructuring deeply entrenched patterns from the first language (Slobin 1996). In this paper we argue that statistical learning (Saffran et al. 1997) can explain why L2 learners are only partially successful in restructuring their second language grammars. We explore to what extent L2 learners make use of two mechanisms of statistical learning, entrenchment and pre-emption (Boyd and Goldberg 2011) to acquire target-like expressions of motion and retreat from overgeneralisation in this domain. Paying attention to the frequency of existing patterns in the input can help learners to adjust the frequency with which they use path and manner verbs in French but is insufficient to acquire the boundary crossing constraint (Slobin and Hoiting 1994) and learn what not to say. We also look at the role of language proficiency and exposure to French in explaining the findings.

Video stimuli reduce object-directed imitation accuracy: a novel two-person motion-tracking approach

Imitation is an important form of social behavior, and research has aimed to discover and explain the neural and kinematic aspects of imitation. However, much of this research has featured single participants imitating in response to pre-recorded video stimuli. This is in spite of findings that show reduced neural activation to video vs. real life movement stimuli, particularly in the motor cortex. We investigated the degree to which video stimuli may affect the imitation process using a novel motion tracking paradigm with high spatial and temporal resolution. We recorded 14 positions on the hands, arms, and heads of two individuals in an imitation experiment. One individual freely moved within given parameters (moving balls across a series of pegs) and a second participant imitated. This task was performed with either simple (one ball) or complex (three balls) movement difficulty, and either face-to-face or via a live video projection. After an exploratory analysis, three dependent variables were chosen for examination: 3D grip position, joint angles in the arm, and grip aperture. A cross-correlation and multivariate analysis revealed that object-directed imitation task accuracy (as represented by grip position) was reduced in video compared to face-to-face feedback, and in complex compared to simple difficulty. This was most prevalent in the left-right and forward-back motions, relevant to the imitator sitting face-to-face with the actor or with a live projected video of the same actor. The results suggest that for tasks which require object-directed imitation, video stimuli may not be an ecologically valid way to present task materials. However, no similar effects were found in the joint angle and grip aperture variables, suggesting that there are limits to the influence of video stimuli on imitation. The implications of these results are discussed with regards to previous findings, and with suggestions for future experimentation.

Low-cost HMD and EEG: using visual stimulation by the Oculus Rift® to detect stronger ERDs induced by motion imagery

Virtual Reality (VR) can provide visual stimuli for EEG studies that can be altered in real time and can produce effects that are difficult or impossible to reproduce in a non-virtual experimental platform. As part of this experiment the Oculus Rift, a commercial-grade, low-cost, Head Mounted Display (HMD) was assessed as a visual stimuli platform for experiments recording EEG. Following, the device was used to investigate the effect of congruent visual stimuli on Event Related Desynchronisation (ERD) due to motion imagery.

Study of optimization for cooperative motion between two humans in mutual tracking

Verbal communication is essential for human society and human civilization. Non-verbal communication, on the other hand, is more widely used not only by human but also other kind of animals, and the content of information is estimated even larger than the verbal communication. Among the non-verbal communication mutual motion is the simplest and easiest to study experimentally and analytically. We measured the power spectrum of the hand velocity in various conditions and clarified the following points on the feed-back and feed- forward mechanism as basic knowledge to understand the condition of good communication.

Why the hand motion proceeds the target in tracking experiment?

In the present study, to shed light on a role of positional error correction mechanism and prediction mechanism in the proactive control discovered earlier, we carried out a visual tracking experiment, in which the region where target was shown, was regulated in a circular orbit. Main results found in this research were following. Recognition of a time step, obtained from the environmental stimuli, is required for the predictive function. The period of the rhythm in the brain obtained from environmental stimuli is shortened about 10%, when the visual information is cut-off. The shortening of the period of the rhythm in the brain accelerates the motion as soon as the visual information is cut-off, and lets the hand motion precedes the target motion. Although the precedence of the hand in the blind region is reset by the environmental information when the target enters the visible region, the hand precedes in average the target when the predictive mechanism dominates the error-corrective mechanism.

Dyspnea-related cues engage the prefrontal cortex - evidence from functional brain imaging in COPD

Dyspnea is the major source of disability in chronic obstructive pulmonary disease (COPD). In COPD, environmental cues (e.g. the prospect of having to climb stairs) become associated with dyspnea, and may trigger dyspnea even before physical activity commences. We hypothesised that brain activation relating to such cues would be different between COPD patients and healthy controls, reflecting greater engagement of emotional mechanisms in patients. Methods: Using FMRI, we investigated brain responses to dyspnea-related word cues in 41 COPD patients and 40 healthy age-matched controls. We combined these findings with scores of self-report questionnaires thus linking the FMRI task with clinically relevant measures. This approach was adapted from studies in pain that enables identification of brain networks responsible for pain processing despite absence of a physical challenge. Results: COPD patients demonstrate activation in the medial prefrontal cortex (mPFC), and anterior cingulate cortex (ACC) which correlated with the visual analogue scale (VAS) response to word cues. This activity independently correlated with patient-reported questionnaires of depression, fatigue and dyspnea vigilance. Activation in the anterior insula, lateral prefrontal cortex (lPFC) and precuneus correlated with the VAS dyspnea scale but not the questionnaires. Conclusions: Our findings suggest that engagement of the brain's emotional circuitry is important for interpretation of dyspnea-related cues in COPD, and is influenced by depression, fatigue, and vigilance. A heightened response to salient cues is associated with increased symptom perception in chronic pain and asthma, and our findings suggest such mechanisms may be relevant in COPD.