Deep Salience: Visual Salience Modeling via Deep Belief Propagation

Visual salience is an intriguing phenomenon observed in biological neural systems. Numerous attempts have been made to model visual salience mathematically using various feature contrasts, either locally or globally. However, these algorithmic models tend to ignore the problem’s biological solutions, in which visual salience appears to arise during the propagation of visual stimuli along the visual cortex. In this paper, inspired by the conjecture that salience arises from deep propagation along the visual cortex, we present a Deep Salience model where a multi-layer model based on successive Markov random fields (sMRF) is proposed to analyze the input image successively through its deep belief propagation. As a result, the foreground object can be automatically separated from the background in a fully unsupervised way. Experimental evaluation on the benchmark dataset validated that our Deep Salience model can consistently outperform eleven state-of-the-art salience models, yielding the higher rates in the precision-recall tests and attaining the best F-measure and mean-square error in the experiments.

Neural adaptations associated with interlimb transfer in a ballistic wrist flexion task.

Cross education is the process whereby training of one limb gives rise to increases in the subsequent performance of its opposite counterpart. The execution of many unilateral tasks is associated with increased excitability of corticospinal projections from primary motor cortex (M1) to the opposite limb. It has been proposed that these effects are causally related. Our aim was to establish whether changes in corticospinal excitability arising from prior training of the opposite limb determine levels of interlimb transfer.

We used three vision conditions shown previously to modulate the excitability of corticospinal projections to the inactive (right) limb during wrist flexion movements performed by the training (left) limb. These were: mirrored visual feedback of the training limb; no visual feedback of either limb; and visual feedback of the inactive limb. Training comprised 300 discrete, ballistic wrist flexion movements executed as rapidly as possible. Performance of the right limb on the same task was assessed prior to, at the mid point of, and following left limb training.

There was no evidence that variations in the excitability of corticospinal projections (assessed by transcranial magnetic stimulation (TMS)) to the inactive limb were associated with, or predictive of, the extent of interlimb transfer that was expressed. There were however associations between alterations in muscle activation dynamics observed for the untrained limb, and the degree of positive transfer that arose from training of the opposite limb.

The results suggest that the acute adaptations that mediate the bilateral performance gains realised through unilateral practice of this ballistic wrist flexion task are mediated by neural elements other than those within M1 that are recruited at rest by single-pulse TMS.

The direction aftereffect is driven by adaptation of local motion detectors

The processing of motion information by the visual system can be decomposed into two general stages; point-by-point local motion extraction, followed by global motion extraction through the pooling of the local motion signals. The direction aftereVect (DAE) is a well known phenomenon in which prior adaptation to a unidirectional moving pattern results in an exaggerated perceived direction diVerence between the adapted direction and a subsequently viewed stimulus moving in a diVerent direction. The experiments in this paper sought to identify where the adaptation underlying the DAE occurs within the motion processing hierarchy. We found that the DAE exhibits interocular transfer, thus demonstrating that the underlying adapted neural mechanisms are binocularly driven and must, therefore, reside in the visual cortex. The remaining experiments measured the speed tuning of the DAE, and used the derived function to test a number of local and global models of the phenomenon. Our data provide compelling evidence that the DAE is driven by the adaptation of motion-sensitive neurons at the local-processing stage of motion encoding. This is in contrast to earlier research showing that direction repulsion, which can be viewed as a simultaneous presentation counterpart to the DAE, is a global motion process. This leads us to conclude that the DAE and direction repulsion reflect interactions between motion-sensitive neural mechanisms at different levels of the motion-processing hierarchy.

The effect of simultaneous contractions of ipsilateral muscles on changes in corticospinal excitability induced by paired associative stimulation (PAS)

Consideration was given to means of increasing the reliability and muscle specificity of paired associative stimulation (PAS) by utilising the phenomenon of crossed-facilitation. Eight participants completed three separate sessions: isometric flexor contractions of the left wrist at 20% of maximum voluntary contraction (MVC) simultaneously with PAS (20s intervals; 14 min duration) delivered at the right median nerve and left primary motor cortex (MI); isometric contractions at 20% of MVC: and PAS only ( 14 min). Eight further participants completed two sessions of longer duration PAS (28 min): either alone or in conjunction with flexion contractions of the left wrist. Thirty motor potentials (MEPs) were evoked in the right flexor (rFCR) and extensor (rECR) carpi radialis muscles by magnetic stimulation of left M1 Prior to the interventions, immediately post-intervention, and 10 min post-intervention. Both 14 and 28 min of combined PAS and (left wrist flexion) contractions resulted in reliable increases in rFCR MEP amplitude, which were not present in rECR. In the PAS only conditions, 14 min of stimulation gave rise to unreliable increases in MEP amplitudes in rFCR and rECR, whereas 28 min of PAS induced small (unreliable) changes only for rFCR. These results support the conclusion that changes in the excitability of the corticospinal pathway induced by PAS interact with those associated with contraction of the muscles ipsilateral to the site of cortical stimulation. Furthermore, focal contractions applied by the opposite limb increase the extent and muscle specificity of the induced changes in excitability associated with PAS. (C) 2008 Elsevier Ireland Ltd. All rights reserved.

Movement-related potentials in high-functioning autism and Asperger's disorder

Autism and Asperger's disorder (AD) are neurodevelopmental conditions that affect cognitive and social-communicative function. Using a movement-related potential (MRP) paradigm, we investigated the clinical and neurobiological issue of 'disorder separateness' versus 'disorder variance' in autism and AD. This paradigm has been used to assess basal ganglia/supplementary motor functioning in Parkinson's disease. Three groups (high functioning autism [HFA]: 16 males, 1 female; mean age 12y 5mo [SD 4y 4mo]; AD: 11 males, 2 females; mean age 13y 5mo [SD 3y 8mo]; comparison group: 13 males, 8 females; mean age 13y 10mo, [SD 3y 11 mo]) completed a cued motor task during electroencephalogram recording of MRPs. The HFA group showed reduced peak amplitude at Cz, indicating less activity over the supplementary motor area during movement preparation. Although an overall significant between-group effect was found for early slope and peak amplitude, subanalysis revealed that the group with AD did not differ significantly from either group. However, it is suggested that autism and AD may be dissociated on the basis of brain-behaviour correlations of IQ with specific neurobiological measures. The overlap between MRP traces for autism and Parkinson's disease suggests that the neurobiological wiring of motor functioning in autism may bypass the supplementary motor area/primary motor cortex pathway.

Dual-task interference: Attentional and neurophysiological influences

Performing two tasks simultaneously often degrades performance of one or both tasks. While this dual-task interference is classically interpreted in terms of shared attentional resources, where two motor tasks are performed simultaneously interactions within primary motor cortex (i.e., activity-dependent coupling) may also be a contributing factor. In the present study TMS (transcranial magnetic stimulation) was used to examine the contribution of activity-dependent coupling to dual-task interference during concurrent performance of a bimanual coordination task and a discrete probe reaction time (RT) task involving the foot. Experiments 1 and 2 revealed that activity-dependent coupling within the leg corticomotor pathway was greater during dual-task performance than single-task performance, and this was associated with interference on the probe RT task (i.e., increased RT). Experiment 3 revealed that dual-task interference occurred regardless of whether the dual-task involved two motor tasks or a motor and cognitive task, however activity-dependent coupling was present only when a dual motor task was performed. This suggests that activity-dependent coupling is less detrimental to performance than attentional processes operating upstream of the corticomotor system. Finally, while prioritising the RT task reduced, but did not eliminate, dual-task interference the contribution of activity-dependent coupling to dual-task interference was not affected by task prioritisation. This suggests that although activity-dependent coupling may contribute to dual motor-task interference, attentional processes appear to be more important. It also suggests that activity-dependent coupling may not be subject to modulation by attentional processes. (C) 2009 Elsevier B.V. All rights reserved.

Monkey and humans exhibit similar motion-processing mechanisms

Single cell recording studies have resulted in a detailed understanding of motion-sensitive neurons in non-human primate visual cortex. However, it is not known to what extent response properties of motion-sensitive neurons in the non-human primate brain mirror response characteristics of motion-sensitive neurons in the human brain. Using a motion adaptation paradigm, the direction aftereffect, we show that changes in the activity of human motion-sensitive neurons to moving dot patterns that differ in dot density bear a strong resemblance to data from macaque monkey. We also show a division-like inhibition between neural populations tuned to opposite directions, which also mirrors neural-inhibitory behaviour in macaque. These findings strongly suggest that motion-sensitive neurons in human and non-human primates share common response and inhibitory characteristics.

Characterizing changes in the excitability of corticospinal projections to proximal muscles of the upper limb

Background: There has been an explosion of interest in methods of exogenous brain stimulation that induce changes in the excitability of human cerebral cortex. The expectation is that these methods may promote recovery of function following brain injury. To assess their effects on motor output, it is typical to assess the state of corticospinal projections from primary motor cortex to muscles of the hand, via electromyographic responses to transcranial magnetic stimulation. If a range of stimulation intensities is employed, the recruitment curves (RCs) obtained can, at least for intrinsic hand muscles, be fitted by a sigmoid function.

Objective/hypothesis: To establish whether sigmoid fits provide a reliable basis upon which to characterize the input–output properties of the corticospinal pathway for muscles proximal to the hand, and to assess as an alternative the area under the (recruitment) curve (AURC).

Methods: A comparison of the reliability of these measures, using RCs obtained for muscles that are frequently the targets of rehabilitation.

Results: The AURC is an extremely reliable measure of the state of corticospinal projections to hand and forearm muscles, which has both face and concurrent validity. Construct validity is demonstrated by detection of widely distributed (across muscles) changes in corticospinal excitability induced by paired associative stimulation (PAS).

Conclusion(s): The parameters derived from sigmoid fits are unlikely to provide an adequate means to assess the effectiveness of therapeutic regimes. The AURC can be employed to characterize corticospinal projections to a range of muscles, and gauge the efficacy of longitudinal interventions in clinical rehabilitation.

Paired associative transcranial alternating current stimulation increases the excitability of corticospinal projections in humans

Many types of non-invasive brain stimulation alter corticospinal excitability (CSE). Paired associative stimulation (PAS) has attracted particular attention as its effects ostensibly adhere to Hebbian principles of neural plasticity. In prototypical form, a single electrical stimulus is directed to a peripheral nerve in close temporal contiguity with transcranial magnetic stimulation delivered to the contralateral primary motor cortex (M1). Repeated pairing of the two discrete stimulus events (i.e. association) over an extended period either increases or decreases the excitability of corticospinal projections from M1, contingent on the interstimulus interval. We studied a novel form of associative stimulation, consisting of brief trains of peripheral afferent stimulation paired with short bursts of high frequency (≥80 Hz) transcranial alternating current stimulation (tACS) over contralateral M1. Elevations in the excitability of corticospinal projections to the forearm were observed for a range of tACS frequency (80, 140 and 250 Hz), current (1, 2 and 3 mA) and duration (500 and 1000 ms) parameters. The effects were at least as reliable as those brought about by PAS or transcranial direct current stimulation. When paired with tACS, muscle tendon vibration also induced elevations of CSE. No such changes were brought about by the tACS or peripheral afferent stimulation alone. In demonstrating that associative effects are expressed when the timing of the peripheral and cortical events is not precisely circumscribed, these findings suggest that multiple cellular pathways may contribute to a long term potentiation-type response. Their relative contributions will differ depending on the nature of the induction protocol that is used.

Modulation of human corticospinal excitability by paired associative stimulation

Paired Associative Stimulation (PAS) has come to prominence as a potential therapeutic intervention for the treatment of brain injury/disease, and as an experimental method with which to investigate Hebbian principles of neural plasticity in humans. Prototypically, a single electrical stimulus is directed to a peripheral nerve in advance of transcranial magnetic stimulation (TMS) delivered to the contralateral primary motor cortex (M1). Repeated pairing of the stimuli (i.e., association) over an extended period may increase or decrease the excitability of corticospinal projections from M1, in manner that depends on the interstimulus interval (ISI). It has been suggested that these effects represent a form of associative long-term potentiation (LTP) and depression (LTD) that bears resemblance to spike-timing dependent plasticity (STDP) as it has been elaborated in animal models. With a large body of empirical evidence having emerged since the cardinal features of PAS were first described, and in light of the variations from the original protocols that have been implemented, it is opportune to consider whether the phenomenology of PAS remains consistent with the characteristic features that were initially disclosed. This assessment necessarily has bearing upon interpretation of the effects of PAS in relation to the specific cellular pathways that are putatively engaged, including those that adhere to the rules of STDP. The balance of evidence suggests that the mechanisms that contribute to the LTP- and LTD-type responses to PAS differ depending on the precise nature of the induction protocol that is used. In addition to emphasizing the requirement for additional explanatory models, in the present analysis we highlight the key features of the PAS phenomenology that require interpretation.

Transcallosal connectivity of the human cortical motor network

The organizational and architectural configuration of white matter pathways connecting brain regions has ramifications for all facets of the human condition, including manifestations of incipient neurodegeneration. Although diffusion tensor imaging (DTI) has been used extensively to visualize white matter connectivity, due to the widespread presence of crossing fibres, the lateral projections of the corpus callosum are not normally detected using this methodology. Detailed knowledge of the transcallosal connectivity of the human cortical motor network has therefore remained elusive. We employed constrained spherical deconvolution (CSD) tractography - an approach that is much less susceptible to the influence of crossing fibres, in order to derive complete in-vivo characterizations of white matter pathways connecting specific motor cortical regions to their counterparts and other loci in the opposite hemisphere. The revealed patterns of connectivity closely resemble those derived from anatomical tracing in primates. It was established that dorsal premotor cortex (PMd) and supplementary motor area (SMA) have extensive interhemispheric connectivity - exhibiting both dense homologous projections, and widespread structural relations with every other region in the contralateral motor network. Through this in-vivo portrayal, the importance of non-primary motor regions for interhemispheric communication is emphasized. Additionally, distinct connectivity profiles were detected for the anterior and posterior subdivisions of primary motor cortex. The present findings provide a comprehensive representation of transcallosal white matter projections in humans, and have the potential to inform the development of models and hypotheses relating structural and functional brain connectivity.

Exploring eye movement analysis as a measure of selective visual attention in brain injured individuals

Primary Objective: To investigate the utility of using a new method of assessment for deficits in selective visual attention (SVA). Methods and Procedures: An independent groups design compared six participants with brain injuries with six participants from a non-brain injured control group. The Sensomotoric Instruments Eye Movement system with remote eye-tracking device (eye camera), and 2 sets of eight stimuli were employed to determine if the camera would be a sensitive discriminator of SVA in these groups. Main Outcomes and Results: The attention profile displayed by the brain injured group showed that they were slower, made more errors, were less accurate, and more indecisive than the control group. Conclusions: The utility of eye movement analysis as an assessment method was established, with implications for rehabilitation requiring further development. Key words: selective visual attention, eye movement analysis, brain injury

Visual feedback alters the variations in corticospinal excitability that arise from rhythmic movements of the opposite limb

Augmented visual feedback can have a profound bearing on the stability of bimanual coordination. Indeed, this has been used to render tractable the study of patterns of coordination that cannot otherwise be produced in a stable fashion. In previous investigations (Carson et al. 1999), we have shown that rhythmic movements, brought about by the contraction of muscles on one side of the body, lead to phase-locked changes in the excitability of homologous motor pathways of the opposite limb. The present study was conducted to assess whether these changes are influenced by the presence of visual feedback of the moving limb. Eight participants performed rhythmic flexion-extension movements of the left wrist to the beat of a metronome (1.5 Hz). In 50% of trials, visual feedback of wrist displacement was provided in relation to a target amplitude, defined by the mean movement amplitude generated during the immediately preceding no feedback trial. Motor potentials (MEPs) were evoked in the quiescent muscles of the right limb by magnetic stimulation of the left motor cortex. Consistent with our previous observations, MEP amplitudes were modulated during the movement cycle of the opposite limb. The extent of this modulation was, however, smaller in the presence of visual feedback of the moving limb (FCR omega(2) =0.41; ECR omega(2)=0.29) than in trials in which there was no visual feedback (FCR omega(2)=0.51; ECR omega(2)=0.48). In addition, the relationship between the level of FCR activation and the excitability of the homologous corticospinal pathway of the opposite limb was sensitive to the vision condition; the degree of correlation between the two variables was larger when there was no visual feedback of the moving limb. The results of the present study support the view that increases in the stability of bimanual coordination brought about by augmented feedback may be mediated by changes in the crossed modulation of excitability in homologous motor pathways.