Distraction by task-irrelevant stimuli: the effects of endogenous spatial attention and visual working memory load

Salient stimuli, like sudden changes in the environment or emotional stimuli, generate a priority signal that captures attention even if they are task-irrelevant. However, to achieve goal-driven behavior, we need to ignore them and to avoid being distracted. It is generally agreed that top-down factors can help us to filter out distractors. A fundamental question is how and at which stage of processing the rejection of distractors is achieved. Two circumstances under which the allocation of attention to distractors is supposed to be prevented are represented by the case in which distractors occur at an unattended location (as determined by the deployment of endogenous spatial attention) and when the amount of visual working memory resources is reduced by an ongoing task. The present thesis is focused on the impact of these factors on three sources of distraction, namely auditory and visual onsets (Experiments 1 and 2, respectively) and pleasant scenes (Experiment 3). In the first two studies we recorded neural correlates of distractor processing (i.e., Event-Related Potentials), whereas in the last study we used interference effects on behavior (i.e., a slowing down of response times on a simultaneous task) to index distraction. Endogenous spatial attention reduced distraction by auditory stimuli and eliminated distraction by visual onsets. Differently, visual working memory load only affected the processing of visual onsets. Emotional interference persisted even when scenes occurred always at unattended locations and when visual working memory was loaded. Altogether, these findings indicate that the ability to detect the location of salient task-irrelevant sounds and identify the affective significance of natural scenes is preserved even when the amount of visual working memory resources is reduced by an ongoing task and when endogenous attention is elsewhere directed. However, these results also indicate that the processing of auditory and visual distractors is not entirely automatic.

The spatial representation of time

Numerosi studi mostrano che gli intervalli temporali sono rappresentati attraverso un codice spaziale che si estende da sinistra verso destra, dove gli intervalli brevi sono rappresentati a sinistra rispetto a quelli lunghi. Inoltre tale disposizione spaziale del tempo può essere influenzata dalla manipolazione dell’attenzione-spaziale. La presente tesi si inserisce nel dibattito attuale sulla relazione tra rappresentazione spaziale del tempo e attenzione-spaziale attraverso l’uso di una tecnica che modula l’attenzione-spaziale, ovvero, l’Adattamento Prismatico (AP). La prima parte è dedicata ai meccanismi sottostanti tale relazione. Abbiamo mostrato che spostando l’attenzione-spaziale con AP, verso un lato dello spazio, si ottiene una distorsione della rappresentazione di intervalli temporali, in accordo con il lato dello spostamento attenzionale. Questo avviene sia con stimoli visivi, sia con stimoli uditivi, nonostante la modalità uditiva non sia direttamente coinvolta nella procedura visuo-motoria di AP. Questo risultato ci ha suggerito che il codice spaziale utilizzato per rappresentare il tempo, è un meccanismo centrale che viene influenzato ad alti livelli della cognizione spaziale. La tesi prosegue con l’indagine delle aree corticali che mediano l’interazione spazio-tempo, attraverso metodi neuropsicologici, neurofisiologici e di neuroimmagine. In particolare abbiamo evidenziato che, le aree localizzate nell’emisfero destro, sono cruciali per l’elaborazione del tempo, mentre le aree localizzate nell’emisfero sinistro sono cruciali ai fini della procedura di AP e affinché AP abbia effetto sugli intervalli temporali. Infine, la tesi, è dedicata allo studio dei disturbi della rappresentazione spaziale del tempo. I risultati ci indicano che un deficit di attenzione-spaziale, dopo danno emisferico destro, provoca un deficit di rappresentazione spaziale del tempo, che si riflette negativamente sulla vita quotidiana dei pazienti. Particolarmente interessanti sono i risultati ottenuti mediante AP. Un trattamento con AP, efficace nel ridurre il deficit di attenzione-spaziale, riduce anche il deficit di rappresentazione spaziale del tempo, migliorando la qualità di vita dei pazienti.

The role of medial parieto occipital cortex in visuospatial attention and reach planning: electrophysiological studies in human and non-human primates

We usually perform actions in a dynamic environment and changes in the location of a target for an upcoming action require both covert shifts of attention and motor planning update. In this study we tested whether, similarly to oculomotor areas that provide signals for overt and covert attention shifts, covert attention shifts modulate activity in cortical area V6A, which provides a bridge between visual signals and arm-motor control. We performed single cell recordings in monkeys trained to fixate straight-ahead while shifting attention outward to a peripheral cue and inward again to the fixation point. We found that neurons in V6A are influenced by spatial attention demonstrating that visual, motor, and attentional responses can occur in combination in single neurons of V6A. This modulation in an area primarily involved in visuo-motor transformation for reaching suggests that also reach-related regions could directly contribute in the shifts of spatial attention necessary to plan and control goal-directed arm movements. Moreover, to test whether V6A is causally involved in these processes, we have performed a human study using on-line repetitive transcranial magnetic stimulation over the putative human V6A (pV6A) during an attention and a reaching task requiring covert shifts of attention and reaching movements towards cued targets in space. We demonstrate that the pV6A is causally involved in attention reorienting to target detection and that this process interferes with the execution of reaching movements towards unattended targets. The current findings suggest the direct involvement of the action-related dorso-medial visual stream in attentional processes, and a more specific role of V6A in attention reorienting. Therefore, we propose that attention signals are used by the V6A to rapidly update the current motor plan or the ongoing action when a behaviorally relevant object unexpectedly appears at an unattended location.

Functional heterogeneity of medial posterior parietal cortex of macaque monkey

The posterior parietal cortex (PPC) of primates represents a remarkable platform that has evolved over time to solve some of the computational challenges that we face in the everyday life, such as sensorimotor integration, spatial attention, and motor planning. With the aim of further investigating the multifaceted functional characteristics of medial PPC, we conducted three studies to explore the visuomotor, somatic, visual, and attention-related properties of two PPC areas: V6A, a visuomotor area part of the dorsomedial visual stream, and PE, an area strongly dominated by somatomotor input, residing mainly on the exposed surface of the superior parietal lobule. In the first study, we tested the impact of visual feedback on V6A grasp-related activity during arm movements towards objects of different shapes. Our results demonstrate that V6A is modulated by both grip type and visual information during grasping preparation and execution, with a predominance of cells influenced by grip type. In the second study, we explored the influence of depth and direction information on reach-related activity of neurons in the so far largely neglected medial part of area PE. We observed a remarkable trend in medial PPC, going from the joint coding of depth and direction signals caudally, in area V6A, to a largely segregated processing of the two signals rostrally, in area PE. In the third study, we used a combined fMRI-electrophysiology experiment to investigate the neuronal mechanisms underlying covert shift of attention processes in area V6A. Our preliminary results reveal that half of the cells showed shift-selective activity when the monkey covertly shifted its attention towards the receptive field. All together these findings highlight the role of the medial PPC in integrating information coming from different sources (vision, somatosensory and motor) and emphasize the involvement of action-related regions of the dorsomedial visual stream in higher level cognitive functions.

Alpha oscillations index the functionality and the plastic changes of the visual system

Alpha oscillations are linked to visual awareness and to the periodical sampling of visual information, suggesting that alpha rhythm reflect an index of the functionality of the posterior cortices, and hence of the visual system. Therefore, the present work described a series of studies investigating alpha oscillations as a biomarker of the functionality and the plastic modifications of the visual system in response to lesions to the visual cortices or to external stimulations. The studies presented in chapter 5 and 6 showed that posterior lesions alter alpha oscillations in hemianopic patients, with reduced alpha reactivity at the eyes opening and decreased alpha functional connectivity, especially in right-lesioned hemianopics, with concurrent dysfunctions in the theta range, suggesting a specialization of the right hemisphere in orchestrating alpha oscillations and coordinating complex interplays among different brain rhythms. The study presented in chapter 7 investigated a mechanism of rhythmical attentional sampling of visual information in healthy participants, showing that perceptual performance is influenced by a rhythmical mechanism of attentional allocation, occurring at lower-alpha frequencies (i.e., 7 Hz), when a single spatial location is monitored, and at lower frequencies (i.e., 5 Hz), when attention is allocated to two spatial locations. Moreover, the right hemisphere seemed to have a dominance in this rhythmical attentional sampling, distributing attentional resources to the entire visual field. Finally, the study presented in chapter 8 showed that prolonged visual entrainment induce long-term modulations of resting-state alpha activity in healthy participants, suggesting that persistent modifications in the functionality of the visual system are possible. Altogheter, these findings show that functional processes and plastic changes of the visual system are reflected in alpha oscillatory patterns. Therefore, investigating and promoting alpha oscillations may contribute to the development of rehabilitative protocols to ameliorate the functionality of the visual system, in brain lesioned patients.

Neural basis of visual deficits recovery: visual residual functions and multisensory integration.

The ability of integrating into a unified percept sensory inputs deriving from different sensory modalities, but related to the same external event, is called multisensory integration and might represent an efficient mechanism of sensory compensation when a sensory modality is damaged by a cortical lesion. This hypothesis has been discussed in the present dissertation. Experiment 1 explored the role of superior colliculus (SC) in multisensory integration, testing patients with collicular lesions, patients with subcortical lesions not involving the SC and healthy control subjects in a multisensory task. The results revealed that patients with collicular lesions, paralleling the evidence of animal studies, demonstrated a loss of multisensory enhancement, in contrast with control subjects, providing the first lesional evidence in humans of the essential role of SC in mediating audio-visual integration. Experiment 2 investigated the role of cortex in mediating multisensory integrative effects, inducing virtual lesions by inhibitory theta-burst stimulation on temporo-parietal cortex, occipital cortex and posterior parietal cortex, demonstrating that only temporo-parietal cortex was causally involved in modulating the integration of audio-visual stimuli at the same spatial location. Given the involvement of the retino-colliculo-extrastriate pathway in mediating audio-visual integration, the functional sparing of this circuit in hemianopic patients is extremely relevant in the perspective of a multisensory-based approach to the recovery of unisensory defects. Experiment 3 demonstrated the spared functional activity of this circuit in a group of hemianopic patients, revealing the presence of implicit recognition of the fearful content of unseen visual stimuli (i.e. affective blindsight), an ability mediated by the retino-colliculo-extrastriate pathway and its connections with amygdala. Finally, Experiment 4 provided evidence that a systematic audio-visual stimulation is effective in inducing long-lasting clinical improvements in patients with visual field defect and revealed that the activity of the spared retino-colliculo-extrastriate pathway is responsible of the observed clinical amelioration, as suggested by the greater improvement observed in patients with cortical lesions limited to the occipital cortex, compared to patients with lesions extending to other cortical areas, found in tasks high demanding in terms of spatial orienting. Overall, the present results indicated that multisensory integration is mediated by the retino-colliculo-extrastriate pathway and that a systematic audio-visual stimulation, activating this spared neural circuit, is able to affect orientation towards the blind field in hemianopic patients and, therefore, might constitute an effective and innovative approach for the rehabilitation of unisensory visual impairments.

Visual-somatosensory interactions in mental representations of the body and the face

The body is represented in the brain at levels that incorporate multisensory information. This thesis focused on interactions between vision and cutaneous sensations (i.e., touch and pain). Experiment 1 revealed that there are partially dissociable pathways for visual enhancement of touch (VET) depending upon whether one sees one’s own body or the body of another person. This indicates that VET, a seeming low-level effect on spatial tactile acuity, is actually sensitive to body identity. Experiments 2-4 explored the effect of viewing one’s own body on pain perception. They demonstrated that viewing the body biases pain intensity judgments irrespective of actual stimulus intensity, and, more importantly, reduces the discriminative capacities of the nociceptive pathway encoding noxious stimulus intensity. The latter effect only occurs if the pain-inducing event itself is not visible, suggesting that viewing the body alone and viewing a stimulus event on the body have distinct effects on cutaneous sensations. Experiment 5 replicated an enhancement of visual remapping of touch (VRT) when viewing fearful human faces being touched, and further demonstrated that VRT does not occur for observed touch on non-human faces, even fearful ones. This suggests that the facial expressions of non-human animals may not be simulated within the somatosensory system of the human observer in the same way that the facial expressions of other humans are. Finally, Experiment 6 examined the enfacement illusion, in which synchronous visuo-tactile inputs cause another’s face to be assimilated into the mental self-face representation. The strength of enfacement was not affected by the other’s facial expression, supporting an asymmetric relationship between processing of facial identity and facial expressions. Together, these studies indicate that multisensory representations of the body in the brain link low-level perceptual processes with the perception of emotional cues and body/face identity, and interact in complex ways depending upon contextual factors.

Residual function, spontaneous reorganisation and treatment plasticity in homonymous visual field defects

This thesis will focus on the residual function and visual and attentional deficits in human patients, which accompany damage to the visual cortex or its thalamic afferents, and plastic changes, which follow it. In particular, I will focus on homonymous visual field defects, which comprise a broad set of central disorders of vision. I will present experimental evidence that when the primary visual pathway is completely damaged, the only signal that can be implicitly processed via subcortical visual networks is fear. I will also present data showing that in a patient with relative deafferentation of visual cortex, changes in the spatial tuning and response gain of the contralesional and ipsilesional cortex are observed, which are accompanied by changes in functional connectivity with regions belonging to the dorsal attentional network and the default mode network. I will also discuss how cortical plasticity might be harnessed to improve recovery through novel treatments. Moreover, I will show how treatment interventions aimed at recruiting spared subcortical pathway supporting multisensory orienting can drive network level change.

The mesophotic zone of the Mediterranean Sea: spatial definition, biodiversity, and predictive models

The mesophotic zone is frequently defined as ranging between 30-40 and 150 m depth. However, these borders are necessarily imprecise due to variations in the penetration of light along the water column related to local factors. Moreover, density of data on mesophotic ecosystems vary along geographical distance, with temperate latitudes largely less explored than tropical situations. This is the case of the Mediterranean Sea, where information on mesophotic ecosystems is largely lower with respect to tropical situations. The lack of a clear definition of the borders of the mesophotic zone may represent a problem when information must be transferred to the policy that requires a coherent spatial definition to plan proper management and conservation measures. The present thesis aims at providing information on the spatial definition of the mesophotic zone in the Mediterranean Sea, its biodiversity and distribution of its ecosystems. The first chapter analyzes information on mesophotic ecosystems in the Mediterranean Sea to identify gaps in the literature and map the mesophotic zone in the Mediterranean Sea using light penetration estimated from satellite data. In the second chapter, different visual techniques to study mesophotic ecosystems are compared to identify the best analytical method to estimate diversity and habitat extension. In the third chapter, a set of Remotely Operated vehicles (ROV) surveys performed on mesophotic assemblages in the Mediterranean Sea are analyzed to describe their taxonomic and functional diversity and environmental factors influencing their structure. A Habitat Suitability Model is run in the fourth chapter to map the distribution of areas suitable for the presence of deep-water oyster reefs in the Adriatic-Ionian area. The fifth chapter explores the mesophotic zone in the northern Gulf of Mexico providing its spatial and vertical extension of the mesophotic zone and information on the diversity associated with mesophotic ecosystems.

1° level of automation: the effectiveness of adaptive cruise control on driving and visual behaviour

The research activities have allowed the analysis of the driver assistance systems, called Advanced Driver Assistance Systems (ADAS) in relation to road safety. The study is structured according to several evaluation steps, related to definite on-site tests that have been carried out with different samples of users, according to their driving experience with the ACC. The evaluation steps concern: •The testing mode and the choice of suitable instrumentation to detect the driver’s behaviour in relation to the ACC. •The analysis modes and outputs to be obtained, i.e.: - Distribution of attention and inattention; - Mental workload; - The Perception-Reaction Time (PRT), the Time To Collision (TTC) and the Time Headway (TH). The main purpose is to assess the interaction between vehicle drivers and ADAS, highlighting the inattention and variation of the workloads they induce regarding the driving task. The research project considered the use of a system for monitoring visual behavior (ASL Mobile Eye-XG - ME), a powerful GPS that allowed to record the kinematic data of the vehicle (Racelogic Video V-BOX) and a tool for reading brain activity (Electroencephalographic System - EEG). Just during the analytical phase, a second and important research objective was born: the creation of a graphical interface that would allow exceeding the frame count limit, making faster and more effective the labeling of the driver’s points of view. The results show a complete and exhaustive picture of the vehicle-driver interaction. It has been possible to highlight the main sources of criticalities related to the user and the vehicle, in order to concretely reduce the accident rate. In addition, the use of mathematical-computational methodologies for the analysis of experimental data has allowed the optimization and verification of analytical processes with neural networks that have made an effective comparison between the manual and automatic methodology.

Oscillatory mechanisms of conscious perception and attention

Although the prominent role of neural oscillations in perception and cognition has been continuously investigated, some critical questions remain unanswered. My PhD thesis was aimed at addressing some of them. First, can we dissociate oscillatory underpinnings of perceptual accuracy and subjective awareness? Current work would strongly suggest that this dissociation can be drawn. While the fluctuations in alpha-amplitude decide perceptual bias and metacognitive abilities, the speed of alpha activity (i.e., alpha-frequency) dictates sensory sampling, shaping perceptual accuracy. Second, how are these oscillatory mechanisms integrated during attention? The obtained results indicate that a top-down visuospatial mechanism modulates neural assemblies in visual areas via oscillatory re-alignment and coherence in the alpha/beta range within the fronto-parietal brain network. These perceptual predictions are reflected in the retinotopically distributed posterior alpha-amplitude, while perceptual accuracy is explained by the higher alpha-frequency at the to-be-attended location. Finally, sensory input, elaborated via fast gamma oscillations, is linked to specific phases of this slower activity via oscillatory nesting, enabling integration of the feedback-modulated oscillatory activity with sensory information. Third, how can we relate this oscillatory activity to other neural markers of behaviour (i.e., event-related potentials)? The obtained results favour the oscillatory model of ERP genesis, where alpha-frequency shapes the latency of early evoked-potentials, namely P1, with both neural indices being related to perceptual accuracy. On the other hand, alpha-amplitude dictates the amplitude of later P3 evoked-response, whereas both indices shape subjective awareness. Crucially, by combining different methodological approaches, including neurostimulation (TMS) and neuroimaging (EEG), current work identified these oscillatory-behavior links as causal and not just as co-occurring events. Current work aimed at ameliorating the use of the TMS-EEG approach by explaining inter-individual differences in the stimulation outcomes, which could be proven crucial in the way we design entrainment experiments and interpret the results in both research and clinical settings.