Cardiovascular patterns associated with appetitive and defensive activation during affective picture viewing

In this study we assessed blood pressure (BP), heart rate (HR), stroke volume (SV), cardiac output (CO), and total peripheral resistance (TPR) in response to 13 picture series in 37 participants in order to investigate their hemodynamic response associated with activation of the appetitive and defensive motivational systems underlying emotional experience. BP and SV, but not TPR, increased with increasing self-rated arousal, whereas HR decelerated more in response to negative than positive and neutral pictures. These findings suggest that modulation of the cardiovascular response to pictures is primarily myocardial. The observed response pattern is consistent with a configuration of cardiac sympathetic-parasympathetic coactivation. The relationships between self-rated arousal, BP, and SV were mainly exhibited by men, suggesting that increases in the sympathetic inotropic effect to the heart with self-rated arousal may be larger in men than in women.

Visual functions in the healthy and schizophrenic brain : from stimulus control to illusory perceptions using electrical neuroimaging

ABSTRACT (FRENCH)Ce travail de thèse basé sur le système visuel chez les sujets sains et chez les patients schizophrènes, s'articule autour de trois articles scientifiques publiés ou en cours de publication. Ces articles traitent des sujets suivants : le premier article présente une nouvelle méthode de traitement des composantes physiques des stimuli (luminance et fréquence spatiale). Le second article montre, à l'aide d'analyses de données EEG, un déficit de la voie magnocellulaire dans le traitement visuel des illusions chez les patients schizophrènes. Ceci est démontré par l'absence de modulation de la composante PI chez les patients schizophrènes contrairement aux sujets sains. Cette absence est induite par des stimuli de type illusion Kanizsa de différentes excentricités. Finalement, le troisième article, également à l'aide de méthodes de neuroimagerie électrique (EEG), montre que le traitement des contours illusoires se trouve dans le complexe latéro-occipital (LOC), à l'aide d'illusion « misaligned gratings ». De plus il révèle que les activités démontrées précédemment dans les aires visuelles primaires sont dues à des inférences « top- down ».Afin de permettre la compréhension de ces trois articles, l'introduction de ce manuscrit présente les concepts essentiels. De plus des méthodes d'analyses de temps-fréquence sont présentées. L'introduction est divisée en quatre parties : la première présente le système visuel depuis les cellules retino-corticales aux deux voix du traitement de l'information en passant par les régions composant le système visuel. La deuxième partie présente la schizophrénie par son diagnostic, ces déficits de bas niveau de traitement des stimuli visuel et ces déficits cognitifs. La troisième partie présente le traitement des contours illusoires et les trois modèles utilisés dans le dernier article. Finalement, les méthodes de traitement des données EEG seront explicitées, y compris les méthodes de temps-fréquences.Les résultats des trois articles sont présentés dans le chapitre éponyme (du même nom). De plus ce chapitre comprendra les résultats obtenus à l'aide des méthodes de temps-fréquenceFinalement, la discussion sera orientée selon trois axes : les méthodes de temps-fréquence ainsi qu'une proposition de traitement de ces données par une méthode statistique indépendante de la référence. La discussion du premier article en montrera la qualité du traitement de ces stimuli. La discussion des deux articles neurophysiologiques, proposera de nouvelles d'expériences afin d'affiner les résultats actuels sur les déficits des schizophrènes. Ceci pourrait permettre d'établir un marqueur biologique fiable de la schizophrénie.ABSTRACT (ENGLISH)This thesis focuses on the visual system in healthy subjects and schizophrenic patients. To address this research, advanced methods of analysis of electroencephalographic (EEG) data were used and developed. This manuscript is comprised of three scientific articles. The first article showed a novel method to control the physical features of visual stimuli (luminance and spatial frequencies). The second article showed, using electrical neuroimaging of EEG, a deficit in spatial processing associated with the dorsal pathway in chronic schizophrenic patients. This deficit was elicited by an absent modulation of the PI component in terms of response strength and topography as well as source estimations. This deficit was orthogonal to the preserved ability to process Kanizsa-type illusory contours. Finally, the third article resolved ongoing debates concerning the neural mechanism mediating illusory contour sensitivity by using electrical neuroimaging to show that the first differentiation of illusory contour presence vs. absence is localized within the lateral occipital complex. This effect was subsequent to modulations due to the orientation of misaligned grating stimuli. Collectively, these results support a model where effects in V1/V2 are mediated by "top-down" modulation from the LOC.To understand these three articles, the Introduction of this thesis presents the major concepts used in these articles. Additionally, a section is devoted to time-frequency analysis methods not presented in the articles themselves. The introduction is divided in four parts. The first part presents three aspects of the visual system: cellular, regional, and its functional interactions. The second part presents an overview of schizophrenia and its sensoiy-cognitive deficits. The third part presents an overview of illusory contour processing and the three models examined in the third article. Finally, advanced analysis methods for EEG are presented, including time- frequency methodology.The Introduction is followed by a synopsis of the main results in the articles as well as those obtained from the time-frequency analyses.Finally, the Discussion chapter is divided along three axes. The first axis discusses the time frequency analysis and proposes a novel statistical approach that is independent of the reference. The second axis contextualizes the first article and discusses the quality of the stimulus control and direction for further improvements. Finally, both neurophysiologic articles are contextualized by proposing future experiments and hypotheses that may serve to improve our understanding of schizophrenia on the one hand and visual functions more generally.

Multisensory facilitation of behavior in monkeys: effects of stimulus intensity.

Multisensory stimuli can improve performance, facilitating RTs on sensorimotor tasks. This benefit is referred to as the redundant signals effect (RSE) and can exceed predictions on the basis of probability summation, indicative of integrative processes. Although an RSE exceeding probability summation has been repeatedly observed in humans and nonprimate animals, there are scant and inconsistent data from nonhuman primates performing similar protocols. Rather, existing paradigms have instead focused on saccadic eye movements. Moreover, the extant results in monkeys leave unresolved how stimulus synchronicity and intensity impact performance. Two trained monkeys performed a simple detection task involving arm movements to auditory, visual, or synchronous auditory-visual multisensory pairs. RSEs in excess of predictions on the basis of probability summation were observed and thus forcibly follow from neural response interactions. Parametric variation of auditory stimulus intensity revealed that in both animals, RT facilitation was limited to situations where the auditory stimulus intensity was below or up to 20 dB above perceptual threshold, despite the visual stimulus always being suprathreshold. No RT facilitation or even behavioral costs were obtained with auditory intensities 30-40 dB above threshold. The present study demonstrates the feasibility and the suitability of behaving monkeys for investigating links between psychophysical and neurophysiologic instantiations of multisensory interactions.

Affect-related synesthesias: A prospective view on their existence, expression and underlying mechanisms

The literature on developmental synaesthesia has seen numerous sensory combinations, with surprisingly few reports on synaesthesias involving affect. On the one hand, emotion, or more broadly affect, might be of minor importance to the synaesthetic experience (e.g. Sinke et al., 2012). On the other hand, predictions on how affect could be relevant to the synaesthetic experience remain to be formulated, in particular those that are driven by emotion theories. In this theoretical paper, we hypothesize that a priori studies on synaesthesia involving affect will observe the following. Firstly, the synaesthetic experience is not merely about discrete emotion processing or overall valence (positive, negative) but is determined by or even altered through cognitive appraisal processes. Secondly, the synaesthetic experience changes temporarily on a quantitative level according to i) the affective appraisal of the inducing stimulus or ii) the current affective state of the individual. These hypotheses are inferred from previous theoretical and empirical accounts on synaesthesia (including the few examples involving affect), different emotion theories, crossmodal processing accounts in synaesthetes and nonsynaesthetes, and the presumed stability of the synaesthetic experience. We hope that the current review will succeed in launching a new series of studies on "affective synaesthesias". We particularly hope that such studies will apply the same creativity in experimental paradigms as we have seen and still see when assessing and evaluating "traditional" synaesthesias.

Spontaneous pre-stimulus fluctuations in the activity of right fronto-parietal areas influence inhibitory control performance.

Inhibitory control refers to the ability to suppress planned or ongoing cognitive or motor processes. Electrophysiological indices of inhibitory control failure have been found to manifest even before the presentation of the stimuli triggering the inhibition, suggesting that pre-stimulus brain-states modulate inhibition performance. However, previous electrophysiological investigations on the state-dependency of inhibitory control were based on averaged event-related potentials (ERPs), a method eliminating the variability in the ongoing brain activity not time-locked to the event of interest. These studies thus left unresolved whether spontaneous variations in the brain-state immediately preceding unpredictable inhibition-triggering stimuli also influence inhibitory control performance. To address this question, we applied single-trial EEG topographic analyses on the time interval immediately preceding NoGo stimuli in conditions where the responses to NoGo trials were correctly inhibited [correct rejection (CR)] vs. committed [false alarms (FAs)] during an auditory spatial Go/NoGo task. We found a specific configuration of the EEG voltage field manifesting more frequently before correctly inhibited responses to NoGo stimuli than before FAs. There was no evidence for an EEG topography occurring more frequently before FAs than before CR. The visualization of distributed electrical source estimations of the EEG topography preceding successful response inhibition suggested that it resulted from the activity of a right fronto-parietal brain network. Our results suggest that the fluctuations in the ongoing brain activity immediately preceding stimulus presentation contribute to the behavioral outcomes during an inhibitory control task. Our results further suggest that the state-dependency of sensory-cognitive processing might not only concern perceptual processes, but also high-order, top-down inhibitory control mechanisms.

Post-traumatic stimulus suppressible myoclonus of peripheral origin.

A patient is described who presented with myoclonus of the first dorsal interosseus muscle of the right foot. This myoclonus occurred 18 months after trauma of the cutaneous branch of the deep peroneal nerve on the dorsal aspect of the foot. Tactile stimulation in the dermatome of this nerve, or an anaesthetic block of the deep peroneal nerve stopped the myoclonus. The different innervation between the efferent motor activity responsible for the movements and the sensory afference suppressing it points firmly towards involvement of central connections. However, abolition of the movement by anaesthesia suggests the presence of a peripheral ectopic generator. This finding confirms that focal myoclonus can have its origin in the peripheral nervous system and may be modulated by sensory inputs.

Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds.

Evidence of multisensory interactions within low-level cortices and at early post-stimulus latencies has prompted a paradigm shift in conceptualizations of sensory organization. However, the mechanisms of these interactions and their link to behavior remain largely unknown. One behaviorally salient stimulus is a rapidly approaching (looming) object, which can indicate potential threats. Based on findings from humans and nonhuman primates suggesting there to be selective multisensory (auditory-visual) integration of looming signals, we tested whether looming sounds would selectively modulate the excitability of visual cortex. We combined transcranial magnetic stimulation (TMS) over the occipital pole and psychophysics for "neurometric" and psychometric assays of changes in low-level visual cortex excitability (i.e., phosphene induction) and perception, respectively. Across three experiments we show that structured looming sounds considerably enhance visual cortex excitability relative to other sound categories and white-noise controls. The time course of this effect showed that modulation of visual cortex excitability started to differ between looming and stationary sounds for sound portions of very short duration (80 ms) that were significantly below (by 35 ms) perceptual discrimination threshold. Visual perceptions are thus rapidly and efficiently boosted by sounds through early, preperceptual and stimulus-selective modulation of neuronal excitability within low-level visual cortex.

Bilateral dorsal and ventral fiber pathways for the processing of affective prosody identified by probabilistic fiber tracking.

Dorsal and ventral pathways for syntacto-semantic speech processing in the left hemisphere are represented in the dual-stream model of auditory processing. Here we report new findings for the right dorsal and ventral temporo-frontal pathway during processing of affectively intonated speech (i.e. affective prosody) in humans, together with several left hemispheric structural connections, partly resembling those for syntacto-semantic speech processing. We investigated white matter fiber connectivity between regions responding to affective prosody in several subregions of the bilateral superior temporal cortex (secondary and higher-level auditory cortex) and of the inferior frontal cortex (anterior and posterior inferior frontal gyrus). The fiber connectivity was investigated by using probabilistic diffusion tensor based tractography. The results underscore several so far underestimated auditory pathway connections, especially for the processing of affective prosody, such as a right ventral auditory pathway. The results also suggest the existence of a dual-stream processing in the right hemisphere, and a general predominance of the dorsal pathways in both hemispheres underlying the neural processing of affective prosody in an extended temporo-frontal network.

Respiration, metabolic balance, and attention in affective picture processing

The jointly voluntary and involuntary control of respiration, unique among essential physiological processes, the interconnection of breathing with and its influence on the autonomic nervous system, and disease states associated with the interface between psychology and respiration (e.g., anxiety disorders, hyperventilation syndrome, asthma) make the study of the relationship between respiration and emotion both theoretically and clinically of great relevance. However, the respiratory behavior during affective states is not yet completely understood. We studied breathing pattern responses to 13 picture series varying widely in their affective tone in 37 adults (18 men, 19 women, mean age 26). Time and volume parameters were recorded with the LifeShirt system (VivoMetrics Inc., Ventura, California, USA, see image). We also measured end-tidal pCO2 (EtCO2) with a Microcap Handheld Capnograph (Oridion Medical 1987 Ltd., Jerusalem, Israel) to determine if ventilation is in balance with metabolic demands and spontaneous eye-blinking to investigate the link between respiration and attention. At the end of each picture series, the participants reported their subjective feeling in the affective dimensions of pleasantness and arousal. Increasing self-rated arousal was associated with increasing minute ventilation but not with decreases in EtCO2, suggesting that ventilatory changes during picture viewing paralleled variations in metabolic activity. EtCO2 correlated with pleasantness, and eye-blink rate decreased with increasing unpleasantness in line with a negativity bias in attention. Like MV, inspiratory drive (i.e., mean inspiratory flow) increased with arousal. This relationship reflected increases in inspiratory volume rather than shortening of the time parameters. This study confirms that respiratory responses to affective stimuli are organized to a certain degree along the dimensions of pleasantness and arousal. It shows, for the first time, that during picture viewing, ventilatory increases with increasing arousal are in balance with metabolic activity and that inspiratory volume is modulated by arousal. MV emerges as the most reliable respiratory index of self-perceived arousal. Finally, end-tidal pCO2 is slightly lower during processing of negative as compared to positive picture contents, which is proposed to enhance sensory perception and reflect a negativity bias in attention.

Decoding stimulus-related information from single-trial EEG responses based on voltage topographies

Neuroimaging studies typically compare experimental conditions using average brain responses, thereby overlooking the stimulus-related information conveyed by distributed spatio-temporal patterns of single-trial responses. Here, we take advantage of this rich information at a single-trial level to decode stimulus-related signals in two event-related potential (ERP) studies. Our method models the statistical distribution of the voltage topographies with a Gaussian Mixture Model (GMM), which reduces the dataset to a number of representative voltage topographies. The degree of presence of these topographies across trials at specific latencies is then used to classify experimental conditions. We tested the algorithm using a cross-validation procedure in two independent EEG datasets. In the first ERP study, we classified left- versus right-hemifield checkerboard stimuli for upper and lower visual hemifields. In a second ERP study, when functional differences cannot be assumed, we classified initial versus repeated presentations of visual objects. With minimal a priori information, the GMM model provides neurophysiologically interpretable features - vis à vis voltage topographies - as well as dynamic information about brain function. This method can in principle be applied to any ERP dataset testing the functional relevance of specific time periods for stimulus processing, the predictability of subject's behavior and cognitive states, and the discrimination between healthy and clinical populations.

Psychotherapeutic case conceptualization using plan analysis for bipolar affective disorder.

Valid individualized case conceptualization methodologies, such as plan analysis, are rarely used for the psychotherapeutic treatment conceptualization and planning of bipolar affective disorder (BD), even if data do exist showing that psychotherapy interventions might be enhanced by applying such analyses for treatment planning for several groups of patients. We applied plan analysis as a research tool (Caspar, 1995) to N=30 inpatients presenting BD, who were interviewed twice. Our study aimed at producing a prototypical plan structure encompassing the most relevant data from the 30 individual case conceptualizations. Special focus was given to links with emotions and coping plans. Inter-rater reliability of these plan analyses was considered sufficient. Results suggest the presence of two subtypes based on plananalytic principles: emotion control and relationship control, along with a mixed form. These subtypes are discussed with regard to inherent plananalytic conflicts, specific emotions and coping plans, as well as symptom level and type. Finally, conclusions are drawn for enhancing psychotherapeutic practice with BD patients, based on the motive-oriented therapeutic relationship.

Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment.

Multisensory interactions are observed in species from single-cell organisms to humans. Important early work was primarily carried out in the cat superior colliculus and a set of critical parameters for their occurrence were defined. Primary among these were temporal synchrony and spatial alignment of bisensory inputs. Here, we assessed whether spatial alignment was also a critical parameter for the temporally earliest multisensory interactions that are observed in lower-level sensory cortices of the human. While multisensory interactions in humans have been shown behaviorally for spatially disparate stimuli (e.g. the ventriloquist effect), it is not clear if such effects are due to early sensory level integration or later perceptual level processing. In the present study, we used psychophysical and electrophysiological indices to show that auditory-somatosensory interactions in humans occur via the same early sensory mechanism both when stimuli are in and out of spatial register. Subjects more rapidly detected multisensory than unisensory events. At just 50 ms post-stimulus, neural responses to the multisensory 'whole' were greater than the summed responses from the constituent unisensory 'parts'. For all spatial configurations, this effect followed from a modulation of the strength of brain responses, rather than the activation of regions specifically responsive to multisensory pairs. Using the local auto-regressive average source estimation, we localized the initial auditory-somatosensory interactions to auditory association areas contralateral to the side of somatosensory stimulation. Thus, multisensory interactions can occur across wide peripersonal spatial separations remarkably early in sensory processing and in cortical regions traditionally considered unisensory.

Respiratory responses associated with affective processing of film stimuli

We investigated respiratory responses during film clip viewing and their relation to the affective dimensions of valence and arousal. Seventy-six subjects participated in a study using a between groups design. To begin with, all participants viewed an emotionally neutral film clip. Then, they were presented with one out of four emotional film clips: a positive high-arousal, a positive low-arousal, a negative high-arousal and a negative low-arousal clip. Respiration, skin conductance level, heart rate, corrugator activity and affective judgments were measured. Expiratory time was shorter and inspiratory duty cycle, mean expiratory flow and minute ventilation were larger during the high-arousal clips compared to the low-arousal clips. The pleasantness of the stimuli had no influence on any respiratory measure. These findings confirm the importance of arousal in respiratory responding but also evidence differences in comparison to previous studies using visual and auditory stimuli. [Authors]