Social perception and cognition : processing of gestures, postures and facial expressions in the human brain

Humans are a social species with the internal capability to process social information from other humans. To understand others behavior and to react accordingly, it is necessary to infer their internal states, emotions and aims, which are conveyed by subtle nonverbal bodily cues such as postures, gestures, and facial expressions. This thesis investigates the brain functions underlying the processing of such social information. Studies I and II of this thesis explore the neural basis of perceiving pain from another person s facial expressions by means of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). In Study I, observing another s facial expression of pain activated the affective pain system (previously associated with self-experienced pain) in accordance with the intensity of the observed expression. The strength of the response in anterior insula was also linked to the observer s empathic abilities. The cortical processing of facial pain expressions advanced from the visual to temporal-lobe areas at similar latencies (around 300 500 ms) to those previously shown for emotional expressions such as fear or disgust. Study III shows that perceiving a yawning face is associated with middle and posterior STS activity, and the contagiousness of a yawn correlates negatively with amygdalar activity. Study IV explored the brain correlates of interpreting social interaction between two members of the same species, in this case human and canine. Observing interaction engaged brain activity in very similar manner for both species. Moreover, the body and object sensitive brain areas of dog experts differentiated interaction from noninteraction in both humans and dogs whereas in the control subjects, similar differentiation occurred only for humans. Finally, Study V shows the engagement of the brain area associated with biological motion when exposed to the sounds produced by a single human being walking. However, more complex pattern of activation, with the walking sounds of several persons, suggests that as the social situation becomes more complex so does the brain response. Taken together, these studies demonstrate the roles of distinct cortical and subcortical brain regions in the perception and sharing of others internal states via facial and bodily gestures, and the connection of brain responses to behavioral attributes.

Human brain mechanisms of auditory and audiovisual selective attention

Selective attention refers to the process in which certain information is actively selected for conscious processing, while other information is ignored. The aim of the present studies was to investigate the human brain mechanisms of auditory and audiovisual selective attention with functional magnetic resonance imaging (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). The main focus was on attention-related processing in the auditory cortex. It was found that selective attention to sounds strongly enhances auditory cortex activity associated with processing the sounds. In addition, the amplitude of this attention-related modulation was shown to increase with the presentation rate of attended sounds. Attention to the pitch of sounds and to their location appeared to enhance activity in overlapping auditory-cortex regions. However, attention to location produced stronger activity than attention to pitch in the temporo-parietal junction and frontal cortical regions. In addition, a study on bimodal attentional selection found stronger audiovisual than auditory or visual attention-related modulations in the auditory cortex. These results were discussed in light of Näätänen s attentional-trace theory and other research concerning the brain mechanisms of selective attention.

Human brain networks of auditory attention and working memory

This thesis examines brain networks involved in auditory attention and auditory working memory using measures of task performance, brain activity, and neuroanatomical connectivity. Auditory orienting and maintenance of attention were compared with visual orienting and maintenance of attention, and top-down controlled attention was compared to bottom-up triggered attention in audition. Moreover, the effects of cognitive load on performance and brain activity were studied using an auditory working memory task. Corbetta and Shulman s (2002) model of visual attention suggests that what is known as the dorsal attention system (intraparietal sulcus/superior parietal lobule, IPS/SPL and frontal eye field, FEF) is involved in the control of top-down controlled attention, whereas what is known as the ventral attention system (temporo-parietal junction, TPJ and areas of the inferior/middle frontal gyrus, IFG/MFG) is involved in bottom-up triggered attention. The present results show that top-down controlled auditory attention also activates IPS/SPL and FEF. Furthermore, in audition, TPJ and IFG/MFG were activated not only by bottom-up triggered attention, but also by top-down controlled attention. In addition, the posterior cerebellum and thalamus were activated by top-down controlled attention shifts and the ventromedial prefrontal cortex (VMPFC) was activated by to-be-ignored, but attention-catching salient changes in auditory input streams. VMPFC may be involved in the evaluation of environmental events causing the bottom-up triggered engagement of attention. Auditory working memory activated a brain network that largely overlapped with the one activated by top-down controlled attention. The present results also provide further evidence of the role of the cerebellum in cognitive processing: During auditory working memory tasks, both activity in the posterior cerebellum (the crus I/II) and reaction speed increased when the cognitive load increased. Based on the present results and earlier theories on the role of the cerebellum in cognitive processing, the function of the posterior cerebellum in cognitive tasks may be related to the optimization of response speed.

Processing of Stimulus Repetition and Change in the Somatosensory System: Recordings of Electrical and Magnetic Brain Responses

In the present work, effects of stimulus repetition and change in a continuous stimulus stream on the processing of somatosensory information in the human brain were studied. Human scalp-recorded somatosensory event-related potentials (ERPs) and magnetoencephalographic (MEG) responses rapidly diminished with stimulus repetition when mechanical or electric stimuli were applied to fingers. On the contrary, when the ERPs and multi-unit a ctivity (MUA) were directly recorded from the primary (SI) and secondary (SII) somatosensory cortices in a monkey, there was no marked decrement in the somatosensory responses as a function of stimulus repetition. These results suggest that this rate effect is not due to the response diminution in the SI and SII cortices. Obviously the responses to the first stimulus after a long "silent" period are nhanced due to unspecific initial orientation, originating in more broadly distributed and/or deeper neural structures, perhaps in the prefrontal cortices. With fast repetition rates not only the late unspecific but also some early specific somatosensory ERPs were diminished in amplitude. The fast decrease of the ERPs as a function of stimulus repetition is mainly due to the disappearance of the orientation effect and with faster repetition rates additively due to stimulus specific refractoriness. A sudden infrequent change in the continuous stimulus stream also enhanced somatosensory MEG responses to electric stimuli applied to different fingers. These responses were quite similar to those elicited by the deviant stimuli alone when the frequent standard stimuli were omitted. This enhancement was obviously due to the release from refractoriness because the neural structures generating the responses to the infrequent deviants had more time to recover from the refractoriness than the respective structures for the standards. Infrequent deviant mechanical stimuli among frequent standard stimuli also enhanced somatosensory ERPs and, in addition, they elicited a new negative wave which did not occur in the deviants-alone condition. This extra negativity could be recorded to deviations in the stimulation site and in the frequency of the vibratory stimuli. This response is probably a somatosensory analogue of the auditory mismatch negativity (MMN) which has been suggested to reflect a neural mismatch process between the sensory input and the sensory memory trace.

Developmental, functional brain imaging and electrophysiological evidence of visual and auditory working memory

Intact function of working memory (WM) is essential for children and adults to cope with every day life. Children with deficits in WM mechanisms have learning difficulties that are often accompanied by behavioral problems. The neural processes subserving WM, and brain structures underlying this system, continue to develop during childhood till adolescence and young adulthood. With functional magnetic resonance imaging (fMRI) it is possible to investigate the organization and development of WM. The present thesis aimed to investigate, using behavioral and neuroimaging methods, whether mnemonic processing of spatial and nonspatial visual information is segregated in the developing and mature human brain. A further aim in this research was to investigate the organization and development of audiospatial and visuospatial information processing in WM. The behavioral results showed that spatial and nonspatial visual WM processing is segregated in the adult brain. The fMRI result in children suggested that memory load related processing of spatial and nonspatial visual information engages common cortical networks, whereas selective attention to either type of stimuli recruits partially segregated areas in the frontal, parietal and occipital cortices. Deactivation mechanisms that are important in the performance of WM tasks in adults are already operational in healthy school-aged children. Electrophysiological evidence suggested segregated mnemonic processing of visual and auditory location information. The results of the development of audiospatial and visuospatial WM demonstrate that WM performance improves with age, suggesting functional maturation of underlying cognitive processes and brain areas. The development of the performance of spatial WM tasks follows a different time course in boys and girls indicating a larger degree of immaturity in the male than female WM systems. Furthermore, the differences in mastering auditory and visual WM tasks may indicate that visual WM reaches functional maturity earlier than the corresponding auditory system. Spatial WM deficits may underlie some learning difficulties and behavioral problems related to impulsivity, difficulties in concentration, and hyperactivity. Alternatively, anxiety or depressive symptoms may affect WM function and the ability to concentrate, being thus the primary cause of poor academic achievement in children.

Functional imaging of peripheral vision and dorsal stream function in the human cerebral cortex

Visual information processing in brain proceeds in both serial and parallel fashion throughout various functionally distinct hierarchically organised cortical areas. Feedforward signals from retina and hierarchically lower cortical levels are the major activators of visual neurons, but top-down and feedback signals from higher level cortical areas have a modulating effect on neural processing. My work concentrates on visual encoding in hierarchically low level cortical visual areas in human brain and examines neural processing especially in cortical representation of visual field periphery. I use magnetoencephalography and functional magnetic resonance imaging to measure neuromagnetic and hemodynamic responses during visual stimulation and oculomotor and cognitive tasks from healthy volunteers. My thesis comprises six publications. Visual cortex forms a great challenge for modeling of neuromagnetic sources. My work shows that a priori information of source locations are needed for modeling of neuromagnetic sources in visual cortex. In addition, my work examines other potential confounding factors in vision studies such as light scatter inside the eye which may result in erroneous responses in cortex outside the representation of stimulated region, and eye movements and attention. I mapped cortical representations of peripheral visual field and identified a putative human homologue of functional area V6 of the macaque in the posterior bank of parieto-occipital sulcus. My work shows that human V6 activates during eye-movements and that it responds to visual motion at short latencies. These findings suggest that human V6, like its monkey homologue, is related to fast processing of visual stimuli and visually guided movements. I demonstrate that peripheral vision is functionally related to eye-movements and connected to rapid stream of functional areas that process visual motion. In addition, my work shows two different forms of top-down modulation of neural processing in the hierachically lowest cortical levels; one that is related to dorsal stream activation and may reflect motor processing or resetting signals that prepare visual cortex for change in the environment and another local signal enhancement at the attended region that reflects local feed-back signal and may perceptionally increase the stimulus saliency.

Neuromagnetic studies on cortical somatosensory functions in infants and children : Normal development and effect of early brain lesions

Until recently, objective investigation of the functional development of the human brain in vivo was challenged by the lack of noninvasive research methods. Consequently, fairly little is known about cortical processing of sensory information even in healthy infants and children. Furthermore, mechanisms by which early brain insults affect brain development and function are poorly understood. In this thesis, we used magnetoencephalography (MEG) to investigate development of cortical somatosensory functions in healthy infants, very premature infants at risk for neurological disorders, and adolescents with hemiplegic cerebral palsy (CP). In newborns, stimulation of the hand activated both the contralateral primary (SIc) and secondary somatosensory cortices (SIIc). The activation patterns differed from those of adults, however. Some of the earliest SIc responses, constantly present in adults, were completely lacking in newborns and the effect of sleep stage on SIIc responses differed. These discrepancies between newborns and adults reflect the still developmental stage of the newborns’ somatosensory system. Its further maturation was demonstrated by a systematic transformation of the SIc response pattern with age. The main early adult­like components were present by age two. In very preterm infants, at term age, the SIc and SIIc were activated at similar latencies as in healthy fullterm newborns, but the SIc activity was weaker in the preterm group. The SIIc response was absent in four out of the six infants with brain lesions of the underlying hemisphere. Determining the prognostic value of this finding remains a subject for future studies, however. In the CP adolescents with pure subcortical lesions, contrasting their unilateral symptoms, the SIc responses of both hemispheres differed from those of controls: For example the distance between SIc representation areas for digits II and V was shorter bilaterally. In four of the five CP patients with cortico­subcortical brain lesions, no normal early SIc responses were evoked by stimulation of the palsied hand. The varying differences in neuronal functions, underlying the common clinical symptoms, call for investigation of more precisely designed rehabilitation strategies resting on knowledge about individual functional alterations in the sensorimotor networks.

Tactile processing in human somatosensory and auditory cortices

Tactile sensation plays an important role in everyday life. While the somatosensory system has been studied extensively, the majority of information has come from studies using animal models. Recent development of high-resolution anatomical and functional imaging techniques has enabled the non-invasive study of human somatosensory cortex and thalamus. This thesis provides new insights into the functional organization of the human brain areas involved in tactile processing using magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI). The thesis also demonstrates certain optimizations of MEG and fMRI methods. Tactile digit stimulation elicited stimulus-specific responses in a number of brain areas. Contralateral activation was observed in somatosensory thalamus (Study II), primary somatosensory cortex (SI; I, III, IV), and post-auditory belt area (III). Bilateral activation was observed in secondary somatosensory cortex (SII; II, III, IV). Ipsilateral activation was found in the post-central gyrus (area 2 of SI cortex; IV). In addition, phasic deactivation was observed within ipsilateral SI cortex and bilateral primary motor cortex (IV). Detailed investigation of the tactile responses demonstrated that the arrangement of distal-proximal finger representations in area 3b of SI in humans is similar to that found in monkeys (I). An optimized MEG approach was sufficient to resolve such fine detail in functional organization. The SII region appeared to contain double representations for fingers and toes (II). The detection of activations in the SII region and thalamus improved at the individual and group levels when cardiac-gated fMRI was used (II). Better detection of body part representations at the individual level is an important improvement, because identification of individual representations is crucial for studying brain plasticity in somatosensory areas. The posterior auditory belt area demonstrated responses to both auditory and tactile stimuli (III), implicating this area as a physiological substrate for the auditory-tactile interaction observed in earlier psychophysical studies. Comparison of different smoothing parameters (III) demonstrated that proper evaluation of co-activation should be based on individual subject analysis with minimal or no smoothing. Tactile input consistently influenced area 3b of the human ipsilateral SI cortex (IV). The observed phasic negative fMRI response is proposed to result from interhemispheric inhibition via trans-callosal connections. This thesis contributes to a growing body of human data suggesting that processing of tactile stimuli involves multiple brain areas, with different spatial patterns of cortical activation for different stimuli.

The Functions and Regulation of Ornithine Decarboxylase

Ornithine decarboxylase (ODC) regulates the synthesis of polyamines which are involved in many cellular functions e.g. proliferation and differentiation. Due to its critical role, ODC is a tightly regulated enzyme by antizymes and antizyme inhibitors. If the regulation fails, the activity of ODC increases and may lead to malignant transformation of a cell. Increased ODC activity is found in many common cancers, including colon, prostate, and breast cancer. In a transformed cell, dynamics of the actin cytoskeleton is disturbed. A small G-protein, RhoA regulates organization of the cytoskeleton, and its overactivity increases malignant potential of the cell. The present results indicate that covalent attachment of polyamines by transglutaminase is a physiological means of regulating the activity of RhoA. The translocation of RhoA to the plasma membrane, where it exerts its activity is dependent on the presence of catalytically active ODC. As the overactivity of ODC and RhoA are implicated in cell transformation, the results provide a mechanistic explanation of the interrelationship between the polyamine metabolism and the reorganization of the actin cytoskeleton occurring in cancer cells. ODC and polyamines have also an important role in the function of central nervous system. They participate in the regulation of brain morphogenesis in embryos. In adult nervous tissue, polyamines regulate K+ and glutamate channels. K+ inward rectifying channels control membrane potentials and NMDA-type glutamate receptors (NMDAR) regulate synaptic plasticity. High ODC activity and polyamine levels are considered important in the development of ischemic brain damage and they are implicated in the pathogenesis of Alzheimer s disease (AD). A homolog of ODC was cloned from a human brain cDNA library, and several alternatively spliced variants were detected in human brain and testis. The novel protein was nevertheless devoid of ODC catalytic activity. It was subsequently found to be a novel inductor of ODC activity and polyamine synthesis, called antizyme inhibitor 2 (AZIN2). The accumulation of AZIN2 in vesicle-like formations along the axons and beneath the plasma membrane of neurons as well as in steroid hormone producing Leydig cells and luteal cells of the gonads implies that AZIN2 plays a role in secretion and vesicle trafficking. An accumulation of AZIN2 was detected also in specimens of AD brains. This increased expression of AZIN2 was specific for AD and was not found in brains with other neurodegenerative diseases including CADASIL or dementia with Lewy bodies.

A Probabilistic Approach to the Primary Visual Cortex

What can the statistical structure of natural images teach us about the human brain? Even though the visual cortex is one of the most studied parts of the brain, surprisingly little is known about how exactly images are processed to leave us with a coherent percept of the world around us, so we can recognize a friend or drive on a crowded street without any effort. By constructing probabilistic models of natural images, the goal of this thesis is to understand the structure of the stimulus that is the raison d etre for the visual system. Following the hypothesis that the optimal processing has to be matched to the structure of that stimulus, we attempt to derive computational principles, features that the visual system should compute, and properties that cells in the visual system should have. Starting from machine learning techniques such as principal component analysis and independent component analysis we construct a variety of sta- tistical models to discover structure in natural images that can be linked to receptive field properties of neurons in primary visual cortex such as simple and complex cells. We show that by representing images with phase invariant, complex cell-like units, a better statistical description of the vi- sual environment is obtained than with linear simple cell units, and that complex cell pooling can be learned by estimating both layers of a two-layer model of natural images. We investigate how a simplified model of the processing in the retina, where adaptation and contrast normalization take place, is connected to the nat- ural stimulus statistics. Analyzing the effect that retinal gain control has on later cortical processing, we propose a novel method to perform gain control in a data-driven way. Finally we show how models like those pre- sented here can be extended to capture whole visual scenes rather than just small image patches. By using a Markov random field approach we can model images of arbitrary size, while still being able to estimate the model parameters from the data.

Dynamics of contour, object and face processing in the human visual cortex

The neural basis of visual perception can be understood only when the sequence of cortical activity underlying successful recognition is known. The early steps in this processing chain, from retina to the primary visual cortex, are highly local, and the perception of more complex shapes requires integration of the local information. In Study I of this thesis, the progression from local to global visual analysis was assessed by recording cortical magnetoencephalographic (MEG) responses to arrays of elements that either did or did not form global contours. The results demonstrated two spatially and temporally distinct stages of processing: The first, emerging 70 ms after stimulus onset around the calcarine sulcus, was sensitive to local features only, whereas the second, starting at 130 ms across the occipital and posterior parietal cortices, reflected the global configuration. To explore the links between cortical activity and visual recognition, Studies II III presented subjects with recognition tasks of varying levels of difficulty. The occipito-temporal responses from 150 ms onwards were closely linked to recognition performance, in contrast to the 100-ms mid-occipital responses. The averaged responses increased gradually as a function of recognition performance, and further analysis (Study III) showed the single response strengths to be graded as well. Study IV addressed the attention dependence of the different processing stages: Occipito-temporal responses peaking around 150 ms depended on the content of the visual field (faces vs. houses), whereas the later and more sustained activity was strongly modulated by the observers attention. Hemodynamic responses paralleled the pattern of the more sustained electrophysiological responses. Study V assessed the temporal processing capacity of the human object recognition system. Above sufficient luminance, contrast and size of the object, the processing speed was not limited by such low-level factors. Taken together, these studies demonstrate several distinct stages in the cortical activation sequence underlying the object recognition chain, reflecting the level of feature integration, difficulty of recognition, and direction of attention.

Sleep deprivation and brain energy metabolism : in vivo studies in rats and humans

Sleep deprivation leads to increased subsequent sleep length and depth and to deficits in cognitive performance in humans. In animals extreme sleep deprivation is eventually fatal. The cellular and molecular mechanisms causing the symptoms of sleep deprivation are unclear. This thesis was inspired by the hypothesis that during wakefulness brain energy stores would be depleted, and they would be replenished during sleep. The aim of this thesis was to elucidate the energy metabolic processes taking place in the brain during sleep deprivation. Endogenous brain energy metabolite levels were assessed in vivo in rats and in humans in four separate studies (Studies I-IV). In the first part (Study I) the effects of local energy depletion on brain energy metabolism and sleep were studied in rats with the use of in vivo microdialysis combined with high performance liquid chromatography. Energy depletion induced by 2,4-dinitrophenol infusion into the basal forebrain was comparable to the effects of sleep deprivation: both increased extracellular concentrations of adenosine, lactate, and pyruvate, and elevated subsequent sleep. This result supports the hypothesis of a connection between brain energy metabolism and sleep. The second part involved healthy human subjects (Studies II-IV). Study II aimed to assess the feasibility of applying proton magnetic resonance spectroscopy (1H MRS) to study brain lactate levels during cognitive stimulation. Cognitive stimulation induced an increase in lactate levels in the left inferior frontal gyrus, showing that metabolic imaging of neuronal activity related to cognition is possible with 1H MRS. Study III examined the effects of sleep deprivation and aging on the brain lactate response to cognitive stimulation. No physiologic, cognitive stimulation-induced lactate response appeared in the sleep-deprived and in the aging subjects, which can be interpreted as a sign of malfunctioning of brain energy metabolism. This malfunctioning may contribute to the functional impairment of the frontal cortex both during aging and sleep deprivation. Finally (Study IV), 1H MRS major metabolite levels in the occipital cortex were assessed during sleep deprivation and during photic stimulation. N-acetyl-aspartate (NAA/H2O) decreased during sleep deprivation, supporting the hypothesis of sleep deprivation-induced disturbance in brain energy metabolism. Choline containing compounds (Cho/H2O) decreased during sleep deprivation and recovered to alert levels during photic stimulation, pointing towards changes in membrane metabolism, and giving support to earlier observations of altered brain response to stimulation during sleep deprivation. Based on these findings, it can be concluded that sleep deprivation alters brain energy metabolism. However, the effects of sleep deprivation on brain energy metabolism may vary from one brain area to another. Although an effect of sleep deprivation might not in all cases be detectable in the non-stimulated baseline state, a challenge imposed by cognitive or photic stimulation can reveal significant changes. It can be hypothesized that brain energy metabolism during sleep deprivation is more vulnerable than in the alert state. Changes in brain energy metabolism may participate in the homeostatic regulation of sleep and contribute to the deficits in cognitive performance during sleep deprivation.