A blueprint for affective computing: A sourcebook

A Blueprint for Affective Computing: A sourcebook and manual is the very first attempt to ground affective computing within the disciplines of psychology, affective neuroscience, and philosophy. This book illustrates the contributions of each of these disciplines to the development of the ever-growing field of affective computing. In addition, it demonstrates practical examples of cross-fertilization between disciplines in order to highlight the need for integration of computer science, engineering and the affective sciences.

Cognitive influences on the affective representation of touch and the sight of touch in the human brain

We show that the affective experience of touch and the sight of touch can be modulated by cognition, and investigate in an fMRI study where top-down cognitive modulations of bottom-up somatosensory and visual processing of touch and its affective value occur in the human brain. The cognitive modulation was produced by word labels, 'Rich moisturizing cream' or 'Basic cream', while cream was being applied to the forearm, or was seen being applied to a forearm. The subjective pleasantness and richness were modulated by the word labels, as were the fMRI activations to touch in parietal cortex area 7, the insula and ventral striatum. The cognitive labels influenced the activations to the sight of touch and also the correlations with pleasantness in the pregenual cingulate/orbitofrontal cortex and ventral striatum. Further evidence of how the orbitofrontal cortex is involved in affective aspects of touch was that touch to the forearm [which has C fiber Touch (CT) afferents sensitive to light touch] compared with touch to the glabrous skin of the hand (which does not) revealed activation in the mid-orbitofrontal cortex. This is of interest as previous studies have suggested that the CT system is important in affiliative caress-like touch between individuals.

Aging is associated with positive responding to neutral information but reduced recovery from negative information

Studies on aging and emotion suggest an increase in reported positive affect, a processing bias of positive over negative information, as well as increasingly adaptive regulation in response to negative events with advancing age. These findings imply that older individuals evaluate information differently, resulting in lowered reactivity to, and/or faster recovery from, negative information, while maintaining more positive responding to positive information. We examined this hypothesis in an ongoing study on Midlife in the US (MIDUS II) where emotional reactivity and recovery were assessed in a large number of respondents (N = 159) from a wide age range (36–84 years). We recorded eye-blink startle magnitudes and corrugator activity during and after the presentation of positive, neutral and negative pictures. The most robust age effect was found in response to neutral stimuli, where increasing age is associated with a decreased corrugator and eyeblink startle response to neutral stimuli. These data suggest that an age-related positivity effect does not essentially alter the response to emotion-laden information, but is reflected in a more positive interpretation of affectively ambiguous information. Furthermore, older women showed reduced corrugator recovery from negative pictures relative to the younger women and men, suggesting that an age-related prioritization of well-being is not necessarily reflected in adaptive regulation of negative affect.

Temporal dynamics of emotional responding: amygdala recovery predicts emotional traits

An individual’s affective style is influenced by many things, including the manner in which an individual responds to an emotional challenge. Emotional response is composed of a number of factors, two of which are the initial reactivity to an emotional stimulus and the subsequent recovery once the stimulus terminates or ceases to be relevant. However, most neuroimaging studies examining emotional processing in humans focus on the magnitude of initial reactivity to a stimulus rather than the prolonged response. In this study, we use functional magnetic resonance imaging to study the time course of amygdala activity in healthy adults in response to presentation of negative images. We split the amygdala time course into an initial reactivity period and a recovery period beginning after the offset of the stimulus. We find that initial reactivity in the amygdala does not predict trait measures of affective style. Conversely, amygdala recovery shows predictive power such that slower amygdala recovery from negative images predicts greater trait neuroticism, in addition to lower levels of likability of a set of social stimuli (neutral faces). These data underscore the importance of taking into account temporal dynamics when studying affective processing using neuroimaging.

Sex differences in reward-related decision processing under stress

Recent research indicates gender differences in the impact of stress on decision behavior, but little is known about the brain mechanisms involved in these gender-specific stress effects. The current study used functional magnetic resonance imaging (fMRI) to determine whether induced stress resulted in gender-specific patterns of brain activation during a decision task involving monetary reward. Specifically, we manipulated physiological stress levels using a cold pressor task, prior to a risky decision making task. Healthy men (n = 24, 12 stressed) and women (n = 23, 11 stressed) completed the decision task after either cold pressor stress or a control task during the period of cortisol response to the cold pressor. Gender differences in behavior were present in stressed participants but not controls, such that stress led to greater reward collection and faster decision speed in males but less reward collection and slower decision speed in females. A gender-by-stress interaction was observed for the dorsal striatum and anterior insula. With cold stress, activation in these regions was increased in males but decreased in females. The findings of this study indicate that the impact of stress on reward-related decision processing differs depending on gender.

Autistic traits modulate frontostriatal connectivity during processing of rewarding faces

Deficits in facial mimicry have been widely reported in autism. Some studies have suggested that these deficits are restricted to spontaneous mimicry and do not extend to volitional mimicry. We bridge these apparently inconsistent observations, by testing the impact of reward value on neural indices of mimicry, and how autistic traits modulate this impact. Neutral faces were conditioned with high and low reward. Subsequently, functional connectivity between the ventral striatum (VS) and inferior frontal gyrus (IFG) was measured whilst neurotypical adults (n = 30) watched happy expressions made by these conditioned faces. We found greater VS-IFG connectivity in response to high-reward vs. low-reward happy faces. This difference was negatively proportional to autistic traits, suggesting that reduced spontaneous mimicry of social stimuli seen in autism, maybe related to a failure in the modulation of the mirror system by the reward system rather than a circumscribed deficit in the mirror system.

Emotional arousal amplifies the effects of biased competition in the brain

The arousal-biased competition model predicts that arousal increases the gain on neural competition between stimuli representations. Thus, the model predicts that arousal simultaneously enhances processing of salient stimuli and impairs processing of relatively less-salient stimuli. We tested this model with a simple dot-probe task. On each trial, participants were simultaneously exposed to one face image as a salient cue stimulus and one place image as a non-salient stimulus. A border around the face cue location further increased its bottom-up saliency. Before these visual stimuli were shown, one of two tones played: one that predicted a shock (increasing arousal) or one that did not. An arousal-by-saliency interaction in category-specific brain regions (fusiform face area for salient faces and parahippocampal place area for non-salient places) indicated that brain activation associated with processing the salient stimulus was enhanced under arousal whereas activation associated with processing the non-salient stimulus was suppressed under arousal. This is the first functional magnetic resonance imaging study to demonstrate that arousal can enhance information processing for prioritized stimuli while simultaneously impairing processing of non-prioritized stimuli. Thus, it goes beyond previous research to show that arousal does not uniformly enhance perceptual processing, but instead does so selectively in ways that optimizes attention to highly salient stimuli.

Prefrontal cortical-ventral striatal interactions involved in affective modulation of attentional performance: implications for corticostriatal circuit function

Anatomically segregated systems linking the frontal cortex and the striatum are involved in various aspects of cognitive, affective, and motor processing. In this study, we examined the effects of combined unilateral lesions of the medial prefrontal cortex (mPFC) and the core subregion of the nucleus accumbens (AcbC) in opposite hemispheres (disconnection) on a continuous performance, visual attention test [five-choice serial reaction-time task (5CSRTT)]. The disconnection lesion produced a set of specific changes in performance of the 5CSRTT, resembling changes that followed bilateral AcbC lesions while, in addition, comprising a subset of the behavioral changes after bilateral mPFC lesions previously reported using the same task. Specifically, both mPFC/AcbC disconnection and bilateral AcbC lesions markedly affected aspects of response control related to affective feedback, as indexed by perseverative responding in the 5CSRTT. These effects were comparable, although not identical, to those in animals with either bilateral AcbC or mPFC/AcbC disconnection lesions. The mPFC/AcbC disconnection resulted in a behavioral profile largely distinct from that produced by disconnection of a similar circuit described previously, between the mPFC and the dorsomedial striatum, which were shown to form a functional network underlying aspects of visual attention and attention to action. This distinction provides an insight into the functional specialization of corticostriatal circuits in similar behavioral contexts.

Neural response to emotional prosody in schizophrenia and in bipolar affective disorder

Background Evidence suggests a reversal of the normal left-lateralised response to speech in schizophrenia. Aims To test the brain's response to emotional prosody in schizophrenia and bipolar disorder. Method BOLD contrast functional magnetic resonance imaging of subjects while they passively listened or attended to sentences that differed in emotional prosody Results Patients with schizophrenia exhibited normal right-lateralisation of the passive response to 'pure' emotional prosody and relative left-lateralisation of the response to unfiltered emotional prosody When attending to emotional prosody, patients with schizophrenia activated the left insula more than healthy controls. When listening passively, patients with bipolar disorder demonstrated less activation of the bilateral superior temporal gyri in response to pure emotional prosody, and greater activation of the left superior temporal gyrus in response to unfiltered emotional prosody In both passive experiments, the patient groups activated different lateral temporal lobe regions. Conclusions Patients with schizophrenia and bipolar disorder may display some left-lateralisation of the normal right-lateralised temporal lobe response to emotional prosody. Declaration of interest R.M. received a studentship from Neuraxis,, and funding from the Neuroscience and Psychiatry Unit, University of Manchester.

Enhanced affective brain representations of chocolate in cravers vs. non-cravers

To examine the neural circuitry involved in food craving, in making food particularly appetitive and thus in driving wanting and eating, we used fMRI to measure the response to the flavour of chocolate, the sight of chocolate and their combination in cravers vs. non-cravers. Statistical parametric mapping (SPM) analyses showed that the sight of chocolate produced more activation in chocolate cravers than non-cravers in the medial orbitofrontal cortex and ventral striatum. For cravers vs. non-cravers, a combination of a picture of chocolate with chocolate in the mouth produced a greater effect than the sum of the components (i.e. supralinearity) in the medial orbitofrontal cortex and pregenual cingulate cortex. Furthermore, the pleasantness ratings of the chocolate and chocolate-related stimuli had higher positive correlations with the fMRI blood oxygenation level-dependent signals in the pregenual cingulate cortex and medial orbitofrontal cortex in the cravers than in the non-cravers. To our knowledge, this is the first study to show that there are differences between cravers and non-cravers in their responses to the sensory components of a craved food in the orbitofrontal cortex, ventral striatum and pregenual cingulate cortex, and that in some of these regions the differences are related to the subjective pleasantness of the craved foods. Understanding individual differences in brain responses to very pleasant foods helps in the understanding of the mechanisms that drive the liking for specific foods and thus intake of those foods.

Failure to regulate: counterproductive recruitment of top-down prefrontal-subcortical circuitry in major depression

Although depressed mood is a normal occurrence in response to adversity in all individuals, what distinguishes those who are vulnerable to major depressive disorder (MDD) is their inability to effectively regulate negative mood when it arises. Investigating the neural underpinnings of adaptive emotion regulation and the extent to which such processes are compromised in MDD may be helpful in understanding the pathophysiology of depression. We report results from a functional magnetic resonance imaging study demonstrating left-lateralized activation in the prefrontal cortex (PFC) when downregulating negative affect in nondepressed individuals, whereas depressed individuals showed bilateral PFC activation. Furthermore, during an effortful affective reappraisal task, nondepressed individuals showed an inverse relationship between activation in left ventrolateral PFC and the amygdala that is mediated by the ventromedial PFC (VMPFC). No such relationship was found for depressed individuals, who instead show a positive association between VMPFC and amygdala. Pupil dilation data suggest that those depressed patients who expend more effort to reappraise negative stimuli are characterized by accentuated activation in the amygdala, insula, and thalamus, whereas nondepressed individuals exhibit the opposite pattern. These findings indicate that a key feature underlying the pathophysiology of major depression is the counterproductive engagement of right prefrontal cortex and the lack of engagement of left lateral-ventromedial prefrontal circuitry important for the downregulation of amygdala responses to negative stimuli.

Perceived controllability modulates the neural response to pain

The response to painful stimulation depends not only on peripheral nociceptive input but also on the cognitive and affective context in which pain occurs. One contextual variable that affects the neural and behavioral response to nociceptive stimulation is the degree to which pain is perceived to be controllable. Previous studies indicate that perceived controllability affects pain tolerance, learning and motivation, and the ability to cope with intractable pain, suggesting that it has profound effects on neural pain processing. To date, however, no neuroimaging studies have assessed these effects. We manipulated the subjects' belief that they had control over a nociceptive stimulus, while the stimulus itself was held constant. Using functional magnetic resonance imaging, we found that pain that was perceived to be controllable resulted in attenuated activation in the three neural areas most consistently linked with pain processing: the anterior cingulate, insular, and secondary somatosensory cortices. This suggests that activation at these sites is modulated by cognitive variables, such as perceived controllability, and that pain imaging studies may therefore overestimate the degree to which these responses are stimulus driven and generalizable across cognitive contexts. [References: 28]

Amygdala and ventromedial prefrontal cortex are inversely coupled during regulation of negative affect and predict the diurnal pattern of cortisol secretion among older adults

Among younger adults, the ability to willfully regulate negative affect, enabling effective responses to stressful experiences, engages regions of prefrontal cortex (PFC) and the amygdala. Because regions of PFC and the amygdala are known to influence the hypothalamic-pituitary-adrenal axis, here we test whether PFC and amygdala responses during emotion regulation predict the diurnal pattern of salivary cortisol secretion. We also test whether PFC and amygdala regions are engaged during emotion regulation in older (62- to 64-year-old) rather than younger individuals. We measured brain activity using functional magnetic resonance imaging as participants regulated (increased or decreased) their affective responses or attended to negative picture stimuli. We also collected saliva samples for 1 week at home for cortisol assay. Consistent with previous work in younger samples, increasing negative affect resulted in ventral lateral, dorsolateral, and dorsomedial regions of PFC and amygdala activation. In contrast to previous work, decreasing negative affect did not produce the predicted robust pattern of higher PFC and lower amygdala activation. Individuals demonstrating the predicted effect (decrease s attend in the amygdala), however, exhibited higher signal in ventromedial prefrontal cortex (VMPFC) for the same contrast. Furthermore, participants displaying higher VMPFC and lower amygdala signal when decreasing compared with the attention control condition evidenced steeper, more normative declines in cortisol over the course of the day. Individual differences yielded the predicted link between brain function while reducing negative affect in the laboratory and diurnal regulation of endocrine activity in the home environment.