Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans.

This study investigated the neuromuscular mechanisms underlying the initial stage of adaptation to novel dynamics. A destabilizing velocity-dependent force field (VF) was introduced for sets of three consecutive trials. Between sets a random number of 4-8 null field trials were interposed, where the VF was inactivated. This prevented subjects from learning the novel dynamics, making it possible to repeatedly recreate the initial adaptive response. We were able to investigate detailed changes in neural control between the first, second and third VF trials. We identified two feedforward control mechanisms, which were initiated on the second VF trial and resulted in a 50% reduction in the hand path error. Responses to disturbances encountered on the first VF trial were feedback in nature, i.e. reflexes and voluntary correction of errors. However, on the second VF trial, muscle activation patterns were modified in anticipation of the effects of the force field. Feedforward cocontraction of all muscles was used to increase the viscoelastic impedance of the arm. While stiffening the arm, subjects also exerted a lateral force to counteract the perturbing effect of the force field. These anticipatory actions indicate that the central nervous system responds rapidly to counteract hitherto unfamiliar disturbances by a combination of increased viscoelastic impedance and formation of a crude internal dynamics model.

Striatal activity underlies novelty-based choice in humans.

The desire to seek new and unfamiliar experiences is a fundamental behavioral tendency in humans and other species. In economic decision making, novelty seeking is often rational, insofar as uncertain options may prove valuable and advantageous in the long run. Here, we show that, even when the degree of perceptual familiarity of an option is unrelated to choice outcome, novelty nevertheless drives choice behavior. Using functional magnetic resonance imaging (fMRI), we show that this behavior is specifically associated with striatal activity, in a manner consistent with computational accounts of decision making under uncertainty. Furthermore, this activity predicts interindividual differences in susceptibility to novelty. These data indicate that the brain uses perceptual novelty to approximate choice uncertainty in decision making, which in certain contexts gives rise to a newly identified and quantifiable source of human irrationality.

When fear is near: threat imminence elicits prefrontal-periaqueductal gray shifts in humans.

Humans, like other animals, alter their behavior depending on whether a threat is close or distant. We investigated spatial imminence of threat by developing an active avoidance paradigm in which volunteers were pursued through a maze by a virtual predator endowed with an ability to chase, capture, and inflict pain. Using functional magnetic resonance imaging, we found that as the virtual predator grew closer, brain activity shifted from the ventromedial prefrontal cortex to the periaqueductal gray. This shift showed maximal expression when a high degree of pain was anticipated. Moreover, imminence-driven periaqueductal gray activity correlated with increased subjective degree of dread and decreased confidence of escape. Our findings cast light on the neural dynamics of threat anticipation and have implications for the neurobiology of human anxiety-related disorders.

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Theories of instrumental learning are centred on understanding how success and failure are used to improve future decisions. These theories highlight a central role for reward prediction errors in updating the values associated with available actions. In animals, substantial evidence indicates that the neurotransmitter dopamine might have a key function in this type of learning, through its ability to modulate cortico-striatal synaptic efficacy. However, no direct evidence links dopamine, striatal activity and behavioural choice in humans. Here we show that, during instrumental learning, the magnitude of reward prediction error expressed in the striatum is modulated by the administration of drugs enhancing (3,4-dihydroxy-L-phenylalanine; L-DOPA) or reducing (haloperidol) dopaminergic function. Accordingly, subjects treated with L-DOPA have a greater propensity to choose the most rewarding action relative to subjects treated with haloperidol. Furthermore, incorporating the magnitude of the prediction errors into a standard action-value learning algorithm accurately reproduced subjects' behavioural choices under the different drug conditions. We conclude that dopamine-dependent modulation of striatal activity can account for how the human brain uses reward prediction errors to improve future decisions.

Cortical substrates for exploratory decisions in humans.

Decision making in an uncertain environment poses a conflict between the opposing demands of gathering and exploiting information. In a classic illustration of this 'exploration-exploitation' dilemma, a gambler choosing between multiple slot machines balances the desire to select what seems, on the basis of accumulated experience, the richest option, against the desire to choose a less familiar option that might turn out more advantageous (and thereby provide information for improving future decisions). Far from representing idle curiosity, such exploration is often critical for organisms to discover how best to harvest resources such as food and water. In appetitive choice, substantial experimental evidence, underpinned by computational reinforcement learning (RL) theory, indicates that a dopaminergic, striatal and medial prefrontal network mediates learning to exploit. In contrast, although exploration has been well studied from both theoretical and ethological perspectives, its neural substrates are much less clear. Here we show, in a gambling task, that human subjects' choices can be characterized by a computationally well-regarded strategy for addressing the explore/exploit dilemma. Furthermore, using this characterization to classify decisions as exploratory or exploitative, we employ functional magnetic resonance imaging to show that the frontopolar cortex and intraparietal sulcus are preferentially active during exploratory decisions. In contrast, regions of striatum and ventromedial prefrontal cortex exhibit activity characteristic of an involvement in value-based exploitative decision making. The results suggest a model of action selection under uncertainty that involves switching between exploratory and exploitative behavioural modes, and provide a computationally precise characterization of the contribution of key decision-related brain systems to each of these functions.

Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

The neural signature of escalating frustration in humans.

Mammalian studies show that frustration is experienced when goal-directed activity is blocked. Despite frustration's strongly negative role in health, aggression and social relationships, the neural mechanisms are not well understood. To address this we developed a task in which participants were blocked from obtaining a reward, an established method of producing frustration. Levels of experienced frustration were parametrically varied by manipulating the participants' motivation to obtain the reward prior to blocking. This was achieved by varying the participants' proximity to a reward and the amount of effort expended in attempting to acquire it. In experiment 1, we confirmed that proximity and expended effort independently enhanced participants' self-reported desire to obtain the reward, and their self-reported frustration and response vigor (key-press force) following blocking. In experiment 2, we used functional magnetic resonance imaging (fMRI) to show that both proximity and expended effort modulated brain responses to blocked reward in regions implicated in animal models of reactive aggression, including the amygdala, midbrain periaqueductal grey (PAG), insula and prefrontal cortex. Our findings suggest that frustration may serve an energizing function, translating unfulfilled motivation into aggressive-like surges via a cortical, amygdala and PAG network.

Metabolite and transcriptome analysis of Campylobacter jejuni in vitro growth reveals a stationary-phase physiological switch.

Campylobacter jejuni is a prevalent cause of food-borne diarrhoeal illness in humans. Understanding of the physiological and metabolic capabilities of the organism is limited. We report a detailed analysis of the C. jejuni growth cycle in batch culture. Combined transcriptomic, phenotypic and metabolic analysis demonstrates a highly dynamic 'stationary phase', characterized by a peak in motility, numerous gene expression changes and substrate switching, despite transcript changes that indicate a metabolic downshift upon the onset of stationary phase. Video tracking of bacterial motility identifies peak activity during stationary phase. Amino acid analysis of culture supernatants shows a preferential order of amino acid utilization. Proton NMR (1H-NMR) highlights an acetate switch mechanism whereby bacteria change from acetate excretion to acetate uptake, most probably in response to depletion of other substrates. Acetate production requires pta (Cj0688) and ackA (Cj0689), although the acs homologue (Cj1537c) is not required. Insertion mutants in Cj0688 and Cj0689 maintain viability less well during the stationary and decline phases of the growth cycle than wild-type C. jejuni, suggesting that these genes, and the acetate pathway, are important for survival.

Bacterial growth rate and host factors as determinants of intracellular bacterial distributions in systemic Salmonella enterica infections.

Bacteria of the species Salmonella enterica cause a range of life-threatening diseases in humans and animals worldwide. The within-host quantitative, spatial, and temporal dynamics of S. enterica interactions are key to understanding how immunity acts on these infections and how bacteria evade immune surveillance. In this study, we test hypotheses generated from mathematical models of in vivo dynamics of Salmonella infections with experimental observation of bacteria at the single-cell level in infected mouse organs to improve our understanding of the dynamic interactions between host and bacterial mechanisms that determine net growth rates of S. enterica within the host. We show that both bacterial and host factors determine the numerical distributions of bacteria within host cells and thus the level of dispersiveness of the infection.

Electrical and optical spectroscopy for quantitative screening of hepatic steatosis in donor livers.

Macro-steatosis in deceased donor livers is increasingly prevalent and is associated with poor or non-function of the liver upon reperfusion. Current assessment of the extent of steatosis depends upon the macroscopic assessment of the liver by the surgeon and histological examination, if available. In this paper we demonstrate electrical and optical spectroscopy techniques which quantitatively characterize fatty infiltration in liver tissue. Optical spectroscopy showed a correlation coefficient of 0.85 in humans when referenced to clinical hematoxylin and eosin (H&E) sections in 20 human samples. With further development, an optical probe may provide a comprehensive measure of steatosis across the liver at the time of procurement.

In vivo regulation of the Vi antigen in Salmonella and induction of immune responses with an in vivo-inducible promoter.

Salmonella enterica serovar Typhi, the agent of typhoid fever in humans, expresses the surface Vi polysaccharide antigen that contributes to virulence. However, Vi expression can also be detrimental to some key steps of S. Typhi infectivity, for example, invasion, and Vi is the target of protective immune responses. We used a strain of S. Typhimurium carrying the whole Salmonella pathogenicity island 7 (SPI-7) to monitor in vivo Vi expression within phagocytic cells of mice at different times after systemic infection. We also tested whether it is possible to modulate Vi expression via the use of in vivo-inducible promoters and whether this would trigger anti-Vi antibodies through the use of Vi-expressing live bacteria. Our results show that Vi expression in the liver and spleen is downregulated with the progression of infection and that the Vi-negative population of bacteria becomes prevalent by day 4 postinfection. Furthermore, we showed that replacing the natural tviA promoter with the promoter of the SPI-2 gene ssaG resulted in sustained Vi expression in the tissues. Intravenous or oral infection of mice with a strain of S. Typhimurium expressing Vi under the control of the ssaG promoter triggered detectable levels of all IgG subclasses specific for Vi. Our work highlights that Vi is downregulated in vivo and provides proof of principle that it is possible to generate a live attenuated vaccine that induces Vi-specific antibodies after single oral administration.