The Silent Period of Evidence Integration in Fast Decision Making

In a typical experiment on decision making, one out of two possible stimuli is displayed and observers decide which one was presented. Recently, Stanford and colleagues (2010) introduced a new variant of this classical one-stimulus presentation paradigm to investigate the speed of decision making. They found evidence for "perceptual decision making in less than 30 ms". Here, we extended this one-stimulus compelled-response paradigm to a two-stimulus compelled-response paradigm in which a vernier was followed immediately by a second vernier with opposite offset direction. The two verniers and their offsets fuse. Only one vernier is perceived. When observers are asked to indicate the offset direction of the fused vernier, the offset of the second vernier dominates perception. Even for long vernier durations, the second vernier dominates decisions indicating that decision making can take substantial time. In accordance with previous studies, we suggest that our results are best explained with a two-stage model of decision making where a leaky evidence integration stage precedes a race-to-threshold process. © 2013 Rüter et al.

Serotonin selectively modulates reward value in human decision-making.

Establishing a function for the neuromodulator serotonin in human decision-making has proved remarkably difficult because if its complex role in reward and punishment processing. In a novel choice task where actions led concurrently and independently to the stochastic delivery of both money and pain, we studied the impact of decreased brain serotonin induced by acute dietary tryptophan depletion. Depletion selectively impaired both behavioral and neural representations of reward outcome value, and hence the effective exchange rate by which rewards and punishments were compared. This effect was computationally and anatomically distinct from a separate effect on increasing outcome-independent choice perseveration. Our results provide evidence for a surprising role for serotonin in reward processing, while illustrating its complex and multifarious effects.

A genetically mediated bias in decision making driven by failure of amygdala control.

Genetic variation at the serotonin transporter-linked polymorphic region (5-HTTLPR) is associated with altered amygdala reactivity and lack of prefrontal regulatory control. Similar regions mediate decision-making biases driven by contextual cues and ambiguity, for example the "framing effect." We hypothesized that individuals hemozygous for the short (s) allele at the 5-HTTLPR would be more susceptible to framing. Participants, selected as homozygous for either the long (la) or s allele, performed a decision-making task where they made choices between receiving an amount of money for certain and taking a gamble. A strong bias was evident toward choosing the certain option when the option was phrased in terms of gains and toward gambling when the decision was phrased in terms of losses (the frame effect). Critically, this bias was significantly greater in the ss group compared with the lala group. In simultaneously acquired functional magnetic resonance imaging data, the ss group showed greater amygdala during choices made in accord, compared with those made counter to the frame, an effect not seen in the lala group. These differences were also mirrored by differences in anterior cingulate-amygdala coupling between the genotype groups during decision making. Specifically, lala participants showed increased coupling during choices made counter to, relative to those made in accord with, the frame, with no such effect evident in ss participants. These data suggest that genetically mediated differences in prefrontal-amygdala interactions underpin interindividual differences in economic decision making.

Frames, biases, and rational decision-making in the human brain.

Human choices are remarkably susceptible to the manner in which options are presented. This so-called "framing effect" represents a striking violation of standard economic accounts of human rationality, although its underlying neurobiology is not understood. We found that the framing effect was specifically associated with amygdala activity, suggesting a key role for an emotional system in mediating decision biases. Moreover, across individuals, orbital and medial prefrontal cortex activity predicted a reduced susceptibility to the framing effect. This finding highlights the importance of incorporating emotional processes within models of human choice and suggests how the brain may modulate the effect of these biasing influences to approximate rationality.

Visualising a stochastic model of California Water Resources Using Sankey Diagrams

This paper describes a novel approach to the analysis of supply and demand of water in California. A stochastic model is developed to assess the future supply of and demand for water resources in California. The results are presented in the form of a Sankey diagram where present and stochastically-varying future fluxes of water in California and its sub-regions are traced from source to services by mapping the various transformations of water from when it is first made available for use, through its treatment, recycling and reuse, to its eventual loss in a variety of sinks. This helps to highlight the connections of water with energy and land resources, including the amount of energy used to pump and treat water, the amount of water used for energy production, and the land resources that create a water demand to produce crops for food. By mapping water in this way, policy-makers can more easily understand the competing uses of water, through the identification of the services it delivers (e.g. sanitation, food production, landscaping), the potential opportunities for improving themanagement of the resource and the connections with other resources which are often overlooked in a traditional sector-based management strategy. This paper focuses on a Sankey diagram for water, but the ultimate aim is the visualisation of linked resource futures through inter-connected Sankey diagrams for energy, land and water, tracking changes from the basic resources for all three, their transformations, and the final services they provide.

Global analysis of dynamical decision-making models through local computation around the hidden saddle

Bistable dynamical switches are frequently encountered in mathematical modeling of biological systems because binary decisions are at the core of many cellular processes. Bistable switches present two stable steady-states, each of them corresponding to a distinct decision. In response to a transient signal, the system can flip back and forth between these two stable steady-states, switching between both decisions. Understanding which parameters and states affect this switch between stable states may shed light on the mechanisms underlying the decision-making process. Yet, answering such a question involves analyzing the global dynamical (i.e., transient) behavior of a nonlinear, possibly high dimensional model. In this paper, we show how a local analysis at a particular equilibrium point of bistable systems is highly relevant to understand the global properties of the switching system. The local analysis is performed at the saddle point, an often disregarded equilibrium point of bistable models but which is shown to be a key ruler of the decision-making process. Results are illustrated on three previously published models of biological switches: two models of apoptosis, the programmed cell death and one model of long-term potentiation, a phenomenon underlying synaptic plasticity. © 2012 Trotta et al.

Delayed decision-making in bistable models

Switching between two modes of operation is a common property of biological systems. In continuous-time differential equation models, this is often realised by bistability, i.e. the existence of two asymptotically stable steadystates. Several biological models are shown to exhibit delayed switching, with a pronounced transient phase, in particular for near-threshold perturbations. This study shows that this delay in switching from one mode to the other in response to a transient input is reflected in local properties of an unstable saddle point, which has a one dimensional unstable manifold with a significantly slower eigenvalue than the stable ones. Thus, the trajectories first approximatively converge to the saddle point, then linger along the saddle's unstable manifold before quickly approaching one of the stable equilibria. ©2010 IEEE.

Motor control is decision-making

© 2012 Elsevier Ltd. Motor behavior may be viewed as a problem of maximizing the utility of movement outcome in the face of sensory, motor and task uncertainty. Viewed in this way, and allowing for the availability of prior knowledge in the form of a probability distribution over possible states of the world, the choice of a movement plan and strategy for motor control becomes an application of statistical decision theory. This point of view has proven successful in recent years in accounting for movement under risk, inferring the loss function used in motor tasks, and explaining motor behavior in a wide variety of circumstances.

Bayesian Learning of Noisy Markov Decision Processes

We consider the inverse reinforcement learning problem, that is, the problem of learning from, and then predicting or mimicking a controller based on state/action data. We propose a statistical model for such data, derived from the structure of a Markov decision process. Adopting a Bayesian approach to inference, we show how latent variables of the model can be estimated, and how predictions about actions can be made, in a unified framework. A new Markov chain Monte Carlo (MCMC) sampler is devised for simulation from the posterior distribution. This step includes a parameter expansion step, which is shown to be essential for good convergence properties of the MCMC sampler. As an illustration, the method is applied to learning a human controller.

Obtaining bifurcation diagrams with a thermoacoustic network model

Linear techniques can predict whether the non-oscillating (steady) state of a thermoacoustic system is stable or unstable. With a sufficiently large impulse, however, a thermoacoustic system can reach a stable oscillating state even when the steady state is also stable. A nonlinear analysis is required to predict the existence of this oscillating state. Continuation methods are often used for this but they are computationally expensive. In this paper, an acoustic network code called LOTAN is used to obtain the steady and the oscillating solutions for a horizontal Rijke tube. The heat release is modelled as a nonlinear function of the mass flow rate. Several test cases from the literature are analysed in order to investigate the effect of various nonlinear terms in the flame model. The results agree well with the literature, showing that LOTAN can be used to map the steady and oscillating solutions as a function of the control parameters. Furthermore, the nature of the bifurcation between steady and oscillating states can be predicted directly from the nonlinear terms inside the flame model. Copyright © 2012 by ASME.

Inclusive design and the bottom line: How can its value be proven to decision makers?

Designing technology products that embrace the needs and capabilities of heterogeneous users leads not only to increased customer satisfaction and enhanced corporate social responsibility, but also better market penetration. Yet, achieving inclusion in today's pressured and fast-moving markets is not straight-forward. For a time, inaccessible and unusable design was solely seen as the fault of designers and a whole line of research was dedicated to pinpointing their frailties. More recently, it has become progressively more recognised that it is not necessarily designers' lack of awareness, or unwillingness, that results in sub-optimal design, but rather there are multi-faceted organisational factors at play that seldom provide an adequate environment in which inclusive products could be designed. Through literature review, a detailed audit of inclusivity practice in a large global company and ongoing research regarding quantification of cost-effectiveness of inclusive design, this paper discusses the overarching operational problems that prevent organisations from developing optimally inclusive products and offers best-practice principles for the future. © 2013 Springer-Verlag Berlin Heidelberg.

Interactive multi-objective particle swarm optimisation using decision space interaction

The most common approach to decision making in multi-objective optimisation with metaheuristics is a posteriori preference articulation. Increased model complexity and a gradual increase of optimisation problems with three or more objectives have revived an interest in progressively interactive decision making, where a human decision maker interacts with the algorithm at regular intervals. This paper presents an interactive approach to multi-objective particle swarm optimisation (MOPSO) using a novel technique to preference articulation based on decision space interaction and visual preference articulation. The approach is tested on a 2D aerofoil design case study and comparisons are drawn to non-interactive MOPSO. © 2013 IEEE.