Neural and computational representations of decision variables

These studies explore how, where, and when representations of variables critical to decision-making are represented in the brain. In order to produce a decision, humans must first determine the relevant stimuli, actions, and possible outcomes before applying an algorithm that will select an action from those available. When choosing amongst alternative stimuli, the framework of value-based decision-making proposes that values are assigned to the stimuli and that these values are then compared in an abstract “value space” in order to produce a decision. Despite much progress, in particular regarding the pinpointing of ventromedial prefrontal cortex (vmPFC) as a region that encodes the value, many basic questions remain. In Chapter 2, I show that distributed BOLD signaling in vmPFC represents the value of stimuli under consideration in a manner that is independent of the type of stimulus it is. Thus the open question of whether value is represented in abstraction, a key tenet of value-based decision-making, is confirmed. However, I also show that stimulus-dependent value representations are also present in the brain during decision-making and suggest a potential neural pathway for stimulus-to-value transformations that integrates these two results.

More broadly speaking, there is both neural and behavioral evidence that two distinct control systems are at work during action selection. These two systems compose the “goal-directed system”, which selects actions based on an internal model of the environment, and the “habitual” system, which generates responses based on antecedent stimuli only. Computational characterizations of these two systems imply that they have different informational requirements in terms of input stimuli, actions, and possible outcomes. Associative learning theory predicts that the habitual system should utilize stimulus and action information only, while goal-directed behavior requires that outcomes as well as stimuli and actions be processed. In Chapter 3, I test whether areas of the brain hypothesized to be involved in habitual versus goal-directed control represent the corresponding theorized variables.

The question of whether one or both of these neural systems drives Pavlovian conditioning is less well-studied. Chapter 4 describes an experiment in which subjects were scanned while engaged in a Pavlovian task with a simple non-trivial structure. After comparing a variety of model-based and model-free learning algorithms (thought to underpin goal-directed and habitual decision-making, respectively), it was found that subjects’ reaction times were better explained by a model-based system. In addition, neural signaling of precision, a variable based on a representation of a world model, was found in the amygdala. These data indicate that the influence of model-based representations of the environment can extend even to the most basic learning processes.

Knowledge of the state of hidden variables in an environment is required for optimal inference regarding the abstract decision structure of a given environment and therefore can be crucial to decision-making in a wide range of situations. Inferring the state of an abstract variable requires the generation and manipulation of an internal representation of beliefs over the values of the hidden variable. In Chapter 5, I describe behavioral and neural results regarding the learning strategies employed by human subjects in a hierarchical state-estimation task. In particular, a comprehensive model fit and comparison process pointed to the use of "belief thresholding". This implies that subjects tended to eliminate low-probability hypotheses regarding the state of the environment from their internal model and ceased to update the corresponding variables. Thus, in concert with incremental Bayesian learning, humans explicitly manipulate their internal model of the generative process during hierarchical inference consistent with a serial hypothesis testing strategy.

Essays in Behavioral Decision Theory

This thesis studies decision making under uncertainty and how economic agents respond to information. The classic model of subjective expected utility and Bayesian updating is often at odds with empirical and experimental results; people exhibit systematic biases in information processing and often exhibit aversion to ambiguity. The aim of this work is to develop simple models that capture observed biases and study their economic implications.

In the first chapter I present an axiomatic model of cognitive dissonance, in which an agent's response to information explicitly depends upon past actions. I introduce novel behavioral axioms and derive a representation in which beliefs are directionally updated. The agent twists the information and overweights states in which his past actions provide a higher payoff. I then characterize two special cases of the representation. In the first case, the agent distorts the likelihood ratio of two states by a function of the utility values of the previous action in those states. In the second case, the agent's posterior beliefs are a convex combination of the Bayesian belief and the one which maximizes the conditional value of the previous action. Within the second case a unique parameter captures the agent's sensitivity to dissonance, and I characterize a way to compare sensitivity to dissonance between individuals. Lastly, I develop several simple applications and show that cognitive dissonance contributes to the equity premium and price volatility, asymmetric reaction to news, and belief polarization.

The second chapter characterizes a decision maker with sticky beliefs. That is, a decision maker who does not update enough in response to information, where enough means as a Bayesian decision maker would. This chapter provides axiomatic foundations for sticky beliefs by weakening the standard axioms of dynamic consistency and consequentialism. I derive a representation in which updated beliefs are a convex combination of the prior and the Bayesian posterior. A unique parameter captures the weight on the prior and is interpreted as the agent's measure of belief stickiness or conservatism bias. This parameter is endogenously identified from preferences and is easily elicited from experimental data.

The third chapter deals with updating in the face of ambiguity, using the framework of Gilboa and Schmeidler. There is no consensus on the correct way way to update a set of priors. Current methods either do not allow a decision maker to make an inference about her priors or require an extreme level of inference. In this chapter I propose and axiomatize a general model of updating a set of priors. A decision maker who updates her beliefs in accordance with the model can be thought of as one that chooses a threshold that is used to determine whether a prior is plausible, given some observation. She retains the plausible priors and applies Bayes' rule. This model includes generalized Bayesian updating and maximum likelihood updating as special cases.

The changing chemical composition of chalk streams and rivers

The area studied was the River Frome system below Dorchester. The main river has its origins mainly in chalk springs, although some of its tributaries have surface run-off from farm lands and heath-lands. Thus the chemistry of the river is affected by changes in land practice and differences in the geology of the catchment area. Regular chemical analysis of chalk waters started at the River Laboratory in 1964, Regular weekly analyses have been carried out since 1965 at Bere Stream (a small chalk stream) and the River Frome (a large chalk stream); also single samples have been analysed to provide preliminary information. In 1970-71 an attempt was made to discover the contribution each main source made to the flow and chemical composition of the River Frome. Results of these investigations are presented in the paper.

Stationary Eddies and Zonal Variations of the Global Hydrological Cycle in a Changing Climate

This thesis advances our physical understanding of the sensitivity of the hydrological cycle to global warming. Specifically, it focuses on changes in the longitudinal (zonal) variation of precipitation minus evaporation (P - E), which is predominantly controlled by planetary-scale stationary eddies. By studying idealized general circulation model (GCM) experiments with zonally varying boundary conditions, this thesis examines the mechanisms controlling the strength of stationary-eddy circulations and their role in the hydrological cycle. The overarching goal of this research is to understand the cause of changes in regional P - E with global warming. An understanding of such changes can be useful for impact studies focusing on water availability, ecosystem management, and flood risk.

Based on a moisture-budget analysis of ERA-Interim data, we establish an approximation for zonally anomalous P - E in terms of surface moisture content and stationary-eddy vertical motion in the lower troposphere. Part of the success of this approximation comes from our finding that transient-eddy moisture fluxes partially cancel the effect of stationary-eddy moisture advection, allowing divergent circulations to dominate the moisture budget. The lower-tropospheric vertical motion is related to horizontal motion in stationary eddies by Sverdrup and Ekman balance. These moisture- and vorticity-budget balances also hold in idealized and comprehensive GCM simulations across a range of climates.

By examining climate changes in the idealized and comprehensive GCM simulations, we are able to show the utility of the vertical motion P - E approximation for splitting changes in zonally anomalous P - E into thermodynamic and dynamic components. Shifts in divergent stationary-eddy circulations dominate changes in zonally anomalous P - E. This limits the local utility of the "wet gets wetter, dry gets drier” idea, where existing P - E patterns are amplified with warming by the increase in atmospheric moisture content, with atmospheric circulations held fixed. The increase in atmospheric moisture content manifests instead in an increase in the amplitude of the zonally anomalous hydrological cycle as measured by the zonal variance of P - E. However, dynamic changes, particularly the slowdown of divergent stationary-eddy circulations, limit the strengthening of the zonally anomalous hydrological cycle. In certain idealized cases, dynamic changes are even strong enough to reverse the tendency towards "wet gets wetter, dry gets drier” with warming.

Motivated by the importance of stationary-eddy vertical velocities in the moisture budget analysis, we examine controls on the amplitude of stationary eddies across a wide range of climates in an idealized GCM with simple topographic and ocean-heating zonal asymmetries. An analysis of the thermodynamic equation in the vicinity of topographic forcing reveals the importance of on-slope surface winds, the midlatitude isentropic slope, and latent heating in setting the amplitude of stationary waves. The response of stationary eddies to climate change is determined primarily by the strength of zonal surface winds hitting the mountain. The sensitivity of stationary-eddies to this surface forcing increases with climate change as the slope of midlatitude isentropes decreases. However, latent heating also plays an important role in damping the stationary-eddy response, and this damping becomes stronger with warming as the atmospheric moisture content increases. We find that the response of tropical overturning circulations forced by ocean heat-flux convergence is described by changes in the vertical structure of moist static energy and deep convection. This is used to derive simple scalings for the Walker circulation strength that capture the monotonic decrease with warming found in our idealized simulations.

Through the work of this thesis, the advances made in understanding the amplitude of stationary-waves in a changing climate can be directly applied to better understand and predict changes in the zonally anomalous hydrological cycle.

Probability in Quantum Mechanics: The Everett Interpretation and the Decision-Theoretic Program

The Everett interpretation of quantum mechanics is an increasingly popular alternative to the traditional Copenhagen interpretation, but there are a few major issues that prevent the widespread adoption. One of these issues is the origin of probabilities in the Everett interpretation, which this thesis will attempt to survey. The most successful resolution of the probability problem thus far is the decision-theoretic program, which attempts to frame probabilities as outcomes of rational decision making. This marks a departure from orthodox interpretations of probabilities in the physical sciences, where probabilities are thought to be objective, stemming from symmetry considerations. This thesis will attempt to offer evaluations on the decision-theoretic program.

Monica Alis Brick Lane: A tale of two cities or How Nazneen left her fate

O objetivo desta dissertação é analisar o romance Brick Lane (2003), da escritora Monica Ali, focalizando o processo de empoderamento da protagonista Nazneen. Usando os conceitos de lugar e não-lugar propostos por Marc Augé, pretendo examinar passagens do romance que caracterizem a sensação de não-pertencimento vivida pela personagem. Nazneen recorre às memórias de sua infância com a irmã Hasina em Bangladesh para tentar se distanciar do espaço físico de Brick Lane (a comunidade onde reside em Londres), que se constitui em um não-lugar, pois ali não é possível reconstruir sua identidade fragmentada pelo deslocamento de uma cultura para outra. Considerando aspectos históricos e culturais de Bangladesh, terra natal de Nazneen, este trabalho pretende discutir as experiências da protagonista e de outros sujeitos diaspóricos do romance, além de analisar o papel crucial que Hasina (e suas cartas) desempenham na narrativa. O atual contexto multicultural e cosmopolita da cidade de Londres também será investigado, com a discussão de situações que afetam os imigrantes e suas representações no romance. Esta dissertação também considera o caráter gendrado dos movimentos migratórios contemporâneos que possibilitam novas perspectivas acerca das consequências da diáspora. A análise de passagens selecionadas do romance ratifica o processo gradual de autonomia de Nazneen que, por fim, consegue se sentir em casa novamente

Design and implementation of a cloud computing adoption decision tool: Generating a cloud road

Migrating to cloud computing is one of the current enterprise challenges. This technology provides a new paradigm based on "on-demand payment" for information and communication technologies. In this sense, the small and medium enterprise is supposed to be the most interested, since initial investments are avoided and the technology allows gradual implementation. However, even if the characteristics and capacities have been widely discussed, entry into the cloud is still lacking in terms of practical, real frameworks. This paper aims at filling this gap, presenting a real tool already implemented and tested, which can be used as a cloud computing adoption decision tool. This tool uses diagnosis based on specific questions to gather the required information and subsequently provide the user with valuable information to deploy the business within the cloud, specifically in the form of Software as a Service (SaaS) solutions. This information allows the decision makers to generate their particular Cloud Road. A pilot study has been carried out with enterprises at a local level with a two-fold objective: To ascertain the degree of knowledge on cloud computing and to identify the most interesting business areas and their related tools for this technology. As expected, the results show high interest and low knowledge on this subject and the tool presented aims to readdress this mismatch, insofar as possible. Copyright: © 2015 Bildosola et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Elements of Decision under Uncertainty with Applications

This work presents the basic elements for the analysis of decision under uncertainty: Expected Utility Theory and its citicisms and risk aversion and its measurement. The concepts of certainty equivalent, risk premium, absolute risk aversion and relative risk aversion, and the "more risk averse than" relation are discussed. The work is completed with several applications of decision making under uncertainty to different economic problems: investment in risky assets and portfolio selection, risk sharing, investment to reduce risk, insurance, taxes and income underreporting, deposit insurance and the value of information.