Essays on the Analysis of Dynamic Games

Thesis (Ph.D.)--University of Washington, 2016-06

On Limits to the Use of Linear Markov Strategies in Common Property Natural Resource Games

We derive conditions that must be satisfied by the primitives of the problem in order for an equilibrium in linear Markov strategies to exist in some common property natural resource differential games. These conditions impose restrictions on the admissible form of the natural growth function, given a benefit function, or on the admissible form of the benefit function, given a natural growth function.

Dynamic coordination among heterogeneous agents

We study a dynamic model of coordination with timing frictions and payoff heterogeneity. There is a unique equilibrium, characterized by thresholds that determine the choices of each type of agent. We characterize equilibrium for the limiting cases of vanishing timing frictions and vanishing shocks to fundamentals. A lot of conformity emerges: despite payoff heterogeneity, agents’ equilibrium thresholds partially coincide as long as there exists a set of beliefs that would make this coincidence possible – though they never fully coincide. In case of vanishing frictions, the economy behaves almost as if all agents were equal to an average type. Conformity is not inefficient. The efficient solution would have agents following others even more often and giving less importance to the fundamental

Financial Policies and Dynamic Game Simulation in Poland and Hungary

Recently, steady economic growth rates have been kept in Poland and Hungary. Money supplies are growing rather rapidly in these economies. In large, exchange rates have trends of depreciation. Then, exports and prices show the steady growth rates. It can be thought that per capita GDPs are in the same level and development stages are similar in these two countries. It is assumed that these two economies have the same export market and export goods are competing in it. If one country has an expansion of monetary policy, price increase and interest rate decrease. Then, exchange rate decrease. Exports and GDP will increase through this phenomenon. At the same time, this expanded monetary policy affects another country through the trade. This mutual relationship between two countries can be expressed by the Nash-equilibrium in the Game theory. In this paper, macro-econometric models of Polish and Hungarian economies are built and the Nash- equilibrium is introduced into them.

The Ghost in the Machine: Inferring Machine-Based Strategies from Observed Behavior

We introduce a procedure to infer the repeated-game strategies that generate actions in experimental choice data. We apply the technique to set of experiments where human subjects play a repeated Prisoner's Dilemma. The technique suggests that two types of strategies underly the data.

Cooperative of Noncooperative Behavior?

In an abstract two-agent model, we show that every deterministic joint choice function compatible with the hypothesis that agents act noncooperatively is also compatible with the hypothesis that they act cooperatively. the converse is false.

The Effects of the Length of the Period of Commitment on the Size of Stable International Environmental Agreements

This paper extends the standard model of self-enforcing dynamic international environmental agreements by allowing the length of the period of commitment of such agreements to vary as a parameter. It analyzes the pattern of behavior of the size of stable coalitions, the stock of pollutant and the emission rate as a function of the length of the period of commitment. It is shown that the length of the period of commitment can have very significant effects on the equilibrium. Three distinct intervals for the length of the period of commitment are identified, across which the equilibrium and its dynamic behavior differ considerably. Whereas for sufficiently high values of the period of commitment only self-enforcing agreements of two countries are possible, for sufficiently low such values full cooperation can be generated. Lengths of periods of commitment between those two thresholds are characterized by an inverse relationship between the length of commitment and the membership size of the agreement. This suggests that considerable attention should be given to the determination of the length of such international agreements.

The Quest for Hegemony Among Countries and Global Pollution

This paper builds on the assumption that countries behave in such a way as to improve, via their economic strength, the probability that they will attain the hegemonic position on the world stage. The quest for hegemony is modeled as a game, with countries being differentiated initially only by some endowment which yields a pollution free flow of income. A country's level of pollution is assumed directly related to its economic strength, as measured by its level of production. Two types of countries are distinguished: richly-endowed countries, for whom the return on their endowment is greater than the return they can expect from winning the hegemony race, and poorly-endowed countries, who can expect a greater return from winning the race than from their endowment. We show that in a symmetric world of poorly-endowed countries the equilibrium level of emissions is larger than in a symmetric world of richly-endowed countries: the former, being less well endowed to begin with, try harder to win the race. In the asymmetric world composed of both types of countries, the poorly-endowed countries will be polluting more than the richly endowed countries. Numerical simulations show that if the number of richly-endowed countries is increased keeping the total number of countries constant, the equilibrium level of global emissions will decrease; if the lot of the poorly-endowed countries is increased by increasing their initial endowment keeping that of the richly-endowed countries constant, global pollution will decrease; increasing the endowments of each type of countries in the same proportion, and hence increasing the average endowment in that proportion, will decrease global pollution; redistributing from the richly-endowed in favor of the poorly-endowed while keeping the average endowment constant will in general result in an increase in the equilibrium level of global pollution.

Essais sur des questions internationales en économie de l'environnement

Cette thèse est constituée de trois articles. Le premier étudie le problème de pollution globale dans un contexte environnemental incertain. Le deuxième article traite des accords internationaux sur l'environnement. Le troisième article montre comment la libéralisation du commerce peut affecter le bien-être et les taxes sur la pollution dans un monde où les pays sont hétérogènes et la pollution transfrontalière. Dans le premier article, je considère un monde dans lequel les pays souffrent uniformément de la pollution globale. Ils font face à une menace continuelle de voir les dommages causés par cette pollution globale s'accroître subitement de façon irréversible. Je caractérise le niveau des émissions, le stock de pollution, et le niveau de bien-être actualisé en équilibres coopératif et non-coopératif. L'objectif visé est d'analyser l'impact de ce type d'incertitude sur les équilibres issus des comportements stratégiques des pays. Je trouve que cette incertitude peut avoir un effet significatif sur ces équilibres. Les pays réduisent leurs émissions pour atténuer leur exposition à cette menace. Plus la menace est grande, plus les pays ajustent leurs émissions afin de réduire le stock de pollution globale. Cependant, en dépit du fait que cette incertitude diminue le bien-être net initial, elle peut à long terme avoir un effet net positif sur le bien-être. Le deuxième article étend la classe des modèles dynamiques standards traitant des accords internationaux sur l'environnement au cas où la durée de la période d'engagement à de tels accords est un paramètre que l'on peut varier de façon exogène. Nous y étudions les évolutions dans le temps de la taille des coalitions stables, du stock de pollution et du taux d'émissions en fonction de la durée d'engagement. Nous montrons que la longueur de la période d'engagement a un effet très significatif sur l'équilibre. Trois intervalles de durée d'engagement sont identifiés pour lesquels l'équilibre et sa dynamique diffèrent considérablement. Alors que pour des durées de la période d'engagement très longues on observe des coalitions stables constituées d'un petit nombre de pays, si ces durées sont suffisamment courtes on peut observer un niveau de coopération élevé. Les durées d'engagement entre ces deux extrêmes sont caractérisées par une relation inverse entre la durée de la période d'engagement et la taille des coalitions stables. Ces faits portent à croire qu'il faudrait accorder une attention toute particulière au choix de la durée d'engagement lors de l'élaboration de tels accords internationaux. Le troisième article s'inscrit dans un contexte où les activités de production des pays potentiellement hétérogènes génèrent de la pollution qui peut traverser les frontières et nuire au bien-être des pays impliqués. Dans chacun de ces pays, l'état impose des taxes sur la pollution aux firmes polluantes et des tarifs à l'importation afin de corriger cette distorsion. Ce papier a pour but d'évaluer les effets que pourrait avoir une diminution des tarifs douaniers sur la production, les taxes sur la pollution et le bien-être de ces pays. La littérature existante a étudié ce problème, mais seulement dans le cadre d'un commerce bilatéral entre pays identiques. Cet article fournit un cadre d'analyse plus réaliste dans lequel les pays ne seront pas nécessairement identiques et où le commerce pourra être multilatéral. Il devient alors possible de mettre en évidence le biais introduit en négligeant ces deux facteurs. Dans ce nouveau contexte, je montre qu'une réduction des tarifs d'importation n'augmente pas nécessairement la production; elle peut aussi nuire au bien-être, même si la pollution est purement locale.

On the Effects of Mergers on Equilibrium Outcomes in a Common Property Renewable Asset Oligopoly

This paper examines a dynamic game of exploitation of a common pool of some renewable asset by agents that sell the result of their exploitation on an oligopolistic market. A Markov Perfect Nash Equilibrium of the game is used to analyze the effects of a merger of a subset of the agents. We study the impact of the merger on the equilibrium production strategies, on the steady states, and on the profitability of the merger for its members. We show that there exists an interval of the asset's stock such that any merger is profitable if the stock at the time the merger is formed falls within that interval. That includes mergers that are known to be unprofitable in the corresponding static equilibrium framework.

Low expectations, low demand : when should the government intervene?

Este trabalho estuda o impacto de diferentes políticas que procuram mitigar falhas de coordenação em um ambiente macroeconômico. Abordamos questões relativas ao timing dos estímulos econômicos. Quando o governo deveria começar a incentivar a economia? Deveria gastar mais para prevenir crises ou para tirar a economia da recessão quando os fundamentos estão melhorando? Como o estímulo deve alterar a complementaridade estratégica? Para responder a estas perguntas, construímos um modelo macroeconômico dinâmico com concorrência monopolística e decisões de investimento sequenciais. Aplicando resultados da literatura teórica de jogos dinâmicos com fricções, selecionamos um único equilíbrio neste modelo, nos dando um instrumental tratável para a análise de políticas. Nossos resultados sugerem que o governo não deveria viesar incentivos nem para a prevenção de crises nem para resgatar a economia quando esta já está em crise.

Foundations of macroeconomic policy coordination: fostering dialogue as a policy tool in Latin America

Includes bibliography

Essays on coordination problems in economics

No estudo da economia, há diversas situações em que a propensão de um indivíduo a tomar determinada ação é crescente na quantidade de outras pessoas que este indivíduo acredita que tomarão a mesma ação. Esse tipo de complementaridade estratégica geralmente leva à existência de múltiplos equilíbrios. Além disso, o resultado atingido pelas decisões decentralizadas dos agentes pode ser ineficiente, deixando espaço para intervenções de política econômica. Esta tese estuda diferentes ambientes em que a coordenação entre indivíduos é importante. O primeiro capítulo analisa como a manipulação de informação e a divulgação de informação afetam a coordenação entre investidores e o bem-estar em um modelo de corridas bancárias. No modelo, há uma autoridade reguladora que não pode se comprometer a revelar a verdadeira situação do setor bancário. O regulador observa informações idiossincráticas dos bancos (através de um stress test, por exemplo) e escolhe se revela essa informação para o público ou se divulga somente um relatório agregado sobre a saúde do sistema financeiro como um todo. O relatório agregado pode ser distorcido a um custo – um custo mais elevado significa maior credibilidade do regulador. Os investidores estão cientes dos incentivos do regulador a esconder más notícias do mercado, mas a manipulação de informação pode, ainda assim, ser efetiva. Se a credibilidade do regulador não for muito baixa, a política de divulgação de informação é estado-contingente, e existe sempre um conjunto de estados em que há manipulação de informação em equilíbrio. Se a credibilidade for suficientemente baixa, porém, o regulador opta por transparência total dos resultados banco-específicos, caso em que somente os bancos mais sólidos sobrevivem. Uma política de opacidade levaria a uma crise bancária sistêmica, independentemente do estado. O nível de credibilidade que maximiza o bem-estar agregado do ponto de vista ex ante é interior. O segundo e o terceiro capítulos estudam problemas de coordenação dinâmicos. O segundo capítulo analisa o bem-estar em um ambiente em que agentes recebem oportunidades aleatórias para migrar entre duas redes. Os resultados mostram que sempre que a rede de pior qualidade (intrínseca) prevalece, isto é eficiente. Na verdade, um planejador central estaria ainda mais inclinado a escolher a rede de pior qualidade. Em equilíbrio, pode haver mudanças ineficientes que ampliem a rede de qualidade superior. Quando indivíduos escolhem entre dois padrões ou redes com níveis de qualidade diferentes, se todos os indivíduos fizessem escolhas simultâneas, a solução eficiente seria que todos adotassem a rede de melhor qualidade. No entanto, quando há fricções e os agentes tomam decisões escalonadas, a solução eficiente difere ix do senso comum. O terceiro capítulo analisa um problema de coordenação dinâmico com decisões escalonadas em que os agentes são heterogêneos ex ante. No modelo, existe um único equilíbrio, caracterizado por thresholds que determinam as escolhas para cada tipo de agente. Apesar da heterogeneidade nos payoffs, há bastante conformidade nas ações individuais em equilíbrio. Os thresholds de diferentes tipos de agentes coincidem parcialmente contanto que exista um conjunto de crenças arbitrário que justifique esta conformidade. No entanto, as estratégias de equilíbrio de diferentes tipos nunca coincidem totalmente. Além disso, a conformidade não é ineficiente. A solução eficiente apresentaria estratégias ainda mais similares para tipos distintos em comparação com o equilíbrio decentralizado.

Agent-orientated auction mechanism and strategy design

Agent-based technology is playing an increasingly important role in today’s economy. Usually a multi-agent system is needed to model an economic system such as a market system, in which heterogeneous trading agents interact with each other autonomously. Two questions often need to be answered regarding such systems: 1) How to design an interacting mechanism that facilitates efficient resource allocation among usually self-interested trading agents? 2) How to design an effective strategy in some specific market mechanisms for an agent to maximise its economic returns? For automated market systems, auction is the most popular mechanism to solve resource allocation problems among their participants. However, auction comes in hundreds of different formats, in which some are better than others in terms of not only the allocative efficiency but also other properties e.g., whether it generates high revenue for the auctioneer, whether it induces stable behaviour of the bidders. In addition, different strategies result in very different performance under the same auction rules. With this background, we are inevitably intrigued to investigate auction mechanism and strategy designs for agent-based economics. The international Trading Agent Competition (TAC) Ad Auction (AA) competition provides a very useful platform to develop and test agent strategies in Generalised Second Price auction (GSP). AstonTAC, the runner-up of TAC AA 2009, is a successful advertiser agent designed for GSP-based keyword auction. In particular, AstonTAC generates adaptive bid prices according to the Market-based Value Per Click and selects a set of keyword queries with highest expected profit to bid on to maximise its expected profit under the limit of conversion capacity. Through evaluation experiments, we show that AstonTAC performs well and stably not only in the competition but also across a broad range of environments. The TAC CAT tournament provides an environment for investigating the optimal design of mechanisms for double auction markets. AstonCAT-Plus is the post-tournament version of the specialist developed for CAT 2010. In our experiments, AstonCAT-Plus not only outperforms most specialist agents designed by other institutions but also achieves high allocative efficiencies, transaction success rates and average trader profits. Moreover, we reveal some insights of the CAT: 1) successful markets should maintain a stable and high market share of intra-marginal traders; 2) a specialist’s performance is dependent on the distribution of trading strategies. However, typical double auction models assume trading agents have a fixed trading direction of either buy or sell. With this limitation they cannot directly reflect the fact that traders in financial markets (the most popular application of double auction) decide their trading directions dynamically. To address this issue, we introduce the Bi-directional Double Auction (BDA) market which is populated by two-way traders. Experiments are conducted under both dynamic and static settings of the continuous BDA market. We find that the allocative efficiency of a continuous BDA market mainly comes from rational selection of trading directions. Furthermore, we introduce a high-performance Kernel trading strategy in the BDA market which uses kernel probability density estimator built on historical transaction data to decide optimal order prices. Kernel trading strategy outperforms some popular intelligent double auction trading strategies including ZIP, GD and RE in the continuous BDA market by making the highest profit in static games and obtaining the best wealth in dynamic games.