Stochastic uncoupled dynamics and Nash equilibrium

In this paper we consider dynamic processes, in repeated games, that are subject to the natural informational restriction of uncoupledness. We study the almost sure convergence to Nash equilibria, and present a number of possibility and impossibility results. Basically, we show that if in addition to random moves some recall is introduced, then successful search procedures that are uncoupled can be devised. In particular, to get almost sure convergence to pure Nash equilibria when these exist, it su±ces to recall the last two periods of play.

Stochastic evolution of rules for playing normal form games

The evolution of boundedly rational rules for playing normal form games is studied within stationary environments ofstochastically changing games. Rules are viewed as algorithms prescribing strategies for the different normal formgames that arise. It is shown that many of the folk results of evolutionary game theory typically obtained witha fixed game and fixed strategies carry over to the present case. The results are also related to recent experimentson rules and games.

Global Nash convergence of Foster and Young's regret testing

We construct an uncoupled randomized strategy of repeated play such that, if every player follows such a strategy, then the joint mixed strategy profiles converge, almost surely, to a Nash equilibrium of the one-shot game. The procedure requires very little in terms of players' information about the game. In fact, players' actions are based only on their own past payoffs and, in a variant of the strategy, players need not even know that their payoffs are determined through other players' actions. The procedure works for general finite games and is based on appropriate modifications of a simple stochastic learningrule introduced by Foster and Young.

Long-run selection and the work ethic

That individuals contribute in social dilemma interactions even when contributing is costly is a well-established observation in the experimental literature. Since a contributor is always strictly worse off than a non-contributor the question is raised if an intrinsic motivation to contribute can survive in an evolutionary setting. Using recent results on deterministic approximation of stochastic evolutionary dynamics we give conditions for equilibria with a positive number of contributors to be selected in the long run.

A class of stochastic games with infinitely many interacting agents related to Glauber dynamics on random graphs

We introduce and study a class of infinite-horizon nonzero-sum non-cooperative stochastic games with infinitely many interacting agents using ideas of statistical mechanics. First we show, in the general case of asymmetric interactions, the existence of a strategy that allows any player to eliminate losses after a finite random time. In the special case of symmetric interactions, we also prove that, as time goes to infinity, the game converges to a Nash equilibrium. Moreover, assuming that all agents adopt the same strategy, using arguments related to those leading to perfect simulation algorithms, spatial mixing and ergodicity are proved. In turn, ergodicity allows us to prove “fixation”, i.e. that players will adopt a constant strategy after a finite time. The resulting dynamics is related to zerotemperature Glauber dynamics on random graphs of possibly infinite volume.

Improving the effort concept: a revision of the traditional approach in the context of controlled Dynamic Stochastic Environments

The objective of this paper is to re-evaluate the attitude to effort of a risk-averse decision-maker in an evolving environment. In the classic analysis, the space of efforts is generally discretized. More realistic, this new approach emploies a continuum of effort levels. The presence of multiple possible efforts and performance levels provides a better basis for explaining real economic phenomena. The traditional approach (see, Laffont, J. J. & Tirole, J., 1993, Salanie, B., 1997, Laffont, J.J. and Martimort, D, 2002, among others) does not take into account the potential effect of the system dynamics on the agent's behavior to effort over time. In the context of a Principal-agent relationship, not only the incentives of the Principal can determine the private agent to allocate a good effort, but also the evolution of the dynamic system. The incentives can be ineffective when the environment does not incite the agent to invest a good effort. This explains why, some effici

Modelling of bird distribution under complex mediterranean landscape dynamics: open habitat birds and fire (MEDFIRE)

Report for the scientific sojourn at the Simon Fraser University, Canada, from July to September 2007. General context: landscape change during the last years is having significant impacts on biodiversity in many Mediterranean areas. Land abandonment, urbanisation and specially fire are profoundly transforming large areas in the Western Mediterranean basin and we know little on how these changes influence species distribution and in particular how these species will respond to further change in a context of global change including climate. General objectives: integrate landscape and population dynamics models in a platform allowing capturing species distribution responses to landscape changes and assessing impact on species distribution of different scenarios of further change. Specific objective 1: develop a landscape dynamic model capturing fire and forest succession dynamics in Catalonia and linked to a stochastic landscape occupancy (SLOM) (or spatially explicit population, SEPM) model for the Ortolan bunting, a species strongly linked to fire related habitat in the region. Predictions from the occupancy or spatially explicit population Ortolan bunting model (SEPM) should be evaluated using data from the DINDIS database. This database tracks bird colonisation of recently burnt big areas (&50 ha). Through a number of different SEPM scenarios with different values for a number of parameter, we should be able to assess different hypothesis in factors driving bird colonisation in new burnt patches. These factors to be mainly, landscape context (i.e. difficulty to reach the patch, and potential presence of coloniser sources), dispersal constraints, type of regenerating vegetation after fire, and species characteristics (niche breadth, etc).

Inflation and output dynamics with firm-owned capital

We model firm-owned capital in a stochastic dynamic New-Keynesian generalequilibrium model à la Calvo. We find that this structure impliesequilibrium dynamics which are quantitatively di¤erent from the onesassociated with a benchmark case where households accumulate capital andrent it to firms. Our findings therefore stress the importance ofmodeling an investment decision at the firm level in addition to ameaningful price setting decision. Along the way we argue that the problemof modeling firm-owned capital with Calvo price-setting has not been solvedin a correct way in the previous literature.

Job dynamics, correlated shocks and wage profiles

We generalize the Mortensen-Pissarides (1994) model of the labor marketwith a more realistic structure for the stochastic process of theshocks to the worker-firm match. In this way we can acommodate theempirical observation that hazard rates of job termination decrease andaverage wages increase with job tenure. Besides being able to fit bettersome observables of the model, the changes we introduce are nontrivialfor the analysis of policies as well.

Kinematic reduction of reaction-diffusion fronts with multiplicative noise. Derivation of stochastic sharp-interface equations

We study the dynamics of generic reaction-diffusion fronts, including pulses and chemical waves, in the presence of multiplicative noise. We discuss the connection between the reaction-diffusion Langevin-like field equations and the kinematic (eikonal) description in terms of a stochastic moving-boundary or sharp-interface approximation. We find that the effective noise is additive and we relate its strength to the noise parameters in the original field equations, to first order in noise strength, but including a partial resummation to all orders which captures the singular dependence on the microscopic cutoff associated with the spatial correlation of the noise. This dependence is essential for a quantitative and qualitative understanding of fluctuating fronts, affecting both scaling properties and nonuniversal quantities. Our results predict phenomena such as the shift of the transition point between the pushed and pulled regimes of front propagation, in terms of the noise parameters, and the corresponding transition to a non-Kardar-Parisi-Zhang universality class. We assess the quantitative validity of the results in several examples including equilibrium fluctuations and kinetic roughening. We also predict and observe a noise-induced pushed-pulled transition. The analytical predictions are successfully tested against rigorous results and show excellent agreement with numerical simulations of reaction-diffusion field equations with multiplicative noise.

Stochastic generation of homogeneous isotropic turbulence with well-defined-spectra

A precise and simple computational model to generate well-behaved two-dimensional turbulent flows is presented. The whole approach rests on the use of stochastic differential equations and is general enough to reproduce a variety of energy spectra and spatiotemporal correlation functions. Analytical expressions for both the continuous and the discrete versions, together with simulation algorithms, are derived. Results for two relevant spectra, covering distinct ranges of wave numbers, are given.

Excitability transitions and wave dynamics under spatiotemporal structured noise

We present an analytic and numerical study of the effects of external fluctuations in active media. Our analytical methodology transforms the initial stochastic partial differential equations into an effective set of deterministic reaction-diffusion equations. As a result we are able to explain and make quantitative predictions on the systematic and constructive effects of the noise, for example, target patterns created out of noise and traveling or spiral waves sustained by noise. Our study includes the case of realistic noises with temporal and spatial structures.

Reaction-diffusion fronts under stochastic advection

We study front propagation in stirred media using a simplified modelization of the turbulent flow. Computer simulations reveal the existence of the two limiting propagation modes observed in recent experiments with liquid phase isothermal reactions. These two modes respectively correspond to a wrinkled although sharp propagating interface and to a broadened one. Specific laws relative to the enhancement of the front velocity in each regime are confirmed by our simulations.

Dynamical properties of nonmarkovian stochastic differential equations

We study nonstationary non-Markovian processes defined by Langevin-type stochastic differential equations with an OrnsteinUhlenbeck driving force. We concentrate on the long time limit of the dynamical evolution. We derive an approximate equation for the correlation function of a nonlinear nonstationary non-Markovian process, and we discuss its consequences. Non-Markovicity can introduce a dependence on noise parameters in the dynamics of the correlation function in cases in which it becomes independent of these parameters in the Markovian limit. Several examples are discussed in which the relaxation time increases with respect to the Markovian limit. For a Brownian harmonic oscillator with fluctuating frequency, the non-Markovicity of the process decreases the domain of stability of the system, and it can change an infradamped evolution into an overdamped one.