Response theory for equilibrium and non-equilibrium statistical mechanics: causality and generalized Kramers-Kronig relations

We consider the general response theory recently proposed by Ruelle for describing the impact of small perturbations to the non-equilibrium steady states resulting from Axiom A dynamical systems. We show that the causality of the response functions entails the possibility of writing a set of Kramers-Kronig (K-K) relations for the corresponding susceptibilities at all orders of nonlinearity. Nonetheless, only a special class of directly observable susceptibilities obey K-K relations. Specific results are provided for the case of arbitrary order harmonic response, which allows for a very comprehensive K-K analysis and the establishment of sum rules connecting the asymptotic behavior of the harmonic generation susceptibility to the short-time response of the perturbed system. These results set in a more general theoretical framework previous findings obtained for optical systems and simple mechanical models, and shed light on the very general impact of considering the principle of causality for testing self-consistency: the described dispersion relations constitute unavoidable benchmarks that any experimental and model generated dataset must obey. The theory exposed in the present paper is dual to the time-dependent theory of perturbations to equilibrium states and to non-equilibrium steady states, and has in principle similar range of applicability and limitations. In order to connect the equilibrium and the non equilibrium steady state case, we show how to rewrite the classical response theory by Kubo so that response functions formally identical to those proposed by Ruelle, apart from the measure involved in the phase space integration, are obtained. These results, taking into account the chaotic hypothesis by Gallavotti and Cohen, might be relevant in several fields, including climate research. In particular, whereas the fluctuation-dissipation theorem does not work for non-equilibrium systems, because of the non-equivalence between internal and external fluctuations, K-K relations might be robust tools for the definition of a self-consistent theory of climate change.

A statistical mechanical approach for the computation of the climatic response to general forcings

The climate belongs to the class of non-equilibrium forced and dissipative systems, for which most results of quasi-equilibrium statistical mechanics, including the fluctuation-dissipation theorem, do not apply. In this paper we show for the first time how the Ruelle linear response theory, developed for studying rigorously the impact of perturbations on general observables of non-equilibrium statistical mechanical systems, can be applied with great success to analyze the climatic response to general forcings. The crucial value of the Ruelle theory lies in the fact that it allows to compute the response of the system in terms of expectation values of explicit and computable functions of the phase space averaged over the invariant measure of the unperturbed state. We choose as test bed a classical version of the Lorenz 96 model, which, in spite of its simplicity, has a well-recognized prototypical value as it is a spatially extended one-dimensional model and presents the basic ingredients, such as dissipation, advection and the presence of an external forcing, of the actual atmosphere. We recapitulate the main aspects of the general response theory and propose some new general results. We then analyze the frequency dependence of the response of both local and global observables to perturbations having localized as well as global spatial patterns. We derive analytically several properties of the corresponding susceptibilities, such as asymptotic behavior, validity of Kramers-Kronig relations, and sum rules, whose main ingredient is the causality principle. We show that all the coefficients of the leading asymptotic expansions as well as the integral constraints can be written as linear function of parameters that describe the unperturbed properties of the system, such as its average energy. Some newly obtained empirical closure equations for such parameters allow to define such properties as an explicit function of the unperturbed forcing parameter alone for a general class of chaotic Lorenz 96 models. We then verify the theoretical predictions from the outputs of the simulations up to a high degree of precision. The theory is used to explain differences in the response of local and global observables, to define the intensive properties of the system, which do not depend on the spatial resolution of the Lorenz 96 model, and to generalize the concept of climate sensitivity to all time scales. We also show how to reconstruct the linear Green function, which maps perturbations of general time patterns into changes in the expectation value of the considered observable for finite as well as infinite time. Finally, we propose a simple yet general methodology to study general Climate Change problems on virtually any time scale by resorting to only well selected simulations, and by taking full advantage of ensemble methods. The specific case of globally averaged surface temperature response to a general pattern of change of the CO2 concentration is discussed. We believe that the proposed approach may constitute a mathematically rigorous and practically very effective way to approach the problem of climate sensitivity, climate prediction, and climate change from a radically new perspective.

Finite- N effects for ideal polymer chains near a flat impenetrable wall

This paper addresses the statistical mechanics of ideal polymer chains next to a hard wall. The principal quantity of interest, from which all monomer densities can be calculated, is the partition function, G N(z) , for a chain of N discrete monomers with one end fixed a distance z from the wall. It is well accepted that in the limit of infinite N , G N(z) satisfies the diffusion equation with the Dirichlet boundary condition, G N(0) = 0 , unless the wall possesses a sufficient attraction, in which case the Robin boundary condition, G N(0) = - x G N ′(0) , applies with a positive coefficient, x . Here we investigate the leading N -1/2 correction, D G N(z) . Prior to the adsorption threshold, D G N(z) is found to involve two distinct parts: a Gaussian correction (for z <~Unknown control sequence '\lesssim' aN 1/2 with a model-dependent amplitude, A , and a proximal-layer correction (for z <~Unknown control sequence '\lesssim' a described by a model-dependent function, B(z).

Universality of rain event size distributions

We compare rain event size distributions derived from measurements in climatically different regions, which we find to be well approximated by power laws of similar exponents over broad ranges. Differences can be seen in the large-scale cutoffs of the distributions. Event duration distributions suggest that the scale-free aspects are related to the absence of characteristic scales in the meteorological mesoscale.

Disentangling multi-level systems: averaging, correlations and memory

We consider two weakly coupled systems and adopt a perturbative approach based on the Ruelle response theory to study their interaction. We propose a systematic way of parameterizing the effect of the coupling as a function of only the variables of a system of interest. Our focus is on describing the impacts of the coupling on the long term statistics rather than on the finite-time behavior. By direct calculation, we find that, at first order, the coupling can be surrogated by adding a deterministic perturbation to the autonomous dynamics of the system of interest. At second order, there are additionally two separate and very different contributions. One is a term taking into account the second-order contributions of the fluctuations in the coupling, which can be parameterized as a stochastic forcing with given spectral properties. The other one is a memory term, coupling the system of interest to its previous history, through the correlations of the second system. If these correlations are known, this effect can be implemented as a perturbation with memory on the single system. In order to treat this case, we present an extension to Ruelle's response theory able to deal with integral operators. We discuss our results in the context of other methods previously proposed for disentangling the dynamics of two coupled systems. We emphasize that our results do not rely on assuming a time scale separation, and, if such a separation exists, can be used equally well to study the statistics of the slow variables and that of the fast variables. By recursively applying the technique proposed here, we can treat the general case of multi-level systems.

A simple analysis of thermodynamic properties for classical plasmas: I. theory

By eliminating the short range negative divergence of the Debye–Hückel pair distribution function, but retaining the exponential charge screening known to operate at large interparticle separation, the thermodynamic properties of one-component plasmas of point ions or charged hard spheres can be well represented even in the strong coupling regime. Predicted electrostatic free energies agree within 5% of simulation data for typical Coulomb interactions up to a factor of 10 times the average kinetic energy. Here, this idea is extended to the general case of a uniform ionic mixture, comprising an arbitrary number of components, embedded in a rigid neutralizing background. The new theory is implemented in two ways: (i) by an unambiguous iterative algorithm that requires numerical methods and breaks the symmetry of cross correlation functions; and (ii) by invoking generalized matrix inverses that maintain symmetry and yield completely analytic solutions, but which are not uniquely determined. The extreme computational simplicity of the theory is attractive when considering applications to complex inhomogeneous fluids of charged particles.

The sample autocorrelation function and the detection of long-memory processes

The detection of long-range dependence in time series analysis is an important task to which this paper contributes by showing that whilst the theoretical definition of a long-memory (or long-range dependent) process is based on the autocorrelation function, it is not possible for long memory to be identified using the sum of the sample autocorrelations, as usually defined. The reason for this is that the sample sum is a predetermined constant for any stationary time series; a result that is independent of the sample size. Diagnostic or estimation procedures, such as those in the frequency domain, that embed this sum are equally open to this criticism. We develop this result in the context of long memory, extending it to the implications for the spectral density function and the variance of partial sums of a stationary stochastic process. The results are further extended to higher order sample autocorrelations and the bispectral density. The corresponding result is that the sum of the third order sample (auto) bicorrelations at lags h,k≥1, is also a predetermined constant, different from that in the second order case, for any stationary time series of arbitrary length.

Fractional order modeling of large three-dimensional RC networks

An incidence matrix analysis is used to model a three-dimensional network consisting of resistive and capacitive elements distributed across several interconnected layers. A systematic methodology for deriving a descriptor representation of the network with random allocation of the resistors and capacitors is proposed. Using a transformation of the descriptor representation into standard state-space form, amplitude and phase admittance responses of three-dimensional random RC networks are obtained. Such networks display an emergent behavior with a characteristic Jonscher-like response over a wide range of frequencies. A model approximation study of these networks is performed to infer the admittance response using integral and fractional order models. It was found that a fractional order model with only seven parameters can accurately describe the responses of networks composed of more than 70 nodes and 200 branches with 100 resistors and 100 capacitors. The proposed analysis can be used to model charge migration in amorphous materials, which may be associated to specific macroscopic or microscopic scale fractal geometrical structures in composites displaying a viscoelastic electromechanical response, as well as to model the collective responses of processes governed by random events described using statistical mechanics.

Hamiltonian geophysical fluid dynamics

Hamiltonian dynamics describes the evolution of conservative physical systems. Originally developed as a generalization of Newtonian mechanics, describing gravitationally driven motion from the simple pendulum to celestial mechanics, it also applies to such diverse areas of physics as quantum mechanics, quantum field theory, statistical mechanics, electromagnetism, and optics – in short, to any physical system for which dissipation is negligible. Dynamical meteorology consists of the fundamental laws of physics, including Newton’s second law. For many purposes, diabatic and viscous processes can be neglected and the equations are then conservative. (For example, in idealized modeling studies, dissipation is often only present for numerical reasons and is kept as small as possible.) In such cases dynamical meteorology obeys Hamiltonian dynamics. Even when nonconservative processes are not negligible, it often turns out that separate analysis of the conservative dynamics, which fully describes the nonlinear interactions, is essential for an understanding of the complete system, and the Hamiltonian description can play a useful role in this respect. Energy budgets and momentum transfer by waves are but two examples.

Mg/Ca partitioning between aqueous solution and aragonite mineral: a molecular dynamics study

We have calculated the concentrations of Mg in the bulk and surfaces of aragonite CaCO3 in equilibrium with aqueous solution, based on molecular dynamics simulations and grand-canonical statistical mechanics. Mg is incorporated in the surfaces, in particular in the (001) terraces, rather than in the bulk of aragonite particles. However, the total Mg content in the bulk and surface of aragonite particles was found to be too small to account for the measured Mg/Ca ratios in corals. We therefore argue that most Mg in corals is either highly metastable in the aragonite lattice, or is located outside the aragonite phase of the coral skeleton, and we discuss the implications of this finding for Mg/Ca paleothermometry.

A theoretical investigation of a-Fe2O3–Cr2O3 solid solutions

We have examined the thermodynamic stability of a-Fe2O3–Cr2O3 solid solutions as a function of temperature and composition, using a combination of statistical mechanics with atomistic simulation techniques based on classical interatomic potentials, and the addition of a model magnetic interaction Hamiltonian. Our calculations show that the segregation of the Fe and Cr cations is marginally favourable in energy compared to any other cation distribution, and in fact the energy of any cation configuration of the mixed system is always slightly higher than the combined energies of equivalent amounts of the pure oxides separately. However, the positive enthalpy of mixing is small enough to allow the stabilisation of highly disordered solid solutions at temperatures of B400 K or higher. We have investigated the degree of cation disorder and the effective cell parameters of the mixed oxide as functions of temperature and composition, and we discuss the effect of magnetic interactions and lattice vibrations on the stability of the solid solution.

Dopant-vacancy binding effects in Li-doped magnesium hydride

We use a combination of ab initio calculations and statistical mechanics to investigate the substitution of Li+ for Mg2+ in magnesium hydride (MgH2) accompanied by the formation of hydrogen vacancies with positive charge (with respect to the original ion at the site). We show that the binding energy between dopants and vacancy defects leads to a significant fraction of trapped vacancies and therefore a dramatic reduction in the number of free vacancies available for diffusion. The concentration of free vacancies initially increases with dopant concentration but reaches a maximum at around 1 mol % Li doping and slowly decreases with further doping. At the optimal level of doping, the corresponding concentration of free vacancies is much higher than the equilibrium concentrations of charged and neutral vacancies in pure MgH2 at typical hydrogen storage conditions. We also show that Li-doped MgH2 is thermodynamically metastable with respect to phase separation into pure magnesium and lithium hydrides at any significant Li concentration, even after considering the stabilization provided by dopant-vacancy interactions and configurational entropic effects. Our results suggest that lithium doping may enhance hydrogen diffusion hydride but only to a limited extent determined by an optimal dopant concentration and conditioned to the stability of the doped phase.

Phase separation and surface segregation in ceria-zirconia solid solutions

Using a combination of density functional theory calculations and statistical mechanics, we show that a wide range of intermediate compositions of ceria – zirconia solid solutions are thermodynamically metastable with respect to phase separation into Ce-rich and Zr-rich oxides. We estimate that the maximum equilibrium concentration of Zr in CeO2 at 1373 K is ~2%, and therefore equilibrated samples with higher Zr content are expected to exhibit heterogeneity at the atomic scale. We also demonstrate that in the vicinity of the (111) surface, cation redistribution at high temperatures will occur with significant Ce enrichment of the surface, which we attribute to the more covalent character of Zr-O bonds compared to Ce-O bonds. Although the kinetic barriers for cation diffusion normally prevent the decomposition/segregation of ceria-zirconia solid solutions in typical catalytic applications, the separation behaviour described here can be expected to occur in modern three-way catalytic converters, where very high temperatures are reached.

Stochastic climate theory and modeling

Stochastic methods are a crucial area in contemporary climate research and are increasingly being used in comprehensive weather and climate prediction models as well as reduced order climate models. Stochastic methods are used as subgrid-scale parameterizations (SSPs) as well as for model error representation, uncertainty quantification, data assimilation, and ensemble prediction. The need to use stochastic approaches in weather and climate models arises because we still cannot resolve all necessary processes and scales in comprehensive numerical weather and climate prediction models. In many practical applications one is mainly interested in the largest and potentially predictable scales and not necessarily in the small and fast scales. For instance, reduced order models can simulate and predict large-scale modes. Statistical mechanics and dynamical systems theory suggest that in reduced order models the impact of unresolved degrees of freedom can be represented by suitable combinations of deterministic and stochastic components and non-Markovian (memory) terms. Stochastic approaches in numerical weather and climate prediction models also lead to the reduction of model biases. Hence, there is a clear need for systematic stochastic approaches in weather and climate modeling. In this review, we present evidence for stochastic effects in laboratory experiments. Then we provide an overview of stochastic climate theory from an applied mathematics perspective. We also survey the current use of stochastic methods in comprehensive weather and climate prediction models and show that stochastic parameterizations have the potential to remedy many of the current biases in these comprehensive models.