Current problems in four-dimensional data assimilation

The purpose of this lecture is to review recent development in data analysis, initialization and data assimilation. The development of 3-dimensional multivariate schemes has been very timely because of its suitability to handle the many different types of observations during FGGE. Great progress has taken place in the initialization of global models by the aid of non-linear normal mode technique. However, in spite of great progress, several fundamental problems are still unsatisfactorily solved. Of particular importance is the question of the initialization of the divergent wind fields in the Tropics and to find proper ways to initialize weather systems driven by non-adiabatic processes. The unsatisfactory ways in which such processes are being initialized are leading to excessively long spin-up times.

An exploration of the equivalent weights particle filter

Particle filters are fully non-linear data assimilation techniques that aim to represent the probability distribution of the model state given the observations (the posterior) by a number of particles. In high-dimensional geophysical applications the number of particles required by the sequential importance resampling (SIR) particle filter in order to capture the high probability region of the posterior, is too large to make them usable. However particle filters can be formulated using proposal densities, which gives greater freedom in how particles are sampled and allows for a much smaller number of particles. Here a particle filter is presented which uses the proposal density to ensure that all particles end up in the high probability region of the posterior probability density function. This gives rise to the possibility of non-linear data assimilation in large dimensional systems. The particle filter formulation is compared to the optimal proposal density particle filter and the implicit particle filter, both of which also utilise a proposal density. We show that when observations are available every time step, both schemes will be degenerate when the number of independent observations is large, unlike the new scheme. The sensitivity of the new scheme to its parameter values is explored theoretically and demonstrated using the Lorenz (1963) model.

Tests of non-linearity using LIFFE futures transactions price data

This paper presents and implements a number of tests for non-linear dependence and a test for chaos using transactions prices on three LIFFE futures contracts: the Short Sterling interest rate contract, the Long Gilt government bond contract, and the FTSE 100 stock index futures contract. While previous studies of high frequency futures market data use only those transactions which involve a price change, we use all of the transaction prices on these contracts whether they involve a price change or not. Our results indicate irrefutable evidence of non-linearity in two of the three contracts, although we find no evidence of a chaotic process in any of the series. We are also able to provide some indications of the effect of the duration of the trading day on the degree of non-linearity of the underlying contract. The trading day for the Long Gilt contract was extended in August 1994, and prior to this date there is no evidence of any structure in the return series. However, after the extension of the trading day we do find evidence of a non-linear return structure.

Testing for non-linearity in daily sterling exchange rates

A number of tests for non-linear dependence in time series are presented and implemented on a set of 10 daily sterling exchange rates covering the entire post Bretton-Woods era until the present day. Irrefutable evidence of non-linearity is shown in many of the series, but most of this dependence can apparently be explained by reference to the GARCH family of models. It is suggested that the literature in this area has reached an impasse, with the presence of ARCH effects clearly demonstrated in a large number of papers, but with the tests for non-linearity which are currently available being unable to classify any additional non-linear structure.

Urban and agricultural soils: conflicts and trade-offs in the optimization of ecosystem services

On-going human population growth and changing patterns of resource consumption are increasing global demand for ecosystem services, many of which are provided by soils. Some of these ecosystem services are linearly related to the surface area of pervious soil, whereas others show non-linear relationships, making ecosystem service optimization a complex task. As limited land availability creates conflicting demands among various types of land use, a central challenge is how to weigh these conflicting interests and how to achieve the best solutions possible from a perspective of sustainable societal development. These conflicting interests become most apparent in soils that are the most heavily used by humans for specific purposes: urban soils used for green spaces, housing, and other infrastructure and agricultural soils for producing food, fibres and biofuels. We argue that, despite their seemingly divergent uses of land, agricultural and urban soils share common features with regards to interactions between ecosystem services, and that the trade-offs associated with decision-making, while scale- and context-dependent, can be surprisingly similar between the two systems. We propose that the trade-offs within land use types and their soil-related ecosystems services are often disproportional, and quantifying these will enable ecologists and soil scientists to help policy makers optimizing management decisions when confronted with demands for multiple services under limited land availability.

Phytoplankton–zooplankton dynamics in the ‘presence’ or ‘absence’ of toxic phytoplankton

The inhibitory effects of toxin-producing phytoplankton (TPP) on zooplankton modulate the dynamics of marine plankton. In this article, we employ simple mathematical models to compare theoretically the dynamics of phytoplankton–zooplankton interaction in situations where the TPP are present with those where TPP are absent. We consider two sets of three-component interaction models: one that does not include the effect of TPP and the other that does. The negative effects of TPP on zooplankton is described by a non-linear interaction term. Extensive theoretical analyses of the models have been performed to understand the qualitative behaviour of the model systems around every possible equilibria. The results of local-stability analysis and numerical simulations demonstrate that the two model-systems differ qualitatively with regard to oscillations and stability. The model system that does not include TPP is asymptotically stable around the coexisting equilibria, whereas, the system that includes TPP oscillates for a range of parametric values associated with toxin-inhibition rate and competition coefficients. Our analysis suggests that the qualitative dynamics of the plankton–zooplankton interactions are very likely to alter due to the presence of TPP species, and therefore the effects of TPP should be considered carefully while modelling plankton dynamics.

Numerical analyses of Runge–Kutta implicit–explicit schemes for horizontally explicit, vertically implicit solutions of atmospheric models

With the prospect of exascale computing, computational methods requiring only local data become especially attractive. Consequently, the typical domain decomposition of atmospheric models means horizontally-explicit vertically-implicit (HEVI) time-stepping schemes warrant further attention. In this analysis, Runge-Kutta implicit-explicit schemes from the literature are analysed for their stability and accuracy using a von Neumann stability analysis of two linear systems. Attention is paid to the numerical phase to indicate the behaviour of phase and group velocities. Where the analysis is tractable, analytically derived expressions are considered. For more complicated cases, amplification factors have been numerically generated and the associated amplitudes and phase diagnosed. Analysis of a system describing acoustic waves has necessitated attributing the three resultant eigenvalues to the three physical modes of the system. To do so, a series of algorithms has been devised to track the eigenvalues across the frequency space. The result enables analysis of whether the schemes exactly preserve the non-divergent mode; and whether there is evidence of spurious reversal in the direction of group velocities or asymmetry in the damping for the pair of acoustic modes. Frequency ranges that span next-generation high-resolution weather models to coarse-resolution climate models are considered; and a comparison is made of errors accumulated from multiple stability-constrained shorter time-steps from the HEVI scheme with a single integration from a fully implicit scheme over the same time interval. Two schemes, “Trap2(2,3,2)” and “UJ3(1,3,2)”, both already used in atmospheric models, are identified as offering consistently good stability and representation of phase across all the analyses. Furthermore, according to a simple measure of computational cost, “Trap2(2,3,2)” is the least expensive.

Baroclinic instability on hot extrasolar planets

We investigate baroclinic instability in flow conditions relevant to hot extrasolar planets. The instability is important for transporting and mixing heat, as well as for influencing large-scale variability on the planets. Both linear normal mode analysis and non-linear initial value cal- culations are carried out – focusing on the freely-evolving, adiabatic situation. Using a high- resolution general circulation model (GCM) which solves the traditional primitive equations, we show that large-scale jets similar to those observed in current GCM simulations of hot ex- trasolar giant planets are likely to be baroclinically unstable on a timescale of few to few tens of planetary rotations, generating cyclones and anticyclones that drive weather systems. The growth rate and scale of the most unstable mode obtained in the linear analysis are in qual- itative, good agreement with the full non-linear calculations. In general, unstable jets evolve differently depending on their signs (eastward or westward), due to the change in sign of the jet curvature. For jets located at or near the equator, instability is strong at the flanks – but not at the core. Crucially, the instability is either poorly or not at all captured in simulations with low resolution and/or high artificial viscosity. Hence, the instability has not been observed or emphasized in past circulation studies of hot extrasolar planets.

Uptake of agri-environmental schemes in the Less-Favoured Areas of Greece: The role of corruption and farmers' responses to the financial crisis

Vine-growing in the Less-Favoured Areas of Greece is facing multiple challenges that might lead to its abandonment. In an attempt to maintain rural populations, Rural Development Schemes have been created that offer the opportunity to rural households to maintain or expand their farming businesses including vine-growing. This paper stems from a study that used data from a cross-sectional survey of 204 farmers to investigate how farming systems and farmers’ perception of corruption, amongst other socio-economic factors, affected their decisions to continue vine-growing through participation in Rural Development Schemes, in three remote Less-Favoured Areas of Greece. The Theory of Planned Behaviour was used to frame the research problem with the assumption being that an individual’s intention to participate in a Scheme is based on their prior beliefs about it. Data from the survey were reduced and simplified by the use of non-linear principal component analysis. The ensuing variables were used in selectivity corrected ordered probit models to reveal farmers’ attitudes towards viticulture and rural development. It was found that economic factors, perceived corruption and farmers’ attitudes were significant determinants on whether to participate in the Schemes. The research findings highlight the important role of perceived corruption and the need for policies that facilitate farmers’ access to decision making centres.

Probabilistic wind power forecasts with an inverse power curve transformation and censored regression

Forecasting wind power is an important part of a successful integration of wind power into the power grid. Forecasts with lead times longer than 6 h are generally made by using statistical methods to post-process forecasts from numerical weather prediction systems. Two major problems that complicate this approach are the non-linear relationship between wind speed and power production and the limited range of power production between zero and nominal power of the turbine. In practice, these problems are often tackled by using non-linear non-parametric regression models. However, such an approach ignores valuable and readily available information: the power curve of the turbine's manufacturer. Much of the non-linearity can be directly accounted for by transforming the observed power production into wind speed via the inverse power curve so that simpler linear regression models can be used. Furthermore, the fact that the transformed power production has a limited range can be taken care of by employing censored regression models. In this study, we evaluate quantile forecasts from a range of methods: (i) using parametric and non-parametric models, (ii) with and without the proposed inverse power curve transformation and (iii) with and without censoring. The results show that with our inverse (power-to-wind) transformation, simpler linear regression models with censoring perform equally or better than non-linear models with or without the frequently used wind-to-power transformation.

Implicit equal-weights particle filter

Filter degeneracy is the main obstacle for the implementation of particle filter in non-linear high-dimensional models. A new scheme, the implicit equal-weights particle filter (IEWPF), is introduced. In this scheme samples are drawn implicitly from proposal densities with a different covariance for each particle, such that all particle weights are equal by construction. We test and explore the properties of the new scheme using a 1,000-dimensional simple linear model, and the 1,000-dimensional non-linear Lorenz96 model, and compare the performance of the scheme to a Local Ensemble Kalman Filter. The experiments show that the new scheme can easily be implemented in high-dimensional systems and is never degenerate, with good convergence properties in both systems.