On the growth of errors in data assimilation systems

Considerable progress has taken place in numerical weather prediction over the last decade. It has been possible to extend predictive skills in the extra-tropics of the Northern Hemisphere during the winter from less than five days to seven days. Similar improvements, albeit on a lower level, have taken place in the Southern Hemisphere. Another example of improvement in the forecasts is the prediction of intense synoptic phenomena such as cyclogenesis which on the whole is quite successful with the most advanced operational models (Bengtsson (1989), Gadd and Kruze (1988)). A careful examination shows that there are no single causes for the improvements in predictive skill, but instead they are due to several different factors encompassing the forecasting system as a whole (Bengtsson, 1985). In this paper we will focus our attention on the role of data-assimilation and the effect it may have on reducing the initial error and hence improving the forecast. The first part of the paper contains a theoretical discussion on error growth in simple data assimilation systems, following Leith (1983). In the second part we will apply the result on actual forecast data from ECMWF. The potential for further forecast improvements within the framework of the present observing system in the two hemispheres will be discussed.

Graph-based algorithms for comparison and prediction of household-level energy use profiles

We present an efficient graph-based algorithm for quantifying the similarity of household-level energy use profiles, using a notion of similarity that allows for small time–shifts when comparing profiles. Experimental results on a real smart meter data set demonstrate that in cases of practical interest our technique is far faster than the existing method for computing the same similarity measure. Having a fast algorithm for measuring profile similarity improves the efficiency of tasks such as clustering of customers and cross-validation of forecasting methods using historical data. Furthermore, we apply a generalisation of our algorithm to produce substantially better household-level energy use forecasts from historical smart meter data.

A review on Arctic sea ice predictability and prediction on seasonal-to-decadal timescales

Sea ice plays a crucial role in the earth's energy and water budget and substantially impacts local and remote atmospheric and oceanic circulations. Predictions of Arctic sea ice conditions a few months to a few years in advance could be of interest for stakeholders. This article presents a review of the potential sources of Arctic sea ice predictability on these timescales. Predictability mainly originates from persistence or advection of sea ice anomalies, interactions with the ocean and atmosphere and changes in radiative forcing. After estimating the inherent potential predictability limit with state-of-the-art models, current sea ice forecast systems are described, together with their performance. Finally, some challenges and issues in sea ice forecasting are presented, along with suggestions for future research priorities.

Lattice Boltzmann simulation of viscous fluid systems with elastic boundaries

A lattice Boltzmann model able to simulate viscous fluid systems with elastic and movable boundaries is proposed. By introducing the virtual distribution function at the boundary, the Galilean invariance is recovered for the full system. As examples of application, the how in elastic vessels is simulated with the pressure-radius relationship similar to that of the pulmonary blood vessels. The numerical results for steady how are in good agreement with the analytical prediction, while the simulation results for pulsative how agree with the experimental observation of the aortic flows qualitatively. The approach has potential application in the study of the complex fluid systems such as the suspension system as well as the arterial blood flow.

Prediction of metabolisable energy concentrations of fresh cut grass using digestibility data measured with non-pregnant non-lactating cows

Pasture-based ruminant production systems are common in certain areas of the world, but energy evaluation in grazing cattle is performed with equations developed, in their majority, with sheep or cattle fed total mixed rations. The aim of the current study was to develop predictions of metabolisable energy (ME) concentrations in fresh-cut grass offered to non-pregnant non-lactating cows at maintenance energy level, which may be more suitable for grazing cattle. Data were collected from three digestibility trials performed over consecutive grazing seasons. In order to cover a range of commercial conditions and data availability in pasture-based systems, thirty-eight equations for the prediction of energy concentrations and ratios were developed. An internal validation was performed for all equations and also for existing predictions of grass ME. Prediction error for ME using nutrient digestibility was lowest when gross energy (GE) or organic matter digestibilities were used as sole predictors, while the addition of grass nutrient contents reduced the difference between predicted and actual values, and explained more variation. Addition of N, GE and diethyl ether extract (EE) contents improved accuracy when digestible organic matter in DM was the primary predictor. When digestible energy was the primary explanatory variable, prediction error was relatively low, but addition of water-soluble carbohydrates, EE and acid-detergent fibre contents of grass decreased prediction error. Equations developed in the current study showed lower prediction errors when compared with those of existing equations, and may thus allow for an improved prediction of ME in practice, which is critical for the sustainability of pasture-based systems.

Prediction of nutrient digestibility and energy concentrations in fresh grass using nutrient composition

Improved nutrient utilization efficiency is strongly related to enhanced economic performance and reduced environmental footprint of dairy farms. Pasture-based systems are widely used for dairy production in certain areas of the world, but prediction equations of fresh grass nutritive value (nutrient digestibility and energy concentrations) are limited. Equations to predict digestible energy (DE) and metabolizable energy (ME) used for grazing cattle have been either developed with cattle fed conserved forage and concentrate diets or sheep fed previously frozen grass, and the majority of them require measurements less commonly available to producers, such as nutrient digestibility. The aim of the present study was therefore to develop prediction equations more suitable to grazing cattle for nutrient digestibility and energy concentrations, which are routinely available at farm level by using grass nutrient contents as predictors. A study with 33 nonpregnant, nonlactating cows fed solely fresh-cut grass at maintenance energy level for 50 wk was carried out over 3 consecutive grazing seasons. Freshly harvested grass of 3 cuts (primary growth and first and second regrowth), 9 fertilizer input levels, and contrasting stage of maturity (3 to 9 wk after harvest) was used, thus ensuring a wide representation of nutritional quality. As a result, a large variation existed in digestibility of dry matter (0.642-0.900) and digestible organic matter in dry matter (0.636-0.851) and in concentrations of DE (11.8-16.7 MJ/kg of dry matter) and ME (9.0-14.1 MJ/kg of dry matter). Nutrient digestibilities and DE and ME concentrations were negatively related to grass neutral detergent fiber (NDF) and acid detergent fiber (ADF) contents but positively related to nitrogen (N), gross energy, and ether extract (EE) contents. For each predicted variable (nutrient digestibilities or energy concentrations), different combinations of predictors (grass chemical composition) were found to be significant and increase the explained variation. For example, relatively higher R(2) values were found for prediction of N digestibility using N and EE as predictors; gross-energy digestibility using EE, NDF, ADF, and ash; NDF, ADF, and organic matter digestibilities using N, water-soluble carbohydrates, EE, and NDF; digestible organic matter in dry matter using water-soluble carbohydrates, EE, NDF, and ADF; DE concentration using gross energy, EE, NDF, ADF, and ash; and ME concentration using N, EE, ADF, and ash. Equations presented may allow a relatively quick and easy prediction of grass quality and, hence, better grazing utilization on commercial and research farms, where nutrient composition falls within the range assessed in the current study.

A global empirical system for probabilistic seasonal climate prediction

Preparing for episodes with risks of anomalous weather a month to a year ahead is an important challenge for governments, non-governmental organisations, and private companies and is dependent on the availability of reliable forecasts. The majority of operational seasonal forecasts are made using process-based dynamical models, which are complex, computationally challenging and prone to biases. Empirical forecast approaches built on statistical models to represent physical processes offer an alternative to dynamical systems and can provide either a benchmark for comparison or independent supplementary forecasts. Here, we present a simple empirical system based on multiple linear regression for producing probabilistic forecasts of seasonal surface air temperature and precipitation across the globe. The global CO2-equivalent concentration is taken as the primary predictor; subsequent predictors, including large-scale modes of variability in the climate system and local-scale information, are selected on the basis of their physical relationship with the predictand. The focus given to the climate change signal as a source of skill and the probabilistic nature of the forecasts produced constitute a novel approach to global empirical prediction. Hindcasts for the period 1961–2013 are validated against observations using deterministic (correlation of seasonal means) and probabilistic (continuous rank probability skill scores) metrics. Good skill is found in many regions, particularly for surface air temperature and most notably in much of Europe during the spring and summer seasons. For precipitation, skill is generally limited to regions with known El Niño–Southern Oscillation (ENSO) teleconnections. The system is used in a quasi-operational framework to generate empirical seasonal forecasts on a monthly basis.

Equations to predict methane emissions from cows fed at maintenance energy level in pasture-based systems

Ruminant production is a vital part of food industry but it raises environmental concerns, partly due to the associated methane outputs. Efficient methane mitigation and estimation of emissions from ruminants requires accurate prediction tools. Equations recommended by international organizations or scientific studies have been developed with animals fed conserved forages and concentrates and may be used with caution for grazing cattle. The aim of the current study was to develop prediction equations with animals fed fresh grass in order to be more suitable to pasture-based systems and for animals at lower feeding levels. A study with 25 nonpregnant nonlactating cows fed solely fresh-cut grass at maintenance energy level was performed over two consecutive grazing seasons. Grass of broad feeding quality, due to contrasting harvest dates, maturity, fertilisation and grass varieties, from eight swards was offered. Cows were offered the experimental diets for at least 2 weeks before housed in calorimetric chambers over 3 consecutive days with feed intake measurements and total urine and faeces collections performed daily. Methane emissions were measured over the last 2 days. Prediction models were developed from 100 3-day averaged records. Internal validation of these equations, and those recommended in literature, was performed. The existing in greenhouse gas inventories models under-estimated methane emissions from animals fed fresh-cut grass at maintenance while the new models, using the same predictors, improved prediction accuracy. Error in methane outputs prediction was decreased when grass nutrient, metabolisable energy and digestible organic matter concentrations were added as predictors to equations already containing dry matter or energy intakes, possibly because they explain feed digestibility and the type of energy-supplying nutrients more efficiently. Predictions based on readily available farm-level data, such as liveweight and grass nutrient concentrations were also generated and performed satisfactorily. New models may be recommended for predictions of methane emissions from grazing cattle at maintenance or low feeding levels.

Understanding advances in the simulation of the Madden-Julian Oscillation in a numerical weather prediction model.

The Madden-Julian Oscillation (MJO) is the dominant mode of intraseasonal variability in the Trop- ics. It can be characterised as a planetary-scale coupling between the atmospheric circulation and organised deep convection that propagates east through the equatorial Indo-Pacific region. The MJO interacts with weather and climate systems on a near-global scale and is a crucial source of predictability for weather forecasts on medium to seasonal timescales. Despite its global signifi- cance, accurately representing the MJO in numerical weather prediction (NWP) and climate models remains a challenge. This thesis focuses on the representation of the MJO in the Integrated Forecasting System (IFS) at the European Centre for Medium-Range Weather Forecasting (ECMWF), a state-of-the-art NWP model. Recent modifications to the model physics in Cycle 32r3 (Cy32r3) of the IFS led to ad- vances in the simulation of the MJO; for the first time the observed amplitude of the MJO was maintained throughout the integration period. A set of hindcast experiments, which differ only in their formulation of convection, have been performed between May 2008 and April 2009 to asses the sensitivity of MJO simulation in the IFS to the Cy32r3 convective parameterization. Unique to this thesis is the attribution of the advances in MJO simulation in Cy32r3 to the mod- ified convective parameterization, specifically, the relative-humidity-dependent formulation for or- ganised deep entrainment. Increasing the sensitivity of the deep convection scheme to environmen- tal moisture is shown to modify the relationship between precipitation and moisture in the model. Through dry-air entrainment, convective plumes ascending in low-humidity environments terminate lower in the atmosphere. As a result, there is an increase in the occurrence of cumulus congestus, which acts to moisten the mid-troposphere. Due to the modified precipitation-moisture relationship more moisture is able to build up which effectively preconditions the tropical atmosphere for the transition to deep convection. Results from this thesis suggest that a tropospheric moisture control on convection is key to simulating the interaction between the physics and large-scale circulation associated with the MJO.

A new adaptive multiple modelling approach for non-linear and non-stationary systems

This paper proposes a novel adaptive multiple modelling algorithm for non-linear and non-stationary systems. This simple modelling paradigm comprises K candidate sub-models which are all linear. With data available in an online fashion, the performance of all candidate sub-models are monitored based on the most recent data window, and M best sub-models are selected from the K candidates. The weight coefficients of the selected sub-model are adapted via the recursive least square (RLS) algorithm, while the coefficients of the remaining sub-models are unchanged. These M model predictions are then optimally combined to produce the multi-model output. We propose to minimise the mean square error based on a recent data window, and apply the sum to one constraint to the combination parameters, leading to a closed-form solution, so that maximal computational efficiency can be achieved. In addition, at each time step, the model prediction is chosen from either the resultant multiple model or the best sub-model, whichever is the best. Simulation results are given in comparison with some typical alternatives, including the linear RLS algorithm and a number of online non-linear approaches, in terms of modelling performance and time consumption.

Climatological features of cutoff low systems in the Southern Hemisphere

Cutoff lows (COLs) pressure systems climatology for the Southern Hemisphere (SH), between 10 degrees S and 50 degrees S, using the National Center for Environmental Prediction-National Center for Atmospheric Research (NCEP-NCAR) and the ERA-40 European Centre for Medium Range Weather Forecast (ECMWF) reanalyses are analyzed for the period 1979-1999. COLs were identified at three pressure levels (200, 300, and 500 hPa) using an objective method that considers the main physical characteristics of the conceptual model of COLs. Independently of the pressure level analyzed, the climatology from the ERA-40 reanalysis has more COLs systems than the NCEP-NCAR. However, both reanalyses present a large frequency of COLs at 300 hPa, followed by 500 and 200 hPa. The seasonality of COLs differs at each pressure level, but it is similar between the reanalyses. COLs are more frequent during summer, autumn, and winter at 200, 300, and 500 hPa, respectively. At these levels, they tend to occur around the continents, preferentially from southeastern Australia to New Zealand, the south of South America, and the south of Africa. To study the COLs at 200 and 300 hPa from a regional perspective, the SH was divided in three regions: Australia-New Zealand (60 E-130 W), South America (130 degrees W-20 degrees W), and southern Africa (20 degrees W-60 degrees E). The common COLs features in these sectors for both reanalyses are a short lifetime (similar to 80.0% and similar to 70.0% of COLs at 200 and 300 hPa, respectively, persisting for up to 3 days), mobility (similar to 70.0% and similar to 50% of COLs at 200 and 300 hPa, respectively, traveling distances of up to 1200 km), and an eastward propagation.

A novel approach for distributed application scheduling based on prediction of communication events

The evolution of commodity computing lead to the possibility of efficient usage of interconnected machines to solve computationally-intensive tasks, which were previously solvable only by using expensive supercomputers. This, however, required new methods for process scheduling and distribution, considering the network latency, communication cost, heterogeneous environments and distributed computing constraints. An efficient distribution of processes over such environments requires an adequate scheduling strategy, as the cost of inefficient process allocation is unacceptably high. Therefore, a knowledge and prediction of application behavior is essential to perform effective scheduling. In this paper, we overview the evolution of scheduling approaches, focusing on distributed environments. We also evaluate the current approaches for process behavior extraction and prediction, aiming at selecting an adequate technique for online prediction of application execution. Based on this evaluation, we propose a novel model for application behavior prediction, considering chaotic properties of such behavior and the automatic detection of critical execution points. The proposed model is applied and evaluated for process scheduling in cluster and grid computing environments. The obtained results demonstrate that prediction of the process behavior is essential for efficient scheduling in large-scale and heterogeneous distributed environments, outperforming conventional scheduling policies by a factor of 10, and even more in some cases. Furthermore, the proposed approach proves to be efficient for online predictions due to its low computational cost and good precision. (C) 2009 Elsevier B.V. All rights reserved.

Prediction of dynamical, nonlinear, and unstable process behavior

Process scheduling techniques consider the current load situation to allocate computing resources. Those techniques make approximations such as the average of communication, processing, and memory access to improve the process scheduling, although processes may present different behaviors during their whole execution. They may start with high communication requirements and later just processing. By discovering how processes behave over time, we believe it is possible to improve the resource allocation. This has motivated this paper which adopts chaos theory concepts and nonlinear prediction techniques in order to model and predict process behavior. Results confirm the radial basis function technique which presents good predictions and also low processing demands show what is essential in a real distributed environment.