Grid Remote Execution (G-Rex) of Climate Models

G-Rex is light-weight Java middleware that allows scientific applications deployed on remote computer systems to be launched and controlled as if they are running on the user's own computer. G-Rex is particularly suited to ocean and climate modelling applications because output from the model is transferred back to the user while the run is in progress, which prevents the accumulation of large amounts of data on the remote cluster. The G-Rex server is a RESTful Web application that runs inside a servlet container on the remote system, and the client component is a Java command line program that can easily be incorporated into existing scientific work-flow scripts. The NEMO and POLCOMS ocean models have been deployed as G-Rex services in the NERC Cluster Grid, and G-Rex is the core grid middleware in the GCEP and GCOMS e-science projects.

Running Climate Models On The NERC Cluster Grid Using G-Rex

Compute grids are used widely in many areas of environmental science, but there has been limited uptake of grid computing by the climate modelling community, partly because the characteristics of many climate models make them difficult to use with popular grid middleware systems. In particular, climate models usually produce large volumes of output data, and running them usually involves complicated workflows implemented as shell scripts. For example, NEMO (Smith et al. 2008) is a state-of-the-art ocean model that is used currently for operational ocean forecasting in France, and will soon be used in the UK for both ocean forecasting and climate modelling. On a typical modern cluster, a particular one year global ocean simulation at 1-degree resolution takes about three hours when running on 40 processors, and produces roughly 20 GB of output as 50000 separate files. 50-year simulations are common, during which the model is resubmitted as a new job after each year. Running NEMO relies on a set of complicated shell scripts and command utilities for data pre-processing and post-processing prior to job resubmission. Grid Remote Execution (G-Rex) is a pure Java grid middleware system that allows scientific applications to be deployed as Web services on remote computer systems, and then launched and controlled as if they are running on the user's own computer. Although G-Rex is general purpose middleware it has two key features that make it particularly suitable for remote execution of climate models: (1) Output from the model is transferred back to the user while the run is in progress to prevent it from accumulating on the remote system and to allow the user to monitor the model; (2) The client component is a command-line program that can easily be incorporated into existing model work-flow scripts. G-Rex has a REST (Fielding, 2000) architectural style, which allows client programs to be very simple and lightweight and allows users to interact with model runs using only a basic HTTP client (such as a Web browser or the curl utility) if they wish. This design also allows for new client interfaces to be developed in other programming languages with relatively little effort. The G-Rex server is a standard Web application that runs inside a servlet container such as Apache Tomcat and is therefore easy to install and maintain by system administrators. G-Rex is employed as the middleware for the NERC1 Cluster Grid, a small grid of HPC2 clusters belonging to collaborating NERC research institutes. Currently the NEMO (Smith et al. 2008) and POLCOMS (Holt et al, 2008) ocean models are installed, and there are plans to install the Hadley Centre’s HadCM3 model for use in the decadal climate prediction project GCEP (Haines et al., 2008). The science projects involving NEMO on the Grid have a particular focus on data assimilation (Smith et al. 2008), a technique that involves constraining model simulations with observations. The POLCOMS model will play an important part in the GCOMS project (Holt et al, 2008), which aims to simulate the world’s coastal oceans. A typical use of G-Rex by a scientist to run a climate model on the NERC Cluster Grid proceeds as follows :(1) The scientist prepares input files on his or her local machine. (2) Using information provided by the Grid’s Ganglia3 monitoring system, the scientist selects an appropriate compute resource. (3) The scientist runs the relevant workflow script on his or her local machine. This is unmodified except that calls to run the model (e.g. with “mpirun”) are simply replaced with calls to "GRexRun" (4) The G-Rex middleware automatically handles the uploading of input files to the remote resource, and the downloading of output files back to the user, including their deletion from the remote system, during the run. (5) The scientist monitors the output files, using familiar analysis and visualization tools on his or her own local machine. G-Rex is well suited to climate modelling because it addresses many of the middleware usability issues that have led to limited uptake of grid computing by climate scientists. It is a lightweight, low-impact and easy-to-install solution that is currently designed for use in relatively small grids such as the NERC Cluster Grid. A current topic of research is the use of G-Rex as an easy-to-use front-end to larger-scale Grid resources such as the UK National Grid service.

Influence of south Atlantic sea surface temperatures on rainfall variability and extremes over southern Africa

It is generally agreed that changing climate variability, and the associated change in climate extremes, may have a greater impact on environmentally vulnerable regions than a changing mean. This research investigates rainfall variability, rainfall extremes, and their associations with atmospheric and oceanic circulations over southern Africa, a region that is considered particularly vulnerable to extreme events because of numerous environmental, social, and economic pressures. Because rainfall variability is a function of scale, high-resolution data are needed to identify extreme events. Thus, this research uses remotely sensed rainfall data and climate model experiments at high spatial and temporal resolution, with the overall aim being to investigate the ways in which sea surface temperature (SST) anomalies influence rainfall extremes over southern Africa. Extreme rainfall identification is achieved by the high-resolution microwave/infrared rainfall algorithm dataset. This comprises satellite-derived daily rainfall from 1993 to 2002 and covers southern Africa at a spatial resolution of 0.1° latitude–longitude. Extremes are extracted and used with reanalysis data to study possible circulation anomalies associated with extreme rainfall. Anomalously cold SSTs in the central South Atlantic and warm SSTs off the coast of southwestern Africa seem to be statistically related to rainfall extremes. Further, through a number of idealized climate model experiments, it would appear that both decreasing SSTs in the central South Atlantic and increasing SSTs off the coast of southwestern Africa lead to a demonstrable increase in daily rainfall and rainfall extremes over southern Africa, via local effects such as increased convection and remote effects such as an adjustment of the Walker-type circulation.

How robust are observed and simulated precipitation responses to tropical ocean warming?

Robust responses and links between the tropical energy and water cycles are investigated using multiple datasets and climate models over the period 1979-2006. Atmospheric moisture and net radiative cooling provide powerful constraints upon future changes in precipitation. While moisture amount is robustly linked with surface temperature, the response of atmospheric net radiative cooling, derived from satellite data, is less coherent. Precipitation trends and relationships with surface temperature are highly sensitive to the data product and the time-period considered. Data from the Special Sensor Microwave Imager (SSM/I) produces the strongest trends in precipitation and response to warming of all the datasets considered. The tendency for moist regions to become wetter while dry regions become drier in response to warming is captured by both observations and models. Citation: John, V. O., R. P. Allan, and B. J. Soden (2009), How robust are observed and simulated precipitation responses to tropical ocean warming?

Storm prediction research and its application to the oil/gas industry

The accurate prediction of storms is vital to the oil and gas sector for the management of their operations. An overview of research exploring the prediction of storms by ensemble prediction systems is presented and its application to the oil and gas sector is discussed. The analysis method used requires larger amounts of data storage and computer processing time than other more conventional analysis methods. To overcome these difficulties eScience techniques have been utilised. These techniques potentially have applications to the oil and gas sector to help incorporate environmental data into their information systems

Voronoi, Delaunay, and Block-Structured Mesh Refinement for Solution of the Shallow-Water Equations on the Sphere

Alternative meshes of the sphere and adaptive mesh refinement could be immensely beneficial for weather and climate forecasts, but it is not clear how mesh refinement should be achieved. A finite-volume model that solves the shallow-water equations on any mesh of the surface of the sphere is presented. The accuracy and cost effectiveness of four quasi-uniform meshes of the sphere are compared: a cubed sphere, reduced latitude–longitude, hexagonal–icosahedral, and triangular–icosahedral. On some standard shallow-water tests, the hexagonal–icosahedral mesh performs best and the reduced latitude–longitude mesh performs well only when the flow is aligned with the mesh. The inclusion of a refined mesh over a disc-shaped region is achieved using either gradual Delaunay, gradual Voronoi, or abrupt 2:1 block-structured refinement. These refined regions can actually degrade global accuracy, presumably because of changes in wave dispersion where the mesh is highly nonuniform. However, using gradual refinement to resolve a mountain in an otherwise coarse mesh can improve accuracy for the same cost. The model prognostic variables are height and momentum collocated at cell centers, and (to remove grid-scale oscillations of the A grid) the mass flux between cells is advanced from the old momentum using the momentum equation. Quadratic and upwind biased cubic differencing methods are used as explicit corrections to a fast implicit solution that uses linear differencing.

Response of organically managed grassland to available phosphorus and potassium in the soil and supplementary fertilization: field trials using grass-clover leys cut for silage

Effective use and recycling of manures together with occasional and judicious use of supplementary fertilizing materials forms the basis for management of phosphorus (P) and potassium (K) within organic farming systems. Replicated field trials were established at three sites across the UK to compare the supply of P and K to grass-clover swards cut for silage from a range of fertilizing materials, and to assess the usefulness of routine soil tests for P and K in organic farming systems. None of the fertilizing materials (farmyard manure, rock phosphate, Kali vinasse, volcanic tuff) significantly increased silage yields, nor was P offtake increased. However, farmyard manure and Kali vinasse proved effective sources of K to grass and clover in the short to medium term. Available P (measured as Olsen-P) showed no clear relationship with crop P offtake in these trials. In contrast, available K (measured by ammonium nitrate extraction) proved a useful measurement to predict K availability to crops and support K management decisions.

A glacier inventory for the Buordakh Massif, Cherskiy Range, northeast Siberia, and evidence for recent glacier recession

The Buordakh Massif, in the Cherskiy Range of northeast Siberia, contains mountains over 3000 in and, despite its and climate, numerous glaciers. This paper presents a glacier inventory for the region and documents some 80 glaciers, which range in size from 0.1 to 10.4 km(2) (total glacierized area is ca. 70 km(2)). The inventory is based on mapping derived from Landsat 7 ETM+ satellite imagery from August 2001, augmented with data from field investigations obtained at that time. The glaciers in this region are of the 'firn-less,' cold, continental type, and their mass balance relies heavily on the formation of superimposed ice. The most recent glacier maximum extents have also been delineated, and these are believed to date from the Little Ice Age (ca. A.D. 1550-1850). Glacier areal extent has reduced by some 14.8 km(2) (ca. 17%) since this most. recent maximum. Of the 80 glaciers catalogued, 49 have undergone a measurable retreat from their most recent maximum extent.

The role of uncomposted materials, composts, manures, and compost extracts in reducing pest and disease incidence and severity in sustainable temperate agricultural and horticultural crop production - A review

This review evaluates evidence of the impact of uncomposted plant residues, composts, manures, and liquid preparations made from composts (compost extracts and teas) on pest and disease incidence and severity in agricultural and horticultural crop production. Most reports on pest control using such organic amendments relate to tropical or and climates. The majority of recent work on the use of organic amendments for prevention and control of diseases relates to container-produced plants, particularly ornamentals. However, there is growing interest in the potential for using composts to prevent and control diseases in temperate agricultural and horticultural field crops and information concerning their use and effectiveness is slowly increasing. The impact of uncomposted plant residues, composts, manures, and compost extracts/teas on pests and diseases is discussed in relation to sustainable temperate field and protected cropping systems. The factors affecting efficacy or such organic amendments in preventing and controlling pests and disease are examined and the mechanisms through which control is achieved are described.

Genotype x environment interaction in the uptake of Cs and Sr from soils by plants

The soil-plant transfer factors for Cs and Sr were analyzed in relationship to soil properties, crops, and varieties of crops. Two crops and two varieties of each crop: lettuce (Lactuca sativa L.), cv. Salad Bowl Green and cv. Lobjoits Green Cos, and radish (Raphanus sativus L.), cv. French Breakfast 3 and cv. Scarlet Globe, were grown on five different soils amended with Cs and Sr to give concentrations of 1 mg kg(-1) and 50 mg kg(-1) of each element. Soil-plant transfer coefficients ranged between 0.12-19.10 (Cs) and 1.48-146.10 (Sr) for lettuce and 0.09-13.24 (Cs) and 2.99-93.00 (Sr) for radish. Uptake of Cs and Sr by plants depended on both plant and soil properties. There were significant (P less than or equal to 0.05) differences between soil-plant transfer factors for each plant type at the two soil concentrations. At each soil concentration about 60% of the variance in the uptake of the Cs and Sr was due to soil properties. For a given concentration of Cs or Sr in soil, the most important factor effecting soil-plant transfer of these elements was the soil properties rather than the crops or varieties of crops. Therefore, for the varieties considered here, soil-plant transfer of Cs and Sr would be best regulated through the management of soil properties. At each concentration of Cs and Sr, the main soil properties effecting the uptake of Cs and Sr by lettuce and radish were the concentrations of K and Ca, pH and CEC. Together with the concentrations of contaminants in soils, they explained about 80% of total data variance, and were the best predictors for soil-plant transfer. The different varieties of lettuce and radish gave different responses in soil-plant transfer of Cs and Sr in different soil conditions, i.e. genotype x environment interaction caused about 30% of the variability in the uptake of Cs and Sr by plants. This means that a plant variety with a low soil-plant transfer of Cs and Sr in one soil could have an increased soil-plant transfer factor in other soils. The broad implications of this work are that in contaminated agricultural lands still used for plant growing, contaminant-excluding crop varieties may not be a reliable method for decreasing contaminant transfer to foodstuffs. Modification of soil properties would be a more reliable technique. This is particularly relevant to agricultural soils in the former USSR still affected by fallout from the Chernobyl disaster.

National and sub-national assessments of soil organic carbon stocks and changes: The GEFSOC modelling system

Soil organic carbon (SOC) plays a vital role in ecosystem function, determining soil fertility, water holding capacity and susceptibility to land degradation. In addition, SOC is related to atmospheric CO, levels with soils having the potential for C release or sequestration, depending on land use, land management and climate. The United Nations Convention on Climate Change and its Kyoto Protocol, and other United Nations Conventions to Combat Desertification and on Biodiversity all recognize the importance of SOC and point to the need for quantification of SOC stocks and changes. An understanding of SOC stocks and changes at the national and regional scale is necessary to further our understanding of the global C cycle, to assess the responses of terrestrial ecosystems to climate change and to aid policy makers in making land use/management decisions. Several studies have considered SOC stocks at the plot scale, but these are site specific and of limited value in making inferences about larger areas. Some studies have used empirical methods to estimate SOC stocks and changes at the regional scale, but such studies are limited in their ability to project future changes, and most have been carried out using temperate data sets. The computational method outlined by the Intergovernmental Panel on Climate Change (IPCC) has been used to estimate SOC stock changes at the regional scale in several studies, including a recent study considering five contrasting eco regions. This 'one step' approach fails to account for the dynamic manner in which SOC changes are likely to occur following changes in land use and land management. A dynamic modelling approach allows estimates to be made in a manner that accounts for the underlying processes leading to SOC change. Ecosystem models, designed for site scale applications can be linked to spatial databases, giving spatially explicit results that allow geographic areas of change in SOC stocks to be identified. Some studies have used variations on this approach to estimate SOC stock changes at the sub-national and national scale for areas of the USA and Europe and at the watershed scale for areas of Mexico and Cuba. However, a need remained for a national and regional scale, spatially explicit system that is generically applicable and can be applied to as wide a range of soil types, climates and land uses as possible. The Global Environment Facility Soil Organic Carbon (GEFSOC) Modelling System was developed in response to this need. The GEFSOC system allows estimates of SOC stocks and changes to be made for diverse conditions, providing essential information for countries wishing to take part in an emerging C market, and bringing us closer to an understanding of the future role of soils in the global C cycle. (C) 2007 Elsevier B.V. All rights reserved.

Evolution of late glacial ice-marginal lakes on the northwestern Canadian Shield and their influence on the location of the Dubawnt Lake palaeo-ice stream

During deglaciation of the North American Laurentide Ice Sheet large proglacial lakes developed in positions where proglacial drainage was impeded by the ice margin. For some of these lakes, it is known that subsequent drainage had an abrupt and widespread impact on North Atlantic Ocean circulation and climate, but less is known about the impact that the lakes exerted on ice sheet dynamics. This paper reports palaeogeographic reconstructions of the evolution of proglacial lakes during deglaciation across the northwestern Canadian Shield, covering an area in excess of 1,000,000 km(2) as the ice sheet retreated some 600 km. The interactions between proglacial lakes and ice sheet flow are explored, with a particular emphasis on whether the disposition of lakes may have influenced the location of the Dubawnt Lake ice stream. This ice stream falls outside the existing paradigm for ice streams in the Laurentide Ice Sheet because it did not operate over fined-grained till or lie in a topographic trough. Ice margin positions and a digital elevation model are utilised to predict the geometry and depth of proglacial takes impounded at the margin at 30-km increments during deglaciation. Palaeogeographic reconstructions match well with previous independent estimates of lake coverage inferred from field evidence, and results suggest that the development of a deep lake in the Thelon drainage basin may have been influential in initiating the ice stream by inducing calving, drawing down ice and triggering fast ice flow. This is the only location alongside this sector of the ice sheet where large (>3000 km(2)), deep lakes (similar to120 m) are impounded for a significant length of time and exactly matches the location of the ice stream. It is speculated that the commencement of calving at the ice sheet margin may have taken the system beyond a threshold and was sufficient to trigger rapid motion but that once initiated, calving processes and losses were insignificant to the functioning of the ice stream. It is thus concluded that proglacial lakes are likely to have been an important control on ice sheet dynamics during deglaciation of the Laurentide Ice Sheet. (C) 2004 Elsevier B.V. All rights reserved.

Robust dynamics of Amazon dieback to climate change with perturbed ecosystem model parameters

Climate change science is increasingly concerned with methods for managing and integrating sources of uncertainty from emission storylines, climate model projections, and ecosystem model parameterizations. In tropical ecosystems, regional climate projections and modeled ecosystem responses vary greatly, leading to a significant source of uncertainty in global biogeochemical accounting and possible future climate feedbacks. Here, we combine an ensemble of IPCC-AR4 climate change projections for the Amazon Basin (eight general circulation models) with alternative ecosystem parameter sets for the dynamic global vegetation model, LPJmL. We evaluate LPJmL simulations of carbon stocks and fluxes against flux tower and aboveground biomass datasets for individual sites and the entire basin. Variability in LPJmL model sensitivity to future climate change is primarily related to light and water limitations through biochemical and water-balance-related parameters. Temperature-dependent parameters related to plant respiration and photosynthesis appear to be less important than vegetation dynamics (and their parameters) for determining the magnitude of ecosystem response to climate change. Variance partitioning approaches reveal that relationships between uncertainty from ecosystem dynamics and climate projections are dependent on geographic location and the targeted ecosystem process. Parameter uncertainty from the LPJmL model does not affect the trajectory of ecosystem response for a given climate change scenario and the primary source of uncertainty for Amazon 'dieback' results from the uncertainty among climate projections. Our approach for describing uncertainty is applicable for informing and prioritizing policy options related to mitigation and adaptation where long-term investments are required.

Modelling monsoons: understanding and predicting current and future behaviour

The global monsoon system is so varied and complex that understanding and predicting its diverse behaviour remains a challenge that will occupy modellers for many years to come. Despite the difficult task ahead, an improved monsoon modelling capability has been realized through the inclusion of more detailed physics of the climate system and higher resolution in our numerical models. Perhaps the most crucial improvement to date has been the development of coupled ocean-atmosphere models. From subseasonal to interdecadal time scales, only through the inclusion of air-sea interaction can the proper phasing and teleconnections of convection be attained with respect to sea surface temperature variations. Even then, the response to slow variations in remote forcings (e.g., El Niño—Southern Oscillation) does not result in a robust solution, as there are a host of competing modes of variability that must be represented, including those that appear to be chaotic. Understanding the links between monsoons and land surface processes is not as mature as that explored regarding air-sea interactions. A land surface forcing signal appears to dominate the onset of wet season rainfall over the North American monsoon region, though the relative role of ocean versus land forcing remains a topic of investigation in all the monsoon systems. Also, improved forecasts have been made during periods in which additional sounding observations are available for data assimilation. Thus, there is untapped predictability that can only be attained through the development of a more comprehensive observing system for all monsoon regions. Additionally, improved parameterizations - for example, of convection, cloud, radiation, and boundary layer schemes as well as land surface processes - are essential to realize the full potential of monsoon predictability. A more comprehensive assessment is needed of the impact of black carbon aerosols, which may modulate that of other anthropogenic greenhouse gases. Dynamical considerations require ever increased horizontal resolution (probably to 0.5 degree or higher) in order to resolve many monsoon features including, but not limited to, the Mei-Yu/Baiu sudden onset and withdrawal, low-level jet orientation and variability, and orographic forced rainfall. Under anthropogenic climate change many competing factors complicate making robust projections of monsoon changes. Absent aerosol effects, increased land-sea temperature contrast suggests strengthened monsoon circulation due to climate change. However, increased aerosol emissions will reflect more solar radiation back to space, which may temper or even reduce the strength of monsoon circulations compared to the present day. Precipitation may behave independently from the circulation under warming conditions in which an increased atmospheric moisture loading, based purely on thermodynamic considerations, could result in increased monsoon rainfall under climate change. The challenge to improve model parameterizations and include more complex processes and feedbacks pushes computing resources to their limit, thus requiring continuous upgrades of computational infrastructure to ensure progress in understanding and predicting current and future behaviour of monsoons.

A comparative method to evaluate and validate stochastic parametrizations

There is a growing interest in using stochastic parametrizations in numerical weather and climate prediction models. Previously, Palmer (2001) outlined the issues that give rise to the need for a stochastic parametrization and the forms such a parametrization could take. In this article a method is presented that uses a comparison between a standard-resolution version and a high-resolution version of the same model to gain information relevant for a stochastic parametrization in that model. A correction term that could be used in a stochastic parametrization is derived from the thermodynamic equations of both models. The origin of the components of this term is discussed. It is found that the component related to unresolved wave-wave interactions is important and can act to compensate for large parametrized tendencies. The correction term is not proportional to the parametrized tendency. Finally, it is explained how the correction term could be used to give information about the shape of the random distribution to be used in a stochastic parametrization. Copyright © 2009 Royal Meteorological Society