Running Climate Models On The NERC Cluster Grid Using G-Rex

Compute grids are used widely in many areas of environmental science, but there has been limited uptake of grid computing by the climate modelling community, partly because the characteristics of many climate models make them difficult to use with popular grid middleware systems. In particular, climate models usually produce large volumes of output data, and running them usually involves complicated workflows implemented as shell scripts. For example, NEMO (Smith et al. 2008) is a state-of-the-art ocean model that is used currently for operational ocean forecasting in France, and will soon be used in the UK for both ocean forecasting and climate modelling. On a typical modern cluster, a particular one year global ocean simulation at 1-degree resolution takes about three hours when running on 40 processors, and produces roughly 20 GB of output as 50000 separate files. 50-year simulations are common, during which the model is resubmitted as a new job after each year. Running NEMO relies on a set of complicated shell scripts and command utilities for data pre-processing and post-processing prior to job resubmission. Grid Remote Execution (G-Rex) is a pure Java grid middleware system that allows scientific applications to be deployed as Web services on remote computer systems, and then launched and controlled as if they are running on the user's own computer. Although G-Rex is general purpose middleware it has two key features that make it particularly suitable for remote execution of climate models: (1) Output from the model is transferred back to the user while the run is in progress to prevent it from accumulating on the remote system and to allow the user to monitor the model; (2) The client component is a command-line program that can easily be incorporated into existing model work-flow scripts. G-Rex has a REST (Fielding, 2000) architectural style, which allows client programs to be very simple and lightweight and allows users to interact with model runs using only a basic HTTP client (such as a Web browser or the curl utility) if they wish. This design also allows for new client interfaces to be developed in other programming languages with relatively little effort. The G-Rex server is a standard Web application that runs inside a servlet container such as Apache Tomcat and is therefore easy to install and maintain by system administrators. G-Rex is employed as the middleware for the NERC1 Cluster Grid, a small grid of HPC2 clusters belonging to collaborating NERC research institutes. Currently the NEMO (Smith et al. 2008) and POLCOMS (Holt et al, 2008) ocean models are installed, and there are plans to install the Hadley Centre’s HadCM3 model for use in the decadal climate prediction project GCEP (Haines et al., 2008). The science projects involving NEMO on the Grid have a particular focus on data assimilation (Smith et al. 2008), a technique that involves constraining model simulations with observations. The POLCOMS model will play an important part in the GCOMS project (Holt et al, 2008), which aims to simulate the world’s coastal oceans. A typical use of G-Rex by a scientist to run a climate model on the NERC Cluster Grid proceeds as follows :(1) The scientist prepares input files on his or her local machine. (2) Using information provided by the Grid’s Ganglia3 monitoring system, the scientist selects an appropriate compute resource. (3) The scientist runs the relevant workflow script on his or her local machine. This is unmodified except that calls to run the model (e.g. with “mpirun”) are simply replaced with calls to "GRexRun" (4) The G-Rex middleware automatically handles the uploading of input files to the remote resource, and the downloading of output files back to the user, including their deletion from the remote system, during the run. (5) The scientist monitors the output files, using familiar analysis and visualization tools on his or her own local machine. G-Rex is well suited to climate modelling because it addresses many of the middleware usability issues that have led to limited uptake of grid computing by climate scientists. It is a lightweight, low-impact and easy-to-install solution that is currently designed for use in relatively small grids such as the NERC Cluster Grid. A current topic of research is the use of G-Rex as an easy-to-use front-end to larger-scale Grid resources such as the UK National Grid service.

Modelling the global coastal ocean

Shelf and coastal seas are regions of exceptionally high biological productivity, high rates of biogeochemical cycling and immense socio-economic importance. They are, however, poorly represented by the present generation of Earth system models, both in terms of resolution and process representation. Hence, these models cannot be used to elucidate the role of the coastal ocean in global biogeochemical cycles and the effects global change (both direct anthropogenic and climatic) are having on them. Here, we present a system for simulating all the coastal regions around the world (the Global Coastal Ocean Modelling System) in a systematic and practical fashion. It is based on automatically generating multiple nested model domains, using the Proudman Oceanographic Laboratory Coastal Ocean Modelling System coupled to the European Regional Seas Ecosystem Model. Preliminary results from the system are presented. These demonstrate the viability of the concept, and we discuss the prospects for using the system to explore key areas of global change in shelf seas, such as their role in the carbon cycle and climate change effects on fisheries.

Methods and resources for climate impacts research: achieving synergy

The prediction of climate variability and change requires the use of a range of simulation models. Multiple climate model simulations are needed to sample the inherent uncertainties in seasonal to centennial prediction. Because climate models are computationally expensive, there is a tradeoff between complexity, spatial resolution, simulation length, and ensemble size. The methods used to assess climate impacts are examined in the context of this trade-off. An emphasis on complexity allows simulation of coupled mechanisms, such as the carbon cycle and feedbacks between agricultural land management and climate. In addition to improving skill, greater spatial resolution increases relevance to regional planning. Greater ensemble size improves the sampling of probabilities. Research from major international projects is used to show the importance of synergistic research efforts. The primary climate impact examined is crop yield, although many of the issues discussed are relevant to hydrology and health modeling. Methods used to bridge the scale gap between climate and crop models are reviewed. Recent advances include large-area crop modeling, quantification of uncertainty in crop yield, and fully integrated crop–climate modeling. The implications of trends in computer power, including supercomputers, are also discussed.

The implications of projected climate change for freshwater resources and their management

A review of the implications of climate change for freshwater resources, based on Chapter 4 of Working Group 2, IPCC.

Granulometric characterization and evaluation of annually banded mid-Holocene estuarine silts, Welsh Severn Estuary (UK): coastal change, sea level and climate

Holocene silts (salt marshes) and highest intertidal-supratidal peats are superbly exposed on a 15 kin coastal transect which reveals two laterally extensive units of annually banded silts (Beds 3, 7) associated with three transgressive-regressive silt-peat cycles (early sixth-early fourth millennium BC). Bed 3 in places is concordantly and gradationally related to peats above and below, but in others transgresses older strata. Bed 7 also grades up into peat, but everywhere overlies a discordance. The banding in Bed 3 at three main and two minor sites was resolved and characterized texturally at high-resolution (2.5/5 mm contiguous slices) using laser granulometry (LS230 with PIDS) and a comprehensive scheme of data-assessment. Most of Bed 3 formed very rapidly, at peak values of several tens of millimetres annually, in accordance with modelled effects of sea-level fluctuations on mature marshes (bed concordant and gradational) and on marshes growing up after coastal erosion and retreat (bed with discordant base). Using data from the modern Severn Estuary, the textural contrast within bands, and its variation between bands, points to a variable but overall milder mid-Holocene climate than today. The inter-annual variability affected marsh dynamics, as shown by the behaviour of the finely divided plant tissues present. Given local calibration, the methodology is applicable to other tidal systems with banded silts in Britain and mainland northwest Europe. (c) 2006 Elsevier Ltd. All rights reserved.

Modelling nitrogen fluxes from the land surface to the coastal zone in European systems: the perspective of the INCA project

This paper describes the results and conclusions of the INCA (Integrated Nitrogen Model for European CAtchments) project and sets the findings in the context of the ELOISE (European Land-Ocean Interaction Studies) programme. The INCA project was concerned with the development of a generic model of the major factors and processes controlling nitrogen dynamics in European river systems, thereby providing a tool (a) to aid the scientific understanding of nitrogen transport and retention in catchments and (b) for river-basin management and policy-making. The findings of the study highlight the heterogeneity of the factors and processes controlling nitrogen dynamics in freshwater systems. Nonetheless, the INCA model was able to simulate the in-stream nitrogen concentrations and fluxes observed at annual and seasonal timescales in Arctic, Continental and Maritime-Temperate regimes. This result suggests that the data requirements and structural complexity of the INCA model are appropriate to simulate nitrogen fluxes across a wide range of European freshwater environments. This is a major requirement for the production of coupled fiver-estuary-coastal shelf models for the management of our aquatic environment. With regard to river-basin management, to achieve an efficient reduction in nutrient fluxes from the land to the estuarine and coastal zone, the model simulations suggest that management options must be adaptable to the prevailing environmental and socio-economic factors in individual catchments: 'Blanket approaches' to environmental policy appear too simple. (c) 2004 Elsevier B.V. All rights reserved.

Integrated modelling of climate change impacts on water resources and quality in a lowland catchment: River Kennet, UK

An integrated approach to climate change impact assessment is explored by linking established models of regional climate (SDSM), water resources (CATCHMOD) and water quality (INCA) within a single framework. A case study of the River Kennet illustrates how the system can be used to investigate aspects of climate change uncertainty, deployable water resources, and water quality dynamics in upper and lower reaches of the drainage network. The results confirm the large uncertainty in climate change scenarios and freshwater impacts due to the choice of general circulation model (GCM). This uncertainty is shown to be greatest during summer months as evidenced by large variations between GCM-derived projections of future tow river flows, deployable yield from groundwater, severity of nutrient flushing episodes, and Long-term trends in surface water quality. Other impacts arising from agricultural land-use reform or delivery of EU Water Framework Directive objectives under climate change could be evaluated using the same framework. (c) 2006 Elsevier B.V. All rights reserved.