The development of a data-driven application benchmarking approach to performance modelling

Performance modelling is a useful tool in the lifeycle of high performance scientific software, such as weather and climate models, especially as a means of ensuring efficient use of available computing resources. In particular, sufficiently accurate performance prediction could reduce the effort and experimental computer time required when porting and optimising a climate model to a new machine. In this paper, traditional techniques are used to predict the computation time of a simple shallow water model which is illustrative of the computation (and communication) involved in climate models. These models are compared with real execution data gathered on AMD Opteron-based systems, including several phases of the U.K. academic community HPC resource, HECToR. Some success is had in relating source code to achieved performance for the K10 series of Opterons, but the method is found to be inadequate for the next-generation Interlagos processor. The experience leads to the investigation of a data-driven application benchmarking approach to performance modelling. Results for an early version of the approach are presented using the shallow model as an example.

A benchmark-driven modelling approach for evaluating deployment choices on a multi-core architecture

The complexity of current and emerging architectures provides users with options about how best to use the available resources, but makes predicting performance challenging. In this work a benchmark-driven model is developed for a simple shallow water code on a Cray XE6 system, to explore how deployment choices such as domain decomposition and core affinity affect performance. The resource sharing present in modern multi-core architectures adds various levels of heterogeneity to the system. Shared resources often includes cache, memory, network controllers and in some cases floating point units (as in the AMD Bulldozer), which mean that the access time depends on the mapping of application tasks, and the core's location within the system. Heterogeneity further increases with the use of hardware-accelerators such as GPUs and the Intel Xeon Phi, where many specialist cores are attached to general-purpose cores. This trend for shared resources and non-uniform cores is expected to continue into the exascale era. The complexity of these systems means that various runtime scenarios are possible, and it has been found that under-populating nodes, altering the domain decomposition and non-standard task to core mappings can dramatically alter performance. To find this out, however, is often a process of trial and error. To better inform this process, a performance model was developed for a simple regular grid-based kernel code, shallow. The code comprises two distinct types of work, loop-based array updates and nearest-neighbour halo-exchanges. Separate performance models were developed for each part, both based on a similar methodology. Application specific benchmarks were run to measure performance for different problem sizes under different execution scenarios. These results were then fed into a performance model that derives resource usage for a given deployment scenario, with interpolation between results as necessary.

Balanced Ocean-Data Assimilation near the Equator

The question is addressed whether using unbalanced updates in ocean-data assimilation schemes for seasonal forecasting systems can result in a relatively poor simulation of zonal currents. An assimilation scheme, where temperature observations are used for updating only the density field, is compared to a scheme where updates of density field and zonal velocities are related by geostrophic balance. This is done for an equatorial linear shallow-water model. It is found that equatorial zonal velocities can be detoriated if velocity is not updated in the assimilation procedure. Adding balanced updates to the zonal velocity is shown to be a simple remedy for the shallow-water model. Next, optimal interpolation (OI) schemes with balanced updates of the zonal velocity are implemented in two ocean general circulation models. First tests indicate a beneficial impact on equatorial upper-ocean zonal currents.

Evidence for global circuit current flow through water droplet layers

Abstract Foggy air and clear air have appreciably different electrical conductivities. The conductivity gradient at horizontal droplet boundaries causes droplet charging, as a result of vertical current flow in the global atmospheric electrical circuit. The charging is poorly known, as both the current flow through atmospheric water droplet layers and the air conductivity are poorly characterised experimentally. Surface measurements during three days of continuous fog using new instrument techniques show that a shallow (of order 100 m deep) fog layer still permits the vertical conduction current to pass. Further, the conductivity in the fog is estimated to be approximately 20% lower than in clear air. Assuming a fog transition thickness of one metre, this implies a vertical conductivity gradient of order 10 fS m−2 at the boundary. The actual vertical conductivity gradient at a cloud boundary would probably be greater, due to the presence of larger droplets in clouds compared to fog, and cleaner, more conductive clear air aloft.

Modelling the impact of land use change on water quality in agricultural catchments

Export coefficient modelling was used to model the impact of agriculture on nitrogen and phosphorus loading on the surface waters of two contrasting agricultural catchments. The model was originally developed for the Windrush catchment where the highly reactive Jurassic limestone aquifer underlying the catchment is well connected to the surface drainage network, allowing the system to be modelled using uniform export coefficients for each nutrient source in the catchment, regardless of proximity to the surface drainage network. In the Slapton catchment, the hydrological path-ways are dominated by surface and lateral shallow subsurface flow, requiring modification of the export coefficient model to incorporate a distance-decay component in the export coefficients. The modified model was calibrated against observed total nitrogen and total phosphorus loads delivered to Slapton Ley from inflowing streams in its catchment. Sensitivity analysis was conducted to isolate the key controls on nutrient export in the modified model. The model was validated against long-term records of water quality, and was found to be accurate in its predictions and sensitive to both temporal and spatial changes in agricultural practice in the catchment. The model was then used to forecast the potential reduction in nutrient loading on Slapton Ley associated with a range of catchment management strategies. The best practicable environmental option (BPEO) was found to be spatial redistribution of high nutrient export risk sources to areas of the catchment with the greatest intrinsic nutrient retention capacity.

Hydrology and geomorphology of the Upper White Nile lakes and their relevance for water resources management in the Nile basin

Remote sensing data and digital elevation models were utilized to extract the catchment hydrological parameters and to delineate storage areas for the Ugandan Equatorial Lakes region. Available rainfall/discharge data are integrated with these morphometric data to construct a hydrological model that simulates the water balance of the different interconnected basins and enables the impact of potential management options to be examined. The total annual discharges of the basins are generally very low (less than 7% of the total annual rainfall). The basin of the shallow (5 m deep) Lake Kioga makes only a minor hydrological contribution compared with other Equatorial Lakes, because most of the overflow from Lake Victoria basin into Lake Kioga is lost by evaporation and evapotranspiration. The discharge from Lake Kioga could be significantly increased by draining the swamps through dredging and deepening certain channel reaches. Development of hydropower dams on the Equatorial Lakes will have an adverse impact on the annual water discharge downstream, including the occasional reduction of flow required for filling up to designed storage capacities and permanently increasing the surface areas of water that is exposed to evaporation. On the basis of modelling studies, alternative sites are proposed for hydropower development and water storage schemes

Commensalism in an agroecosystem: hydraulic redistribution by deep-rooted legumes improves survival of a droughted shallow-rooted legume companion

We investigated commensalism of water use among annual shallow-rooted and perennial deep-rooted pasture legumes by examining the effect of hydraulic lift by Cullen pallidum (N.T.Burb.) J.W.Grimes and Medicago sativa on growth, survival and nutrient uptake of Trifolium subterraneum L. A vertically split-root design allowed separate control of soil water in top and bottom soil. Thirty-five days after watering ceased in the top tube, but soil remained at field capacity in the bottom tube, an increase in shallow soil water content by hydraulic lift was 5.6 and 5.9 g kg−1 soil overnight for C. pallidum and M. sativa, respectively. Trifolium subterraneum in this treatment maintained higher leaf water potentials (with M. sativa) or exhibited a slower decline (with C. pallidum) than without companion perennial plants; and shoot biomass of T. subterraneum was 56% (with C. pallidum) and 67% (with M. sativa) of that when both top and bottom tubes were at field capacity. Uptake of rubidium (a potassium analog) and phosphorus by T. subterraneum was not facilitated by hydraulic lift. Interestingly, phosphorus content was threefold greater, and shoot biomass 1.5–3.3-fold greater when T. subterraneum was interplanted with C. pallidum compared with M. sativa, although dry weight of C. pallidum was much greater than that of M. sativa. This study showed that interplanting with deep-rooted perennial legumes has benefited the survival of T. subterraneum.

Season changes in water quality and Sargassum biomass in Southwest Australia

Sargassum C. Agardh is one of the most diverse genera of marine macro-algae and commonly inhabits shallow tropical and sub-tropical waters. This study aimed to investigate the effect of seasonality and the associated water quality changes on the distribution, canopy cover, mean thallus length and the biomass of Sargassum beds around Point Peron, Shoalwater Islands Marine Park, Southwest Australia. Samples of Sargassum and seawater were collected every three months from summer 2012 to summer 2014 from four different reef zones. A combination of in situ observations and WorldView-2 satellite remote-sensing images were used to map the spatial distribution of Sargassum beds and other associated benthic habitats. The results demonstrated a strong seasonal variation in the environmental parameters, canopy cover, mean thallus length, and biomass of Sargassum, which were significantly (P < 0.05) influenced by the nutrient concentration (PO43-, NO3-, NH4+) and rainfall. However, no variation in any studied parameter was observed among the four reef zones. The highest Sargassum biomass peaks occurred between late spring and early summer (from September to January). The results provide essential information to guide effective conservation and management, as well as sustainable utilisation of this coastal marine renewable resource.