Fast regridding of large, complex geospatial datasets

In the earth sciences, data are commonly cast on complex grids in order to model irregular domains such as coastlines, or to evenly distribute grid points over the globe. It is common for a scientist to wish to re-cast such data onto a grid that is more amenable to manipulation, visualization, or comparison with other data sources. The complexity of the grids presents a significant technical difficulty to the regridding process. In particular, the regridding of complex grids may suffer from severe performance issues, in the worst case scaling with the product of the sizes of the source and destination grids. We present a mechanism for the fast regridding of such datasets, based upon the construction of a spatial index that allows fast searching of the source grid. We discover that the most efficient spatial index under test (in terms of memory usage and query time) is a simple look-up table. A kd-tree implementation was found to be faster to build and to give similar query performance at the expense of a larger memory footprint. Using our approach, we demonstrate that regridding of complex data may proceed at speeds sufficient to permit regridding on-the-fly in an interactive visualization application, or in a Web Map Service implementation. For large datasets with complex grids the new mechanism is shown to significantly outperform algorithms used in many scientific visualization packages.

Simulations of the London urban heat island

We present simulations of London's meteorology using the Met Office Unified Model with a new, sophisticated surface energy-balance scheme to represent the urban surfaces, called MORUSES. Simulations are performed with the urban surfaces represented and with the urban surfaces replaced with grass in order to calculate the urban increment on the local meteorology. The local urban effects were moderated to some extent by the passage of an onshore flow that propagated up the Thames estuary and across the city, cooling London slightly in the afternoon. Validations of screen-level temperature show encouraging agreement to within 1–2 K, when the urban increment is up to 5 K. The model results are then used to examine factors shaping the spatial and temporal structure of London's atmospheric boundary layer. The simulations reconcile the differences in the temporal evolution of the urban heat island (UHI) shown in various studies and demonstrate that the variation of UHI with time depends strongly on the urban fetch. The UHI at a location downwind of the city centre shows a decrease in UHI during the night, while the UHI at the city centre stays constant. Finally, the UHI at a location upwind of the city centre increases continuously. The magnitude of the UHI by the time of the evening transition increases with urban fetch. The urban increments are largest at night, when the boundary layer is shallow. The boundary layer experiences continued warming after sunset, as the heat from the urban fabric is released, and a weakly convective boundary layer develops across the city. The urban land-use fraction is the dominant control on the spatial structure in the sensible heat flux and the resulting urban increment, although even the weak advection present in this case study is sufficient to advect the peak temperature increments downwind of the most built-up areas. Copyright © 2011 Royal Meteorological Society and British Crown Copyright, the Met Office

Cooperative task support for the control room

The National Grid Company plc. owns and operates the electricity transmission network in England and Wales, the day to day running of the network being carried out by teams of engineers within the national control room. The task of monitoring and operating the transmission network involves the transfer of large amounts of data and a high degree of cooperation between these engineers. The purpose of the research detailed in this paper is to investigate the use of interfacing techniques within the control room scenario, in particular, the development of an agent based architecture for the support of cooperative tasks. The proposed architecture revolves around the use of interface and user supervisor agents. Primarily, these agents are responsible for the flow of information to and from individual users and user groups. The agents are also responsible for tackling the synchronisation and control issues arising during the completion of cooperative tasks. In this paper a novel approach to human computer interaction (HCI) for power systems incorporating an embedded agent infrastructure is presented. The agent architectures used to form the base of the cooperative task support system are discussed, as is the nature of the support system and tasks it is intended to support.

HCI issues in power systems

With the advance of information technology capabilities, and the importance of human computer interfaces within society there has been a significant increase in research activity within the field of human computer interaction (HCI). This paper summarizes some of the work undertaken to date, paying particular attention to methods applicable to on-line control and monitoring systems such as those employed by The National Grid Company plc.

Resolving the spatial variability of soil N using fractions of soil organic matter

The spatial variability of soil nitrogen (N) mineralisation has not been extensively studied, which limits our capacity to make N fertiliser recommendations. Even less attention has been paid to the scale-dependence of the variation. The objective of this research was to investigate the scale-dependence of variation of mineral N (MinN, N–NO3− plus N–NH4+) at within-field scales. The study was based on the spatial dependence of the labile fractions of SOM, the key fractions for N mineralisation. Soils were sampled in an unbalanced nested design in a 4-ha arable field to examine the distribution of the variation of SOM at 30, 10, 1, and 0.12 m. Organic matter in free and intra-aggregate light fractions (FLF and IALF) was extracted by physical fractionation. The variation occurred entirely within 0.12 m for FLF and at 10 m for IALF. A subsequent sampling on a 5-m grid was undertaken to link the status of the SOM fractions to MinN, which showed uncorrelated spatial dependence. A uniform application of N fertiliser would be suitable in this case. The failure of SOM fractions to identify any spatial dependence of MinN suggests that other soil variables, or crop indicators, should be tested to see if they can identify different N supply areas within the field for a more efficient and environmentally friendly N management.

An investigation of the impact of time of generation on carbon savings from PV systems in Great Britain

PV only generates electricity during daylight hours and primarily generates over summer. In the UK, the carbon intensity of grid electricity is higher during the daytime and over winter. This work investigates whether the grid electricity displaced by PV is high or low carbon compared to the annual mean carbon intensity using carbon factors at higher temporal resolutions (half-hourly and daily). UK policy for carbon reporting requires savings to be calculated using the annual mean carbon intensity of grid electricity. This work offers an insight into whether this technique is appropriate. Using half hourly data on the generating plant supplying the grid from November 2008 to May 2010, carbon factors for grid electricity at half-hourly and daily resolution have been derived using technology specific generation emission factors. Applying these factors to generation data from PV systems installed on schools, it is possible to assess the variation in the carbon savings from displacing grid electricity with PV generation using carbon factors with different time resolutions. The data has been analyzed for a period of 363 to 370 days and so cannot account for inter-year variations in the relationship between PV generation and carbon intensity of the electricity grid. This analysis suggests that PV displaces more carbon intensive electricity using half-hourly carbon factors than using daily factors but less compared with annual ones. A similar methodology could provide useful insights on other variable renewable and demand-side technologies and in other countries where PV performance and grid behavior are different.

An automated calibration method for non-see-through head mounted displays

Accurate calibration of a head mounted display (HMD) is essential both for research on the visual system and for realistic interaction with virtual objects. Yet, existing calibration methods are time consuming and depend on human judgements, making them error prone, and are often limited to optical see-through HMDs. Building on our existing approach to HMD calibration Gilson et al. (2008), we show here how it is possible to calibrate a non-see-through HMD. A camera is placed inside a HMD displaying an image of a regular grid, which is captured by the camera. The HMD is then removed and the camera, which remains fixed in position, is used to capture images of a tracked calibration object in multiple positions. The centroids of the markers on the calibration object are recovered and their locations re-expressed in relation to the HMD grid. This allows established camera calibration techniques to be used to recover estimates of the HMD display's intrinsic parameters (width, height, focal length) and extrinsic parameters (optic centre and orientation of the principal ray). We calibrated a HMD in this manner and report the magnitude of the errors between real image features and reprojected features. Our calibration method produces low reprojection errors without the need for error-prone human judgements.

The elasticity of demand is about occupancy, not prices: building European demand curves based on occupancy elasticity

The peak congestion of the European grid may create significant impacts on system costs because of the need for higher marginal cost generation, higher cost system balancing and increasing grid reinforcement investment. The use of time of use rates, incentives, real time pricing and other programmes, usually defined as Demand Side Management (DSM), could bring about significant reductions in prices, limit carbon emissions from dirty power plants, and improve the integration of renewable sources of energy. Unlike previous studies on elasticity of residential electricity demand under flat tariffs, the aim of this study is not to investigate the known relatively inelastic relationship between demand and prices. Rather, the aim is to assess how occupancy levels vary in different European countries. This reflects the reality of demand loads, which are predominantly determined by the timing of human activities (e.g. travelling to work, taking children to school) rather than prices. To this end, two types of occupancy elasticity are estimated: baseline occupancy elasticity and peak occupancy elasticity. These represent the intrinsic elasticity associated with human activities of single residential end-users in 15 European countries. This study makes use of occupancy time-series data from the Harmonised European Time Use Survey database to build European occupancy curves; identify peak occupancy periods; draw time use demand curves for video and TV watching activity; and estimate national occupancy elasticity levels of single-occupant households. Findings on occupancy elasticities provide an indication of possible DSM strategies based on occupancy levels and not prices.

Cloud-base vertical velocity statistics: a comparison between an atmospheric mesoscale model and remote sensing observations

The statistics of cloud-base vertical velocity simulated by the non-hydrostatic mesoscale model AROME are compared with Cloudnet remote sensing observations at two locations: the ARM SGP site in Central Oklahoma, and the DWD observatory at Lindenberg, Germany. The results show that, as expected, AROME significantly underestimates the variability of vertical velocity at cloud-base compared to observations at their nominal resolution; the standard deviation of vertical velocity in the model is typically 4-6 times smaller than observed, and even more during the winter at Lindenberg. Averaging the observations to the horizontal scale corresponding to the physical grid spacing of AROME (2.5 km) explains 70-80% of the underestimation by the model. Further averaging of the observations in the horizontal is required to match the model values for the standard deviation in vertical velocity. This indicates an effective horizontal resolution for the AROME model of at least 4 times the physically-defined grid spacing. The results illustrate the need for special treatment of sub-grid scale variability of vertical velocities in kilometer-scale atmospheric models, if processes such as aerosol-cloud interactions are to be included in the future.

Large-scale length and time scales for use with stochastic convective parameterization

Many numerical models for weather prediction and climate studies are run at resolutions that are too coarse to resolve convection explicitly, but too fine to justify the local equilibrium assumed by conventional convective parameterizations. The Plant-Craig (PC) stochastic convective parameterization scheme, developed in this paper, solves this problem by removing the assumption that a given grid-scale situation must always produce the same sub-grid-scale convective response. Instead, for each timestep and gridpoint, one of the many possible convective responses consistent with the large-scale situation is randomly selected. The scheme requires as input the large-scale state as opposed to the instantaneous grid-scale state, but must nonetheless be able to account for genuine variations in the largescale situation. Here we investigate the behaviour of the PC scheme in three-dimensional simulations of radiative-convective equilibrium, demonstrating in particular that the necessary space-time averaging required to produce a good representation of the input large-scale state is not in conflict with the requirement to capture large-scale variations. The resulting equilibrium profiles agree well with those obtained from established deterministic schemes, and with corresponding cloud-resolving model simulations. Unlike the conventional schemes the statistics for mass flux and rainfall variability from the PC scheme also agree well with relevant theory and vary appropriately with spatial scale. The scheme is further shown to adapt automatically to changes in grid length and in forcing strength.

The diurnal cycle in the tropics

A global archive of high-resolution (3-hourly, 0.58 latitude–longitude grid) window (11–12 mm) brightness temperature (Tb) data from multiple satellites is being developed by the European Union Cloud Archive User Service (CLAUS) project. It has been used to construct a climatology of the diurnal cycle in convection, cloudiness, and surface temperature for all regions of the Tropics. An example of the application of the climatology to the evaluation of the climate version of the U.K. Met. Office Unified Model (UM), version HadAM3, is presented. The characteristics of the diurnal cycle described by the CLAUS data agree with previous observational studies, demonstrating the universality of the characteristics of the diurnal cycle for land versus ocean, clear sky versus convective regimes. It is shown that oceanic deep convection tends to reach its maximum in the early morning. Continental convection generally peaks in the evening, although there are interesting regional variations, indicative of the effects of complex land–sea and mountain–valley breezes, as well as the life cycle of mesoscale convective systems. A striking result from the analysis of the CLAUS data has been the extent to which the strong diurnal signal over land is spread out over the adjacent oceans, probably through gravity waves of varying depths. These coherent signals can be seen for several hundred kilometers and in some instances, such as over the Bay of Bengal, can lead to substantial diurnal variations in convection and precipitation. The example of the use of the CLAUS data in the evaluation of the Met. Office UM has demonstrated that the model has considerable difficulty in capturing the observed phase of the diurnal cycle in convection, which suggests some fundamental difficulties in the model’s physical parameterizations. Analysis of the diurnal cycle represents a powerful tool for identifying and correcting model deficiencies.

Working Group 1: Future developments in deterministic and stochastic parametrizations

Our group considered the desirability of including representations of uncertainty in the development of parameterizations. (By ‘uncertainty’ here we mean the deviation of sub-grid scale fluxes or tendencies in any given model grid box from truth.) We unanimously agreed that the ECWMF should attempt to provide a more physical basis for uncertainty estimates than the very effective but ad hoc methods being used at present. Our discussions identified several issues that will arise.

Sub-agent elements for control methods in multi-agent energy management system

Increased penetration of generation and decentralised control are considered to be feasible and effective solution for reducing cost and emissions and hence efficiency associated with power generation and distribution. Distributed generation in combination with the multi-agent technology are perfect candidates for this solution. Pro-active and autonomous nature of multi-agent systems can provide an effective platform for decentralised control whilst improving reliability and flexibility of the grid.

Evaluation of ice cloud representation in the ECMWF and UK Met Office models using CloudSat and CALIPSO data

Ice cloud representation in general circulation models remains a challenging task, due to the lack of accurate observations and the complexity of microphysical processes. In this article, we evaluate the ice water content (IWC) and ice cloud fraction statistical distributions from the numerical weather prediction models of the European Centre for Medium-Range Weather Forecasts (ECMWF) and the UK Met Office, exploiting the synergy between the CloudSat radar and CALIPSO lidar. Using the last three weeks of July 2006, we analyse the global ice cloud occurrence as a function of temperature and latitude and show that the models capture the main geographical and temperature-dependent distributions, but overestimate the ice cloud occurrence in the Tropics in the temperature range from −60 °C to −20 °C and in the Antarctic for temperatures higher than −20 °C, but underestimate ice cloud occurrence at very low temperatures. A global statistical comparison of the occurrence of grid-box mean IWC at different temperatures shows that both the mean and range of IWC increases with increasing temperature. Globally, the models capture most of the IWC variability in the temperature range between −60 °C and −5 °C, and also reproduce the observed latitudinal dependencies in the IWC distribution due to different meteorological regimes. Two versions of the ECMWF model are assessed. The recent operational version with a diagnostic representation of precipitating snow and mixed-phase ice cloud fails to represent the IWC distribution in the −20 °C to 0 °C range, but a new version with prognostic variables for liquid water, ice and snow is much closer to the observed distribution. The comparison of models and observations provides a much-needed analysis of the vertical distribution of IWC across the globe, highlighting the ability of the models to reproduce much of the observed variability as well as the deficiencies where further improvements are required.

Spatial disaggregation and intensity correction of TRMM-based rainfall time series for hydrological applications in dryland catchments

A novel approach is presented for combining spatial and temporal detail from newly available TRMM-based data sets to derive hourly rainfall intensities at 1-km spatial resolution for hydrological modelling applications. Time series of rainfall intensities derived from 3-hourly 0.25° TRMM 3B42 data are merged with a 1-km gridded rainfall climatology based on TRMM 2B31 data to account for the sub-grid spatial distribution of rainfall intensities within coarse-scale 0.25° grid cells. The method is implemented for two dryland catchments in Tunisia and Senegal, and validated against gauge data. The outcomes of the validation show that the spatially disaggregated and intensity corrected TRMM time series more closely approximate ground-based measurements than non-corrected data. The method introduced here enables the generation of rainfall intensity time series with realistic temporal and spatial detail for dynamic modelling of runoff and infiltration processes that are especially important to water resource management in arid regions.