An integrated view of data quality in Earth observation

Data quality is a difficult notion to define precisely, and different communities have different views and understandings of the subject. This causes confusion, a lack of harmonization of data across communities and omission of vital quality information. For some existing data infrastructures, data quality standards cannot address the problem adequately and cannot fulfil all user needs or cover all concepts of data quality. In this study, we discuss some philosophical issues on data quality. We identify actual user needs on data quality, review existing standards and specifications on data quality, and propose an integrated model for data quality in the field of Earth observation (EO). We also propose a practical mechanism for applying the integrated quality information model to a large number of datasets through metadata inheritance. While our data quality management approach is in the domain of EO, we believe that the ideas and methodologies for data quality management can be applied to wider domains and disciplines to facilitate quality-enabled scientific research.

Evaluation of biospheric components in Earth system models using modern and palaeo-observations: the state-of-the-art

Earth system models (ESMs) are increasing in complexity by incorporating more processes than their predecessors, making them potentially important tools for studying the evolution of climate and associated biogeochemical cycles. However, their coupled behaviour has only recently been examined in any detail, and has yielded a very wide range of outcomes. For example, coupled climate–carbon cycle models that represent land-use change simulate total land carbon stores at 2100 that vary by as much as 600 Pg C, given the same emissions scenario. This large uncertainty is associated with differences in how key processes are simulated in different models, and illustrates the necessity of determining which models are most realistic using rigorous methods of model evaluation. Here we assess the state-of-the-art in evaluation of ESMs, with a particular emphasis on the simulation of the carbon cycle and associated biospheric processes. We examine some of the new advances and remaining uncertainties relating to (i) modern and palaeodata and (ii) metrics for evaluation. We note that the practice of averaging results from many models is unreliable and no substitute for proper evaluation of individual models. We discuss a range of strategies, such as the inclusion of pre-calibration, combined process- and system-level evaluation, and the use of emergent constraints, that can contribute to the development of more robust evaluation schemes. An increasingly data-rich environment offers more opportunities for model evaluation, but also presents a challenge. Improved knowledge of data uncertainties is still necessary to move the field of ESM evaluation away from a "beauty contest" towards the development of useful constraints on model outcomes.

Cloud-radar observations of insects in the UK convective boundary layer

Radar has been applied to the study of insect migration for almost 40 years, but most entomological radars operate at X-band (9.4 GHz, 3.2 cm wavelength), and can only detect individuals of relatively large species, such as migratory grasshoppers and noctuid moths, over all of their flight altitudes. Many insects (including economically important species) are much smaller than this, but development of the requisite higher power and/or higher frequency radar systems to detect these species is often prohibitively expensive. In this paper, attention is focussed upon the uses of some recently-deployed meteorological sensing devices to investigate insect migratory flight behaviour, and especially its interactions with boundary layer processes. Records were examined from the vertically-pointing 35 GHz ‘Copernicus’ and 94 GHz ‘Galileo’ cloud radars at Chilbolton (Hampshire, England) for 12 cloudless and convective occasions in summer 2003, and one of these occasions (13 July) is presented in detail. Insects were frequently found at heights above aerosol particles, which represent passive tracers, indicating active insect movement. It was found that insect flight above the convective boundary layer occurs most often during the morning. The maximum radar reflectivity (an indicator of aerial insect biomass) was found to be positively correlated with maximum screen temperature.

Radar studies of the vertical distribution of insects migrating over southern Britain: the influence of temperature inversions on nocturnal layer concentrations

Insects migrating over two sites in southern UK (Malvern in Worcestershire, and Harpenden in Hertfordshire) have been monitored continuously with nutating vertical-looking radars (VLRs) equipped with powerful control and analysis software. These observations make possible, for the first time, a systematic investigation of the vertical distribution of insect aerial density in the atmosphere, over temporal scales ranging from the short (instantaneous vertical profiles updated every 15 min) to the very long (profiles aggregated over whole seasons or even years). In the present paper, an outline is given of some general features of insect stratification as revealed by the radars, followed by a description of occasions during warm nights in the summer months when intense insect layers developed. Some of these nocturnal layers were due to the insects flying preferentially at the top of strong surface temperature inversions, and in other cases, layering was associated with higher-altitude temperature maxima, such as those due to subsidence inversions. The layers were formed from insects of a great variety of sizes, but peaks in the mass distributions pointed to a preponderance of medium-sized noctuid moths on certain occasions.

Use of a portable topographic mapping millimetre wave radar at an active lava flow

A ground-based millimetre wave radar, AVTIS (All-weather Volcano Topography Imaging Sensor), has been developed for topographic monitoring. The instrument is portable and capable of measurements over ranges up to similar to 7 km through cloud and at night. In April and May 2005, AVTIS was deployed at Arenal Volcano, Costa Rica, in order to determine topographic changes associated with the advance of a lava flow. This is the first reported application of mm-wave radar technology to the measurement of lava flux rates. Three topographic data sets of the flow were acquired from observation distances of similar to 3 km over an eight day period, during which the flow front was detected to have advanced similar to 200 m. Topographic differences between the data sets indicated a flow thickness of similar to 10 m, and a dense rock equivalent lava flux of similar to 0.20 +/- 0.08 m(3) s(-1).

Ground deformation at Soufriere Hills Volcano, Montserrat during 1998-2000 measured by radar interferometry and GPS

We examine the motion of the ground surface on the Soufriere Hills Volcano, Montserrat between 1998 and 2000 using radar interferometry (InSAR). To minimise the effects of variable atmospheric water vapour on the InSAR measurements we use independently-derived measurements of the radar path delay from six continuous GPS receivers. The surfaces providing a measurable inter-ferometric signal are those on pyroclastic flow deposits, mainly emplaced in 1997. Three types of surface motion can be discriminated. Firstly, the surfaces of thick, valley-filling deposits subsided at rates of 150-120 mm/year in the year after emplacement to 50-30 mm/year two years later. This must be due to contraction and settling effects during cooling. The second type is the near-field motion localised within about one kilometre of the dome. Both subsidence and uplift events are seen and though the former could be due to surface gravitational effects, the latter may reflect shallow (< 1 km) pressurisation effects within the conduit/dome. Far-field motions of the surface away from the deeply buried valleys are interpreted as crustal strains. Because the flux of magma to the surface stopped from March 1998 to November 1999 and then resumed from November 1999 through 2000, we use InSAR data from these two periods to test the crustal strain behaviour of three models of magma supply: open, depleting and unbalanced. The InSAR observations of strain gradients of 75-80 mm/year/krn uplift during the period of quiescence on the western side of the volcano are consistent with an unbalanced model in which magma supply into a crustal magma chamber continues during quiescence, raising chamber pressure that is then released upon resumption of effusion. GPS motion vectors agree qualitatively with the InSAR displacements but are of smaller magnitude. The discrepancy may be due to inaccurate compensation for atmospheric delays in the InSAR data. (c) 2005 Elsevier B.V. All rights reserved.

Data assimilation: From photon counts to Earth System forecasts

Data assimilation – the set of techniques whereby information from observing systems and models is combined optimally – is rapidly becoming prominent in endeavours to exploit Earth Observation for Earth sciences, including climate prediction. This paper explains the broad principles of data assimilation, outlining different approaches (optimal interpolation, three-dimensional and four-dimensional variational methods, the Kalman Filter), together with the approximations that are often necessary to make them practicable. After pointing out a variety of benefits of data assimilation, the paper then outlines some practical applications of the exploitation of Earth Observation by data assimilation in the areas of operational oceanography, chemical weather forecasting and carbon cycle modelling. Finally, some challenges for the future are noted.

Dispersion Experiments in Central London: The 2007 DAPPLE project

In the event of a release of toxic gas in the center of London, the emergency services would need to determine quickly the extent of the area contaminated. The transport of pollutants by turbulent flow within the complex street and building architecture of cities is not straightforward, and we might wonder whether it is at all possible to make a scientifically-reasoned decision. Here we describe recent progress from a major UK project, ‘Dispersion of Air Pollution and its Penetration into the Local Environment’ (DAPPLE, www.dapple.org.uk). In DAPPLE, we focus on the movement of airborne pollutants in cities by developing a greater understanding of atmospheric flow and dispersion within urban street networks. In particular, we carried out full-scale dispersion experiments in central London (UK) during 2003, 2004, 2007, and 2008 to address the extent of the dispersion of tracers following their release at street level. These measurements complemented previous studies because (i) our focus was on dispersion within the first kilometer from the source, when most of the material was expected to remain within the street network rather than being mixed into the boundary layer aloft, (ii) measurements were made under a wide variety of meteorological conditions, and (iii) central London represents a European, rather than North American, city geometry. Interpretation of the results from the full-scale experiments was supported by extensive numerical and wind tunnel modeling, which allowed more detailed analysis under idealized and controlled conditions. In this article, we review the full-scale DAPPLE methodologies and show early results from the analysis of the 2007 field campaign data.

Flight periodicity and the vertical distribution of high-altitude moth migration over southern Britain

The continuous operation of insect-monitoring radars in the UK has permitted, for the first time, the characterization of various phenomena associated with high-altitude migration of large insects over this part of northern Europe. Previous studies have taken a case-study approach, concentrating on a small number of nights of particular interest. Here, combining data from two radars, and from an extensive suction- and light-trapping network, we have undertaken a more systematic, longer-term study of diel flight periodicity and vertical distribution of macro-insects in the atmosphere. Firstly, we identify general features of insect abundance and stratification, occurring during the 24-hour cycle, which emerge from four years’ aggregated radar data for the summer months in southern Britain. These features include mass emigrations at dusk and to a lesser extent at dawn, and daytime concentrations associated with thermal convection. We then focus our attention on the well-defined layers of large nocturnal migrants that form in the early evening, usually at heights of 200–500 m above ground. We present evidence from both radar and trap data that these nocturnal layers are composed mainly of noctuid moths, with species such as Noctua pronuba, Autographa gamma, Agrotis exclamationis, A. segetum, Xestia c-nigrum and Phlogophora meticulosa predominating.