Quantifying uncertainty in remotely sensed land cover maps

Remotely sensed land cover maps are increasingly used as inputs into environmental simulation models whose outputs inform decisions and policy-making. Risks associated with these decisions are dependent on model output uncertainty, which is in turn affected by the uncertainty of land cover inputs. This article presents a method of quantifying the uncertainty that results from potential mis-classification in remotely sensed land cover maps. In addition to quantifying uncertainty in the classification of individual pixels in the map, we also address the important case where land cover maps have been upscaled to a coarser grid to suit the users’ needs and are reported as proportions of land cover type. The approach is Bayesian and incorporates several layers of modelling but is straightforward to implement. First, we incorporate data in the confusion matrix derived from an independent field survey, and discuss the appropriate way to model such data. Second, we account for spatial correlation in the true land cover map, using the remotely sensed map as a prior. Third, spatial correlation in the mis-classification characteristics is induced by modelling their variance. The result is that we are able to simulate posterior means and variances for individual sites and the entire map using a simple Monte Carlo algorithm. The method is applied to the Land Cover Map 2000 for the region of England and Wales, a map used as an input into a current dynamic carbon flux model.

Complex dynamics in simple systems with periodic parameter oscillations

We study systems with periodically oscillating parameters that can give way to complex periodic or nonperiodic orbits. Performing the long time limit, we can define ergodic averages such as Lyapunov exponents, where a negative maximal Lyapunov exponent corresponds to a stable periodic orbit. By this, extremely complicated periodic orbits composed of contracting and expanding phases appear in a natural way. Employing the technique of ϵ-uncertain points, we find that values of the control parameters supporting such periodic motion are densely embedded in a set of values for which the motion is chaotic. When a tiny amount of noise is coupled to the system, dynamics with positive and with negative nontrivial Lyapunov exponents are indistinguishable. We discuss two physical systems, an oscillatory flow inside a duct and a dripping faucet with variable water supply, where such a mechanism seems to be responsible for a complicated alternation of laminar and turbulent phases.

Government policy under price uncertainty: a source of volatility in illegal immigration

In this paper we provide an alternative explanation for why illegal immigration can exhibit substantial fluctuation. We develop a model economy in which migrants make decisions in the face of uncertain border enforcement and lump-sum transfers from the host country. The uncertainty is extrinsic in nature, a sunspot, and arises as a result of ambiguity regarding the commodity price of money. Migrants are restricted from participating in state-contingent insurance markets in the host country, whereas host country natives are not. Volatility in migration flows stems from two distinct sources: the tension between transfers inducing migration and enforcement discouraging it and secondly the existence of a sunspot. Finally, we examine the impact of a change in tax/transfer policies by the government on migration.

Simple uncertainty frameworks for selecting weighting schemes and interpreting multimodel ensemble climate change experiments

Future climate change projections are often derived from ensembles of simulations from multiple global circulation models using heuristic weighting schemes. This study provides a more rigorous justification for this by introducing a nested family of three simple analysis of variance frameworks. Statistical frameworks are essential in order to quantify the uncertainty associated with the estimate of the mean climate change response. The most general framework yields the “one model, one vote” weighting scheme often used in climate projection. However, a simpler additive framework is found to be preferable when the climate change response is not strongly model dependent. In such situations, the weighted multimodel mean may be interpreted as an estimate of the actual climate response, even in the presence of shared model biases. Statistical significance tests are derived to choose the most appropriate framework for specific multimodel ensemble data. The framework assumptions are explicit and can be checked using simple tests and graphical techniques. The frameworks can be used to test for evidence of nonzero climate response and to construct confidence intervals for the size of the response. The methodology is illustrated by application to North Atlantic storm track data from the Coupled Model Intercomparison Project phase 5 (CMIP5) multimodel ensemble. Despite large variations in the historical storm tracks, the cyclone frequency climate change response is not found to be model dependent over most of the region. This gives high confidence in the response estimates. Statistically significant decreases in cyclone frequency are found on the flanks of the North Atlantic storm track and in the Mediterranean basin.

Present state of global wetland extent and wetland methane modelling: conclusions from a model inter-comparison project (WETCHIMP)

Global wetlands are believed to be climate sensitive, and are the largest natural emitters of methane (CH4). Increased wetland CH4 emissions could act as a positive feedback to future warming. The Wetland and Wetland CH4 Inter-comparison of Models Project (WETCHIMP) investigated our present ability to simulate large-scale wetland characteristics and corresponding CH4 emissions. To ensure inter-comparability, we used a common experimental protocol driving all models with the same climate and carbon dioxide (CO2) forcing datasets. The WETCHIMP experiments were conducted for model equilibrium states as well as transient simulations covering the last century. Sensitivity experiments investigated model response to changes in selected forcing inputs (precipitation, temperature, and atmospheric CO2 concentration). Ten models participated, covering the spectrum from simple to relatively complex, including models tailored either for regional or global simulations. The models also varied in methods to calculate wetland size and location, with some models simulating wetland area prognostically, while other models relied on remotely sensed inundation datasets, or an approach intermediate between the two. Four major conclusions emerged from the project. First, the suite of models demonstrate extensive disagreement in their simulations of wetland areal extent and CH4 emissions, in both space and time. Simple metrics of wetland area, such as the latitudinal gradient, show large variability, principally between models that use inundation dataset information and those that independently determine wetland area. Agreement between the models improves for zonally summed CH4 emissions, but large variation between the models remains. For annual global CH4 emissions, the models vary by ±40% of the all-model mean (190 Tg CH4 yr−1). Second, all models show a strong positive response to increased atmospheric CO2 concentrations (857 ppm) in both CH4 emissions and wetland area. In response to increasing global temperatures (+3.4 °C globally spatially uniform), on average, the models decreased wetland area and CH4 fluxes, primarily in the tropics, but the magnitude and sign of the response varied greatly. Models were least sensitive to increased global precipitation (+3.9 % globally spatially uniform) with a consistent small positive response in CH4 fluxes and wetland area. Results from the 20th century transient simulation show that interactions between climate forcings could have strong non-linear effects. Third, we presently do not have sufficient wetland methane observation datasets adequate to evaluate model fluxes at a spatial scale comparable to model grid cells (commonly 0.5°). This limitation severely restricts our ability to model global wetland CH4 emissions with confidence. Our simulated wetland extents are also difficult to evaluate due to extensive disagreements between wetland mapping and remotely sensed inundation datasets. Fourth, the large range in predicted CH4 emission rates leads to the conclusion that there is both substantial parameter and structural uncertainty in large-scale CH4 emission models, even after uncertainties in wetland areas are accounted for.

Multi-site evaluation of an urban land-surface model: intra-urban heterogeneity, seasonality and parameter complexity requirements

An extensive off-line evaluation of the Noah/Single Layer Urban Canopy Model (Noah/SLUCM) urban land-surface model is presented using data from 15 sites to assess (1) the ability of the scheme to reproduce the surface energy balance observed in a range of urban environments, including seasonal changes, and (2) the impact of increasing complexity of input parameter information. Model performance is found to be most dependent on representation of vegetated surface area cover; refinement of other parameter values leads to smaller improvements. Model biases in net all-wave radiation and trade-offs between turbulent heat fluxes are highlighted using an optimization algorithm. Here we use the Urban Zones to characterize Energy partitioning (UZE) as the basis to assign default SLUCM parameter values. A methodology (FRAISE) to assign sites (or areas) to one of these categories based on surface characteristics is evaluated. Using three urban sites from the Basel Urban Boundary Layer Experiment (BUBBLE) dataset, an independent evaluation of the model performance with the parameter values representative of each class is performed. The scheme copes well with both seasonal changes in the surface characteristics and intra-urban heterogeneities in energy flux partitioning, with RMSE performance comparable to similar state-of-the-art models for all fluxes, sites and seasons. The potential of the methodology for high-resolution atmospheric modelling application using the Weather Research and Forecasting (WRF) model is highlighted. This analysis supports the recommendations that (1) three classes are appropriate to characterize the urban environment, and (2) that the parameter values identified should be adopted as default values in WRF.

Black carbon vertical profiles strongly affect its radiative forcing uncertainty

The impact of black carbon (BC) aerosols on the global radiation balance is not well constrained. Here twelve global aerosol models are used to show that at least 20% of the present uncertainty in modeled BC direct radiative forcing (RF) is due to diversity in the simulated vertical profile of BC mass. Results are from phases 1 and 2 of the global aerosol model intercomparison project (AeroCom). Additionally, a significant fraction of the variability is shown to come from high altitudes, as, globally, more than 40% of the total BC RF is exerted above 5 km. BC emission regions and areas with transported BC are found to have differing characteristics. These insights into the importance of the vertical profile of BC lead us to suggest that observational studies are needed to better characterize the global distribution of BC, including in the upper troposphere.

Consistent and contrasting decadal Arctic sea ice thickness predictions from a highly optimized sea ice model

[1] Decadal hindcast simulations of Arctic Ocean sea ice thickness made by a modern dynamic-thermodynamic sea ice model and forced independently by both the ERA-40 and NCEP/NCAR reanalysis data sets are compared for the first time. Using comprehensive data sets of observations made between 1979 and 2001 of sea ice thickness, draft, extent, and speeds, we find that it is possible to tune model parameters to give satisfactory agreement with observed data, thereby highlighting the skill of modern sea ice models, though the parameter values chosen differ according to the model forcing used. We find a consistent decreasing trend in Arctic Ocean sea ice thickness since 1979, and a steady decline in the Eastern Arctic Ocean over the full 40-year period of comparison that accelerated after 1980, but the predictions of Western Arctic Ocean sea ice thickness between 1962 and 1980 differ substantially. The origins of differing thickness trends and variability were isolated not to parameter differences but to differences in the forcing fields applied, and in how they are applied. It is argued that uncertainty, differences and errors in sea ice model forcing sets complicate the use of models to determine the exact causes of the recently reported decline in Arctic sea ice thickness, but help in the determination of robust features if the models are tuned appropriately against observations.

Understanding the WTA–WTP gap: Attitudes, feelings, uncertainty and personality

We present an experiment designed to study the psychological basis for the willingness to accept (WTA)–willingness to pay (WTP) gap. Specifically, we conduct a standard WTA–WTP economic experiment to replicate the gap and include in it five additional instruments to try to follow the psychological processes producing it. These instruments are designed to measure five psychological constructs we consider especially relevant: (1) attitudes, (2) feelings, (3) familiarity with the target good, (4) risk attitudes, and (5) personality. Our results provide important new insights into the psychological foundations of the WTA–WTP disparity, which can be used to organize some major previous results and cast serious doubts on the claim that the gap might be just a consequence of inappropriate experimental practice.

Global runoff routing with the hydrological component of the ECMWF NWP system

A global river routing scheme coupled to the ECMWF land surface model is implemented and tested within the framework of the Global Soil Wetness Project II, to evaluate the feasibility of modelling global river runoff at a daily time scale. The exercise is designed to provide benchmark river runoff predictions needed to verify the land surface model. Ten years of daily runoff produced by the HTESSEL land surface scheme is input into the TRIP2 river routing scheme in order to generate daily river runoff. These are then compared to river runoff observations from the Global Runoff Data Centre (GRDC) in order to evaluate the potential and the limitations. A notable source of inaccuracy is bias between observed and modelled discharges which is not primarily due to the modelling system but instead of to the forcing and quality of observations and seems uncorrelated to the river catchment size. A global sensitivity analysis and Generalised Likelihood Uncertainty Estimation (GLUE) uncertainty analysis are applied to the global routing model. The ground water delay parameter is identified as being the most sensitive calibration parameter. Significant uncertainties are found in results, and those due to parameterisation of the routing model are quantified. The difficulty involved in parameterising global river discharge models is discussed. Detailed river runoff simulations are shown for the river Danube, which match well observed river runoff in upstream river transects. Results show that although there are errors in runoff predictions, model results are encouraging and certainly indicative of useful runoff predictions, particularly for the purpose of verifying the land surface scheme hydrologicly. Potential of this modelling system on future applications such as river runoff forecasting and climate impact studies is highlighted. Copyright © 2009 Royal Meteorological Society.

An environmental uncertainty-based diagnostic reference tool for evaluating the performance of supply chain value streams

This research has responded to the need for diagnostic reference tools explicitly linking the influence of environmental uncertainty and performance within the supply chain. Uncertainty is a key factor influencing performance and an important measure of the operating environment. We develop and demonstrate a novel reference methodology based on data envelopment analysis (DEA) for examining the performance of value streams within the supply chain with specific reference to the level of environmental uncertainty they face. In this paper, using real industrial data, 20 product supply value streams within the European automotive industry sector are evaluated. Two are found to be efficient. The peer reference groups for the underperforming value streams are identified and numerical improvement targets are derived. The paper demonstrates how DEA can be used to guide supply chain improvement efforts through role-model identification and target setting, in a way that recognises the multiple dimensions/outcomes of the supply chain process and the influence of its environmental conditions. We have facilitated the contextualisation of environmental uncertainty and its incorporation into a specific diagnostic reference tool.

Bootstrapping prediction intervals for autoregressive models

Methods of improving the coverage of Box–Jenkins prediction intervals for linear autoregressive models are explored. These methods use bootstrap techniques to allow for parameter estimation uncertainty and to reduce the small-sample bias in the estimator of the models’ parameters. In addition, we also consider a method of bias-correcting the non-linear functions of the parameter estimates that are used to generate conditional multi-step predictions.

Consensus and uncertainty: using forecast probabilities of output declines

A number of studies have addressed the relationship between intra-personal uncertainty and inter-personal disagreement about the future values of economic variables such as output growth and inflation using the SPF. By making use of the SPF respondents' probability forecasts of declines in output, we are able to construct a quarterly series of output growth uncertainty to supplement the annual series that are often used in such analyses. We also consider the relationship between disagreement and uncertainty for probability forecasts of declines in output.

Direct soil moisture controls of future global soil carbon changes: An important source of uncertainty

The nature of the climate–carbon cycle feedback depends critically on the response of soil carbon to climate, including changes in moisture. However, soil moisture–carbon feedback responses have not been investigated thoroughly. Uncertainty in the response of soil carbon to soil moisture changes could arise from uncertainty in the relationship between soil moisture and heterotrophic respiration. We used twelve soil moisture–respiration functions (SMRFs) with a soil carbon model (RothC) and data from a coupled climate–carbon cycle general circulation model to investigate the impact of direct heterotrophic respiration dependence on soil moisture on the climate carbon cycle feedback. Global changes in soil moisture acted to oppose temperature‐driven decreases in soil carbon and hence tended to increase soil carbon storage. We found considerable uncertainty in soil carbon changes due to the response of soil respiration to soil moisture. The use of different SMRFs resulted in both large losses and small gains in future global soil carbon stocks, whether considering all climate forcings or only moisture changes. Regionally, the greatest range in soil carbon changes across SMRFs was found where the largest soil carbon changes occurred. Further research is needed to constrain the soil moisture–respiration relationship and thus reduce uncertainty in climate–carbon cycle feedbacks. There may also be considerable uncertainty in the regional responses of soil carbon to soil moisture changes since climate model predictions of regional soil moisture changes are less coherent than temperature changes.