Problems with binary pattern measures for flood model evaluation

As the calibration and evaluation of flood inundation models are a prerequisite for their successful application, there is a clear need to ensure that the performance measures that quantify how well models match the available observations are fit for purpose. This paper evaluates the binary pattern performance measures that are frequently used to compare flood inundation models with observations of flood extent. This evaluation considers whether these measures are able to calibrate and evaluate model predictions in a credible and consistent way, i.e. identifying the underlying model behaviour for a number of different purposes such as comparing models of floods of different magnitudes or on different catchments. Through theoretical examples, it is shown that the binary pattern measures are not consistent for floods of different sizes, such that for the same vertical error in water level, a model of a flood of large magnitude appears to perform better than a model of a smaller magnitude flood. Further, the commonly used Critical Success Index (usually referred to as F<2 >) is biased in favour of overprediction of the flood extent, and is also biased towards correctly predicting areas of the domain with smaller topographic gradients. Consequently, it is recommended that future studies consider carefully the implications of reporting conclusions using these performance measures. Additionally, future research should consider whether a more robust and consistent analysis could be achieved by using elevation comparison methods instead.

A comprehensive benchmarking system for evaluating global vegetation models

We present a benchmark system for global vegetation models. This system provides a quantitative evaluation of multiple simulated vegetation properties, including primary production; seasonal net ecosystem production; vegetation cover; composition and height; fire regime; and runoff. The benchmarks are derived from remotely sensed gridded datasets and site-based observations. The datasets allow comparisons of annual average conditions and seasonal and inter-annual variability, and they allow the impact of spatial and temporal biases in means and variability to be assessed separately. Specifically designed metrics quantify model performance for each process, and are compared to scores based on the temporal or spatial mean value of the observations and a "random" model produced by bootstrap resampling of the observations. The benchmark system is applied to three models: a simple light-use efficiency and water-balance model (the Simple Diagnostic Biosphere Model: SDBM), the Lund-Potsdam-Jena (LPJ) and Land Processes and eXchanges (LPX) dynamic global vegetation models (DGVMs). In general, the SDBM performs better than either of the DGVMs. It reproduces independent measurements of net primary production (NPP) but underestimates the amplitude of the observed CO2 seasonal cycle. The two DGVMs show little difference for most benchmarks (including the inter-annual variability in the growth rate and seasonal cycle of atmospheric CO2), but LPX represents burnt fraction demonstrably more accurately. Benchmarking also identified several weaknesses common to both DGVMs. The benchmarking system provides a quantitative approach for evaluating how adequately processes are represented in a model, identifying errors and biases, tracking improvements in performance through model development, and discriminating among models. Adoption of such a system would do much to improve confidence in terrestrial model predictions of climate change impacts and feedbacks.

Global patterns of vegetation response to millennial-scale variability and rapid climate change during the last glacial period

Ninety-four sites worldwide have sufficient resolution and dating to document the impact of millennial-scale climate variability on vegetation and fire regimes during the last glacial period. Although Dansgaard–Oeschger (D–O) cycles all show a basically similar gross structure, they vary in the magnitude and the length of the warm and cool intervals. We illustrate the geographic patterns in the climate-induced changes in vegetation by comparing D–O 6, D–O 8 and D–O 19. There is a strong response to both D–O warming events and subsequent cooling, most marked in the northern extratropics. Pollen records from marine cores from the northern extratropics confirm that there is no lag between the change in climate and the vegetation response, within the limits of the dating resolution (50–100 years). However, the magnitude of the change in vegetation is regionally specific and is not a simple function of either the magnitude or the duration of the change in climate as registered in Greenland ice cores. Fire regimes also show an initial immediate response to climate changes, but during cooling intervals there is a slow recovery of biomass burning after the initial reduction, suggesting a secondary control through the recovery of vegetation productivity. In the extratropics, vegetation changes are largely determined by winter temperatures while in the tropics they are largely determined by changes in plant-available water. Tropical vegetation records show changes corresponding to Heinrich Stadials but the response to D–O warming events is less marked than in the northern extratropics. There are very few high-resolution records from the Southern Hemisphere extratropics, but these records also show both a vegetation and fire response to millennial-scale climate variability. It is not yet possible to determine unequivocally whether terrestrial records reflect the asynchroneity apparent in the ice-core records.

Pollen-based reconstructions of biome distributions for Australia, Southeast Asia and the Pacific (SEAPAC region) at 0,6000 and 18,000 14C yr B.P.

Aim  This paper documents reconstructions of the vegetation patterns in Australia, Southeast Asia and the Pacific (SEAPAC region) in the mid-Holocene and at the last glacial maximum (LGM). Methods  Vegetation patterns were reconstructed from pollen data using an objective biomization scheme based on plant functional types. The biomization scheme was first tested using 535 modern pollen samples from 377 sites, and then applied unchanged to fossil pollen samples dating to 6000 ± 500 or 18,000 ± 1000 14C yr bp. Results  1. Tests using surface pollen sample sites showed that the biomization scheme is capable of reproducing the modern broad-scale patterns of vegetation distribution. The north–south gradient in temperature, reflected in transitions from cool evergreen needleleaf forest in the extreme south through temperate rain forest or wet sclerophyll forest (WSFW) and into tropical forests, is well reconstructed. The transitions from xerophytic through sclerophyll woodlands and open forests to closed-canopy forests, which reflect the gradient in plant available moisture from the continental interior towards the coast, are reconstructed with less geographical precision but nevertheless the broad-scale pattern emerges. 2. Differences between the modern and mid-Holocene vegetation patterns in mainland Australia are comparatively small and reflect changes in moisture availability rather than temperature. In south-eastern Australia some sites show a shift towards more moisture-stressed vegetation in the mid-Holocene with xerophytic woods/scrub and temperate sclerophyll woodland and shrubland at sites characterized today by WSFW or warm-temperate rain forest (WTRF). However, sites in the Snowy Mountains, on the Southern Tablelands and east of the Great Dividing Range have more moisture-demanding vegetation in the mid-Holocene than today. South-western Australia was slightly drier than today. The single site in north-western Australia also shows conditions drier than today in the mid-Holocene. Changes in the tropics are also comparatively small, but the presence of WTRF and tropical deciduous broadleaf forest and woodland in the mid-Holocene, in sites occupied today by cool-temperate rain forest, indicate warmer conditions. 3. Expansion of xerophytic vegetation in the south and tropical deciduous broadleaf forest and woodland in the north indicate drier conditions across mainland Australia at the LGM. None of these changes are informative about the degree of cooling. However the evidence from the tropics, showing lowering of the treeline and forest belts, indicates that conditions were between 1 and 9 °C (depending on elevation) colder. The encroachment of tropical deciduous broadleaf forest and woodland into lowland evergreen broadleaf forest implies greater aridity. Main conclusions  This study provides the first continental-scale reconstruction of mid-Holocene and LGM vegetation patterns from Australia, Southeast Asia and the Pacific (SEAPAC region) using an objective biomization scheme. These data will provide a benchmark for evaluation of palaeoclimate simulations within the framework of the Palaeoclimate Modelling Intercomparison Project.

Synergistic feedbacks between ocean and vegetation on mid- and high-latitude climates during the mid-Holocene

Simulations with the IPSL atmosphere–ocean model asynchronously coupled with the BIOME1 vegetation model show the impact of ocean and vegetation feedbacks, and their synergy, on mid- and high-latitude (>40°N) climate in response to orbitally-induced changes in mid-Holocene insolation. The atmospheric response to orbital forcing produces a +1.2 °C warming over the continents in summer and a cooling during the rest of the year. Ocean feedback reinforces the cooling in spring but counteracts the autumn and winter cooling. Vegetation feedback produces warming in all seasons, with largest changes (+1 °C) in spring. Synergy between ocean and vegetation feedbacks leads to further warming, which can be as large as the independent impact of these feedbacks. The combination of these effects causes the high northern latitudes to be warmer throughout the year in the ocean–atmosphere-vegetation simulation. Simulated vegetation changes resulting from this year-round warming are consistent with observed mid-Holocene vegetation patterns. Feedbacks also impact on precipitation. The atmospheric response to orbital-forcing reduces precipitation throughout the year; the most marked changes occur in the mid-latitudes in summer. Ocean feedback reduces aridity during autumn, winter and spring, but does not affect summer precipitation. Vegetation feedback increases spring precipitation but amplifies summer drying. Synergy between the feedbacks increases precipitation in autumn, winter and spring, and reduces precipitation in summer. The combined changes amplify the seasonal contrast in precipitation in the ocean–atmosphere-vegetation simulation. Enhanced summer drought produces an unrealistically large expansion of temperate grasslands, particularly in mid-latitude Eurasia.

Climate and CO2 controls on global vegetation distribution at the last glacial maximum: analysis based on palaeovegetation data, biome modelling and palaeoclimate simulations.

The global vegetation response to climate and atmospheric CO2 changes between the last glacial maximum and recent times is examined using an equilibrium vegetation model (BIOME4), driven by output from 17 climate simulations from the Palaeoclimate Modelling Intercomparison Project. Features common to all of the simulations include expansion of treeless vegetation in high northern latitudes; southward displacement and fragmentation of boreal and temperate forests; and expansion of drought-tolerant biomes in the tropics. These features are broadly consistent with pollen-based reconstructions of vegetation distribution at the last glacial maximum. Glacial vegetation in high latitudes reflects cold and dry conditions due to the low CO2 concentration and the presence of large continental ice sheets. The extent of drought-tolerant vegetation in tropical and subtropical latitudes reflects a generally drier low-latitude climate. Comparisons of the observations with BIOME4 simulations, with and without consideration of the direct physiological effect of CO2 concentration on C3 photosynthesis, suggest an important additional role of low CO2 concentration in restricting the extent of forests, especially in the tropics. Global forest cover was overestimated by all models when climate change alone was used to drive BIOME4, and estimated more accurately when physiological effects of CO2 concentration were included. This result suggests that both CO2 effects and climate effects were important in determining glacial-interglacial changes in vegetation. More realistic simulations of glacial vegetation and climate will need to take into account the feedback effects of these structural and physiological changes on the climate.

The impact of sea ice dynamics on the Arctic climate system

Five paired global climate model experiments, one with an ice pack that only responds thermodynamically (TI) and one including sea-ice dynamics (DI), were used to investigate the sensitivity of Arctic climates to sea-ice motion. The sequence of experiments includes situations in which the Arctic was both considerably colder (Glacial Inception, ca 115,000 years ago) and considerably warmer (3 × CO2) than today. Sea-ice motion produces cooler anomalies year-round than simulations without ice dynamics, resulting in reduced Arctic warming in warm scenarios and increased Arctic cooling in cold scenarios. These changes reflect changes in atmospheric circulation patterns: the DI simulations favor outflow of Arctic air and sea ice into the North Atlantic by promoting cyclonic circulation centered over northern Eurasia, whereas the TI simulations favor southerly inflow of much warmer air from the North Atlantic by promoting cyclonic circulation centered over Greenland. The differences between the paired simulations are sufficiently large to produce different vegetation cover over >19% of the land area north of 55°N, resulting in changes in land-surface characteristics large enough to have an additional impact on climate. Comparison of the DI and TI experiments for the mid-Holocene (6000 years ago) with paleovegetation reconstructions suggests the incorporation of sea-ice dynamics yields a more realistic simulation of high-latitude climates. The spatial pattern of sea-ice anomalies in the warmer-than-modern DI experiments strongly resembles the observed Arctic Ocean sea-ice dipole structure in recent decades, consistent with the idea that greenhouse warming is already impacting the high-northern latitudes.

Impact of vegetation and preferential source areas on global dust aerosol: results from a model study

[1] We present a model of the dust cycle that successfully predicts dust emissions as determined by land surface properties, monthly vegetation and snow cover, and 6-hourly surface wind speeds for the years 1982–1993. The model takes account of the role of dry lake beds as preferential source areas for dust emission. The occurrence of these preferential sources is determined by a water routing and storage model. The dust source scheme also explicitly takes into account the role of vegetation type as well as monthly vegetation cover. Dust transport is computed using assimilated winds for the years 1987–1990. Deposition of dust occurs through dry and wet deposition, where subcloud scavenging is calculated using assimilated precipitation fields. Comparison of simulated patterns of atmospheric dust loading with the Total Ozone Mapping Spectrometer satellite absorbing aerosol index shows that the model produces realistic results from daily to interannual timescales. The magnitude of dust deposition agrees well with sediment flux data from marine sites. Emission of submicron dust from preferential source areas are required for the computation of a realistic dust optical thickness. Sensitivity studies show that Asian dust source strengths are particularly sensitive to the seasonality of vegetation cover.