Evaluating the potential for statistical decadal predictions of sea surface temperatures with a perfect model approach

We explore the potential for making statistical decadal predictions of sea surface temperatures (SSTs) in a perfect model analysis, with a focus on the Atlantic basin. Various statistical methods (Lagged correlations, Linear Inverse Modelling and Constructed Analogue) are found to have significant skill in predicting the internal variability of Atlantic SSTs for up to a decade ahead in control integrations of two different global climate models (GCMs), namely HadCM3 and HadGEM1. Statistical methods which consider non-local information tend to perform best, but which is the most successful statistical method depends on the region considered, GCM data used and prediction lead time. However, the Constructed Analogue method tends to have the highest skill at longer lead times. Importantly, the regions of greatest prediction skill can be very different to regions identified as potentially predictable from variance explained arguments. This finding suggests that significant local decadal variability is not necessarily a prerequisite for skillful decadal predictions, and that the statistical methods are capturing some of the dynamics of low-frequency SST evolution. In particular, using data from HadGEM1, significant skill at lead times of 6–10 years is found in the tropical North Atlantic, a region with relatively little decadal variability compared to interannual variability. This skill appears to come from reconstructing the SSTs in the far north Atlantic, suggesting that the more northern latitudes are optimal for SST observations to improve predictions. We additionally explore whether adding sub-surface temperature data improves these decadal statistical predictions, and find that, again, it depends on the region, prediction lead time and GCM data used. Overall, we argue that the estimated prediction skill motivates the further development of statistical decadal predictions of SSTs as a benchmark for current and future GCM-based decadal climate predictions.

Dependence of Indian monsoon rainfall on moisture fluxes across the Arabian Sea and the impact of coupled model sea surface temperature biases

The Arabian Sea is an important moisture source for Indian monsoon rainfall. The skill of climate models in simulating the monsoon and its variability varies widely, while Arabian Sea cold sea surface temperature (SST) biases are common in coupled models and may therefore influence the monsoon and its sensitivity to climate change. We examine the relationship between monsoon rainfall, moisture fluxes and Arabian Sea SST in observations and climate model simulations. Observational analysis shows strong monsoons depend on moisture fluxes across the Arabian Sea, however detecting consistent signals with contemporaneous summer SST anomalies is complicated in the observed system by air/sea coupling and large-scale induced variability such as the El Niño-Southern Oscillation feeding back onto the monsoon through development of the Somali Jet. Comparison of HadGEM3 coupled and atmosphere-only configurations suggests coupled model cold SST biases significantly reduce monsoon rainfall. Idealised atmosphere-only experiments show that the weakened monsoon can be mainly attributed to systematic Arabian Sea cold SST biases during summer and their impact on the monsoon-moisture relationship. The impact of large cold SST biases on atmospheric moisture content over the Arabian Sea, and also the subsequent reduced latent heat release over India, dominates over any enhancement in the land-sea temperature gradient and results in changes to the mean state. We hypothesize that a cold base state will result in underestimation of the impact of larger projected Arabian Sea SST changes in future climate, suggesting that Arabian Sea biases should be a clear target for model development.

On the evaluation of temperature trends in the tropical troposphere

A series of model experiments with the coupled Max-Planck-Institute ECHAM5/OM climate model have been investigated and compared with microwave measurements from the Microwave Sounding Unit (MSU) and re-analysis data for the period 1979–2008. The evaluation is carried out by computing the Temperature in the Lower Troposphere (TLT) and Temperature in the Middle Troposphere (TMT) using the MSU weights from both University of Alabama (UAH) and Remote Sensing Systems (RSS) and restricting the study to primarily the tropical oceans. When forced by analysed sea surface temperature the model reproduces accurately the time-evolution of the mean outgoing tropospheric microwave radiation especially over tropical oceans but with a minor bias towards higher temperatures in the upper troposphere. The latest reanalyses data from the 25 year Japanese re-analysis (JRA25) and European Center for Medium Range Weather Forecasts Interim Reanalysis are in very close agreement with the time-evolution of the MSU data with a correlation of 0.98 and 0.96, respectively. The re-analysis trends are similar to the trends obtained from UAH but smaller than the trends from RSS. Comparison of TLT, computed from observations from UAH and RSS, with Sea Surface Temperature indicates that RSS has a warm bias after 1993. In order to identify the significance of the tropospheric linear temperature trends we determined the natural variability of 30-year trends from a 500 year control integration of the coupled ECHAM5 model. The model exhibits natural unforced variations of the 30 year tropospheric trend that vary within ±0.2 K/decade for the tropical oceans. This general result is supported by similar results from the Geophysical Fluid Dynamics Laboratory (GFDL) coupled climate model. Present MSU observations from UAH for the period 1979–2008 are well within this range but RSS is close to the upper positive limit of this variability. We have also compared the trend of the vertical lapse rate over the tropical oceans assuming that the difference between TLT and TMT is an approximate measure of the lapse rate. The TLT–TMT trend is larger in both the measurements and in the JRA25 than in the model runs by 0.04–0.06 K/decade. Furthermore, a calculation of all 30 year TLT–TMT trends of the unforced 500-year integration vary between ±0.03 K/decade suggesting that the models have a minor systematic warm bias in the upper troposphere.

Regime dependent changes in global precipitation

Assessment of changes in precipitation (P) as a function of percentiles of surface temperature (T) and 500 hPa vertical velocity (ω) are presented, considering present-day simulations and observational estimates from the Global Precipitation Climatology Project (GPCP) combined with the European Centre for Medium-range Weather Forecasts Interim reanalysis (ERA Interim). There is a tendency for models to overestimate P in the warm, subsiding regimes compared to GPCP, in some cases by more than 100%, while many models underestimate P in the moderate temperature regimes. Considering climate change projections between 1980–1999 and 2080–2099, responses in P are characterised by dP/dT ≥ 4%/K over the coldest 10–20% of land points and over warm, ascending ocean points while P declines over the warmest, descending regimes (dP/dT ∼ − 4%/K for model ensemble means). The reduced Walker circulation limits this contrasting dP/dT response in the tropical wet and dry regimes only marginally. Around 70% of the global surface area exhibits a consistent sign for dP/dT in at least 6 out of a 7-member model ensemble when considering P composites in terms of dynamic regime.

The effect of Arabian Sea optical properties on SST biases and the South Asian summer monsoon in a coupled GCM

This study examines the effect of seasonally varying chlorophyll on the climate of the Arabian Sea and South Asian monsoon. The effect of such seasonality on the radiative properties of the upper ocean is often a missing process in coupled general circulation models and its large amplitude in the region makes it a pertinent choice for study to determine any impact on systematic biases in the mean and seasonality of the Arabian Sea. In this study we examine the effects of incorporating a seasonal cycle in chlorophyll due to phytoplankton blooms in the UK Met Office coupled atmosphere-ocean GCM HadCM3. This is achieved by performing experiments in which the optical properties of water in the Arabian Sea - a key signal of the semi-annual cycle of phytoplankton blooms in the region - are calculated from a chlorophyll climatology derived from Sea-viewing Wide Field-of-View Sensor (SeaWiFS) data. The SeaWiFS chlorophyll is prescribed in annual mean and seasonally-varying experiments. In response to the chlorophyll bloom in late spring, biases in mixed layer depth are reduced by up to 50% and the surface is warmed, leading to increases in monsoon rainfall during the onset period. However when the monsoons are fully established in boreal winter and summer and there are strong surface winds and a deep mixed layer, biases in the mixed layer depth are reduced but the surface undergoes cooling. The seasonality of the response of SST to chlorophyll is found to depend on the relative depth of the mixed layer to that of the anomalous penetration depth of solar fluxes. Thus the inclusion of the effects of chlorophyll on radiative properties of the upper ocean acts to reduce biases in mixed layer depth and increase seasonality in SST.

How well do coupled models replicate ocean energetics relevant to ENSO?

Accurate replication of the processes associated with the energetics of the tropical ocean is necessary if coupled GCMs are to simulate the physics of ENSO correctly, including the transfer of energy from the winds to the ocean thermocline and energy dissipation during the ENSO cycle. Here, we analyze ocean energetics in coupled GCMs in terms of two integral parameters describing net energy loss in the system using the approach recently proposed by Brown and Fedorov (J Clim 23:1563–1580, 2010a) and Fedorov (J Clim 20:1108–1117, 2007). These parameters are (1) the efficiency c of the conversion of wind power into the buoyancy power that controls the rate of change of the available potential energy (APE) in the ocean and (2) the e-folding rate a that characterizes the damping of APE by turbulent diffusion and other processes. Estimating these two parameters for coupled models reveals potential deficiencies (and large differences) in how state-of-the-art coupled GCMs reproduce the ocean energetics as compared to ocean-only models and data assimilating models. The majority of the coupled models we analyzed show a lower efficiency (values of c in the range of 10–50% versus 50–60% for ocean-only simulations or reanalysis) and a relatively strong energy damping (values of a-1 in the range 0.4–1 years versus 0.9–1.2 years). These differences in the model energetics appear to reflect differences in the simulated thermal structure of the tropical ocean, the structure of ocean equatorial currents, and deficiencies in the way coupled models simulate ENSO.

The role of atmosphere feedbacks during ENSO in the CMIP3 models. Part II: using AMIP runs to understand the heat flux feedback mechanisms

Several studies using ocean–atmosphere general circulation models (GCMs) suggest that the atmospheric component plays a dominant role in the modelled El Niño-Southern Oscillation (ENSO). To help elucidate these findings, the two main atmosphere feedbacks relevant to ENSO, the Bjerknes positive feedback (μ) and the heat flux negative feedback (α), are here analysed in nine AMIP runs of the CMIP3 multimodel dataset. We find that these models generally have improved feedbacks compared to the coupled runs which were analysed in part I of this study. The Bjerknes feedback, μ, is increased in most AMIP runs compared to the coupled run counterparts, and exhibits both positive and negative biases with respect to ERA40. As in the coupled runs, the shortwave and latent heat flux feedbacks are the two dominant components of α in the AMIP runs. We investigate the mechanisms behind these two important feedbacks, in particular focusing on the strong 1997–1998 El Niño. Biases in the shortwave flux feedback, α SW, are the main source of model uncertainty in α. Most models do not successfully represent the negative αSW in the East Pacific, primarily due to an overly strong low-cloud positive feedback in the far eastern Pacific. Biases in the cloud response to dynamical changes dominate the modelled α SW biases, though errors in the large-scale circulation response to sea surface temperature (SST) forcing also play a role. Analysis of the cloud radiative forcing in the East Pacific reveals model biases in low cloud amount and optical thickness which may affect α SW. We further show that the negative latent heat flux feedback, α LH, exhibits less diversity than α SW and is primarily driven by variations in the near-surface specific humidity difference. However, biases in both the near-surface wind speed and humidity response to SST forcing can explain the inter-model αLH differences.

Will the South Asian monsoon overturning circulation stabilize any further?

Understanding the response of the South Asian monsoon (SAM) system to global climate change is an interesting scientific problem that has enormous implications from the societal viewpoint. While the CMIP3 projections of future changes in monsoon precipitation used in the IPCC AR4 show major uncertainties, there is a growing recognition that the rapid increase of moisture in a warming climate can potentially enhance the stability of the large-scale tropical circulations. In this work, the authors have examined the stability of the SAM circulation based on diagnostic analysis of climate datasets over the past half century; and addressed the issue of likely future changes in the SAM in response to global warming using simulations from an ultrahigh resolution (20 km) global climate model. Additional sensitivity experiments using a simplified atmospheric model have been presented to supplement the overall findings. The results here suggest that the intensity of the boreal summer monsoon overturning circulation and the associated southwesterly monsoon flow have significantly weakened during the past 50-years. The weakening trend of the monsoon circulation is further corroborated by a significant decrease in the frequency of moderate-to-heavy monsoon rainfall days and upward vertical velocities particularly over the narrow mountain ranges of the Western Ghats. Based on simulations from the 20-km ultra high-resolution model, it is argued that a stabilization (weakening) of the summer monsoon Hadley-type circulation in response to global warming can potentially lead to a weakened large-scale monsoon flow thereby resulting in weaker vertical velocities and reduced orographic precipitation over the narrow Western Ghat mountains by the end of the twenty-first century. Supplementary experiments using a simplified atmospheric model indicate a high sensitivity of the large-scale monsoon circulation to atmospheric stability in comparison with the effects of condensational heating.

The last glacial cycle: transient simulations with an AOGCM

A number of transient climate runs simulating the last 120kyr have been carried out using FAMOUS, a fast atmosphere-ocean general circulation model (AOGCM). This is the first time such experiments have been done with a full AOGCM, providing a three-dimensional simulation of both atmosphere and ocean over this period. Our simulation thus includes internally generated temporal variability over periods from days to millennia, and physical, detailed representations of important processes such as clouds and precipitation. Although the model is fast, computational restrictions mean that the rate of change of the forcings has been increased by a factor of 10, making each experiment 12kyr long. Atmospheric greenhouse gases (GHGs), northern hemisphere ice sheets and variations in solar radiation arising from changes in the Earth's orbit are treated as forcing factors, and are applied either separately or combined in different experiments. The long-term temperature changes on Antarctica match well with reconstructions derived from ice-core data, as does variability on timescales longer than 10 kyr. Last Glacial Maximum (LGM) cooling on Greenland is reasonably well simulated, although our simulations, which lack ice-sheet meltwater forcing, do not reproduce the abrupt, millennial scale climate shifts seen in northern hemisphere climate proxies or their slower southern hemisphere counterparts. The spatial pattern of sea surface cooling at the LGM matches proxy reconstructions reasonably well. There is significant anti-correlated variability in the strengths of the Atlantic Meridional Overturning Circulation (AMOC) and the Antarctic Circumpolar Current (ACC) on timescales greater than 10kyr in our experiments. We find that GHG forcing weakens the AMOC and strengthens the ACC, whilst the presence of northern hemisphere ice-sheets strengthens the AMOC and weakens the ACC. The structure of the AMOC at the LGM is found to be sensitive to the details of the ice-sheet reconstruction used. The precessional component of the orbital forcing induces ~20kyr oscillations in the AMOC and ACC, whose amplitude is mediated by changes in the eccentricity of the Earth's orbit. These forcing influences combine, to first order, in a linear fashion to produce the mean climate and ocean variability seen in the run with all forcings.

Upper-ocean heat budget and ocean eddy transport in the south-east Pacific in a high-resolution coupled model

We present an analysis of the oceanic heat advection and its variability in the upper 500 m in the southeastern tropical Pacific (100W–75W, 25S–10S) as simulated by the global coupled model HiGEM, which has one of the highest resolutions currently used in long-term integrations. The simulated climatology represents a temperature advection field arising from transient small-scale (<450 km) features, with structures and transport that appear consistent with estimates based on available observational data for the mooring at 20S, 85W. The transient structures are very persistent (>4 months), and in specific locations they generate an important contribution to the local upper-ocean heat budget, characterised by scales of a few hundred kilometres, and periods of over a year. The contribution from such structures to the local, long-term oceanic heat budget however can be of either sign, or vanishing, depending on the location; and, although there appears some organisation in preferential areas of activity, the average over the entire region is small. While several different mechanisms may be responsible for the temperature advection by transients, we find that a significant, and possibly dominant, component is associated with vortices embedded in the large-scale, climatological salinity gradient associated with the fresh intrusion of mid-latitude intermediate water which penetrates north-westward beneath the tropical thermocline

A verification framework for interannual-to-decadal predictions experiments

Decadal predictions have a high profile in the climate science community and beyond, yet very little is known about their skill. Nor is there any agreed protocol for estimating their skill. This paper proposes a sound and coordinated framework for verification of decadal hindcast experiments. The framework is illustrated for decadal hindcasts tailored to meet the requirements and specifications of CMIP5 (Coupled Model Intercomparison Project phase 5). The chosen metrics address key questions about the information content in initialized decadal hindcasts. These questions are: (1) Do the initial conditions in the hindcasts lead to more accurate predictions of the climate, compared to un-initialized climate change projections? and (2) Is the prediction model’s ensemble spread an appropriate representation of forecast uncertainty on average? The first question is addressed through deterministic metrics that compare the initialized and uninitialized hindcasts. The second question is addressed through a probabilistic metric applied to the initialized hindcasts and comparing different ways to ascribe forecast uncertainty. Verification is advocated at smoothed regional scales that can illuminate broad areas of predictability, as well as at the grid scale, since many users of the decadal prediction experiments who feed the climate data into applications or decision models will use the data at grid scale, or downscale it to even higher resolution. An overall statement on skill of CMIP5 decadal hindcasts is not the aim of this paper. The results presented are only illustrative of the framework, which would enable such studies. However, broad conclusions that are beginning to emerge from the CMIP5 results include (1) Most predictability at the interannual-to-decadal scale, relative to climatological averages, comes from external forcing, particularly for temperature; (2) though moderate, additional skill is added by the initial conditions over what is imparted by external forcing alone; however, the impact of initialization may result in overall worse predictions in some regions than provided by uninitialized climate change projections; (3) limited hindcast records and the dearth of climate-quality observational data impede our ability to quantify expected skill as well as model biases; and (4) as is common to seasonal-to-interannual model predictions, the spread of the ensemble members is not necessarily a good representation of forecast uncertainty. The authors recommend that this framework be adopted to serve as a starting point to compare prediction quality across prediction systems. The framework can provide a baseline against which future improvements can be quantified. The framework also provides guidance on the use of these model predictions, which differ in fundamental ways from the climate change projections that much of the community has become familiar with, including adjustment of mean and conditional biases, and consideration of how to best approach forecast uncertainty.

Statistical decadal predictions for sea surface temperatures: a benchmark for dynamical GCM predictions

Accurate decadal climate predictions could be used to inform adaptation actions to a changing climate. The skill of such predictions from initialised dynamical global climate models (GCMs) may be assessed by comparing with predictions from statistical models which are based solely on historical observations. This paper presents two benchmark statistical models for predicting both the radiatively forced trend and internal variability of annual mean sea surface temperatures (SSTs) on a decadal timescale based on the gridded observation data set HadISST. For both statistical models, the trend related to radiative forcing is modelled using a linear regression of SST time series at each grid box on the time series of equivalent global mean atmospheric CO2 concentration. The residual internal variability is then modelled by (1) a first-order autoregressive model (AR1) and (2) a constructed analogue model (CA). From the verification of 46 retrospective forecasts with start years from 1960 to 2005, the correlation coefficient for anomaly forecasts using trend with AR1 is greater than 0.7 over parts of extra-tropical North Atlantic, the Indian Ocean and western Pacific. This is primarily related to the prediction of the forced trend. More importantly, both CA and AR1 give skillful predictions of the internal variability of SSTs in the subpolar gyre region over the far North Atlantic for lead time of 2 to 5 years, with correlation coefficients greater than 0.5. For the subpolar gyre and parts of the South Atlantic, CA is superior to AR1 for lead time of 6 to 9 years. These statistical forecasts are also compared with ensemble mean retrospective forecasts by DePreSys, an initialised GCM. DePreSys is found to outperform the statistical models over large parts of North Atlantic for lead times of 2 to 5 years and 6 to 9 years, however trend with AR1 is generally superior to DePreSys in the North Atlantic Current region, while trend with CA is superior to DePreSys in parts of South Atlantic for lead time of 6 to 9 years. These findings encourage further development of benchmark statistical decadal prediction models, and methods to combine different predictions.

Estimating reliability and resolution of probability forecasts through decomposition of the empirical score

References (20)Cited By (1)Export CitationAboutAbstract Proper scoring rules provide a useful means to evaluate probabilistic forecasts. Independent from scoring rules, it has been argued that reliability and resolution are desirable forecast attributes. The mathematical expectation value of the score allows for a decomposition into reliability and resolution related terms, demonstrating a relationship between scoring rules and reliability/resolution. A similar decomposition holds for the empirical (i.e. sample average) score over an archive of forecast–observation pairs. This empirical decomposition though provides a too optimistic estimate of the potential score (i.e. the optimum score which could be obtained through recalibration), showing that a forecast assessment based solely on the empirical resolution and reliability terms will be misleading. The differences between the theoretical and empirical decomposition are investigated, and specific recommendations are given how to obtain better estimators of reliability and resolution in the case of the Brier and Ignorance scoring rule.