Probabilistic skill in ensemble seasonal forecasts

Simulation models are widely employed to make probability forecasts of future conditions on seasonal to annual lead times. Added value in such forecasts is reflected in the information they add, either to purely empirical statistical models or to simpler simulation models. An evaluation of seasonal probability forecasts from the Development of a European Multimodel Ensemble system for seasonal to inTERannual prediction (DEMETER) and ENSEMBLES multi-model ensemble experiments is presented. Two particular regions are considered: Nino3.4 in the Pacific and the Main Development Region in the Atlantic; these regions were chosen before any spatial distribution of skill was examined. The ENSEMBLES models are found to have skill against the climatological distribution on seasonal time-scales. For models in ENSEMBLES that have a clearly defined predecessor model in DEMETER, the improvement from DEMETER to ENSEMBLES is discussed. Due to the long lead times of the forecasts and the evolution of observation technology, the forecast-outcome archive for seasonal forecast evaluation is small; arguably, evaluation data for seasonal forecasting will always be precious. Issues of information contamination from in-sample evaluation are discussed and impacts (both positive and negative) of variations in cross-validation protocol are demonstrated. Other difficulties due to the small forecast-outcome archive are identified. The claim that the multi-model ensemble provides a ‘better’ probability forecast than the best single model is examined and challenged. Significant forecast information beyond the climatological distribution is also demonstrated in a persistence probability forecast. The ENSEMBLES probability forecasts add significantly more information to empirical probability forecasts on seasonal time-scales than on decadal scales. Current operational forecasts might be enhanced by melding information from both simulation models and empirical models. Simulation models based on physical principles are sometimes expected, in principle, to outperform empirical models; direct comparison of their forecast skill provides information on progress toward that goal.

Effect of seasonal variation on some physical properties and heat stability of milk subjected to ultra-high temperature and in-container sterilisation

Heat stability was evaluated in bulk raw milk, collected throughout the year and subjected to ultra-high temperature (UHT) or in-container sterilisation, with and without added calcium chloride (2 mM), disodium hydrogen phosphate (DSHP, 10 mM) and trisodium citrate (TSC, 10 mM). More sediment was observed following in-container sterilisation (0.24%) compared with UHT (0.19%). Adding CaCl2 made the milk more unstable to UHT than to in-container sterilisation, while adding DSHP and TSC made the milk more unstable during in-container sterilisation than to UHT processing, although TSC addition increased the sediment formed by UHT processing. Better heat stability was observed in autumn and winter than in spring and summer following UHT. However, following in-container sterilisation, samples with added stabilising salts showed significantly improved heat stability in autumn, whereas with added CaCl2, the best heat stability was observed in spring. No correlation was found between urea and heat stability. DSHP and TSC made the milk more unstable during in-container sterilisation than to UHT processing, although TSC addition increased the sediment formed by UHT processing. Better heat stability was observed in autumn and winter than in spring and summer following UHT. However, following in-container sterilisation, samples with added stabilising salts showed significantly improved heat stability in autumn, whereas with added CaCl2, the best heat stability was observed in spring. No correlation was found between urea and heat stability.

Evaluation of modern and mid-Holocene seasonal precipitation of the Mediterranean and northern Africa in the CMIP5 simulations

We analyse the spatial expression of seasonal climates of the Mediterranean and northern Africa in pre-industrial (piControl) and mid-Holocene (midHolocene, 6 yr BP) simulations from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Modern observations show four distinct precipitation regimes characterized by differences in the seasonal distribution and total amount of precipitation: an equatorial band characterized by a double peak in rainfall, the monsoon zone characterized by summer rainfall, the desert characterized by low seasonality and total precipitation, and the Mediterranean zone characterized by summer drought. Most models correctly simulate the position of the Mediterranean and the equatorial climates in the piControl simulations, but overestimate the extent of monsoon influence and underestimate the extent of desert. However, most models fail to reproduce the amount of precipitation in each zone. Model biases in the simulated magnitude of precipitation are unrelated to whether the models reproduce the correct spatial patterns of each regime. In the midHolocene, the models simulate a reduction in winter rainfall in the equatorial zone, and a northward expansion of the monsoon with a significant increase in summer and autumn rainfall. Precipitation is slightly increased in the desert, mainly in summer and autumn, with northward expansion of the monsoon. Changes in the Mediterranean are small, although there is an increase in spring precipitation consistent with palaeo-observations of increased growing-season rainfall. Comparison with reconstructions shows most models underestimate the mid-Holocene changes in annual precipitation, except in the equatorial zone. Biases in the piControl have only a limited influence on midHolocene anomalies in ocean–atmosphere models; carbon-cycle models show no relationship between piControl bias and midHolocene anomalies. Biases in the prediction of the midHolocene monsoon expansion are unrelated to how well the models simulate changes in Mediterranean climate.

Improving climate change detection through optimal seasonal averaging: the case of the North Atlantic jet and European precipitation

The detection of anthropogenic climate change can be improved by recognising the seasonality in the climate change response. This is demonstrated for the North Atlantic jet (zonal wind at 850 hPa, U850) and European precipitation responses projected by the CMIP5 climate models. The U850 future response is characterised by a marked seasonality: an eastward extension of the North Atlantic jet into Europe in November-April, and a poleward shift in May-October. Under the RCP8.5 scenario, the multi-model mean response in U850 in these two extended seasonal means emerges by 2035-2040 for the lower--latitude features and by 2050-2070 for the higher--latitude features, relative to the 1960-1990 climate. This is 5-15 years earlier than when evaluated in the traditional meteorological seasons (December--February, June--August), and it results from an increase in the signal to noise ratio associated with the spatial coherence of the response within the extended seasons. The annual mean response lacks important information on the seasonality of the response without improving the signal to noise ratio. The same two extended seasons are demonstrated to capture the seasonality of the European precipitation response to climate change and to anticipate its emergence by 10-20 years. Furthermore, some of the regional responses, such as the Mediterranean precipitation decline and the U850 response in North Africa in the extended winter, are projected to emerge by 2020-2025, according to the models with a strong response. Therefore, observations might soon be useful to test aspects of the atmospheric circulation response predicted by some of the CMIP5 models.

Molecular and phenotypic characterization of the alternative seasonal growth habit and flowering time in barley (Hordeum vulgare ssp. vulgare L.)

Barley can be classified into three major agronomic types, based on its seasonal growth habit (SGH): spring, winter and alternative. Winter varieties require exposure to vernalization to promote subsequent flowering and are autumn-sown. Spring varieties proceed to flowering in the absence of vernalization and are sown in the spring. The ‘alternative’ (also known as ‘facultative’) SGH is only loosely defined and can be sown in autumn or spring. Here, we investigate the molecular genetic basis of alternative barley. Analysis of the major barley vernalization (VRN-H1, VRN-H2) and photoperiod (PPD-H1, PPD-H2) response genes in a collection of 386 varieties found alternative SGH to be characterized by specific allelic combinations. Spring varieties possessed spring loci at one or both of the vernalization response loci, combined with long-day non-responsive ppd-H1 alleles and wild-type alleles at the short-day photoperiod response locus, PPD-H2. Winter varieties possessed winter alleles at both vernalization loci, in combination with the mutant ppd-H2 allele conferring delayed flowering under short-day photoperiods. In contrast, all alternative varieties investigated possessed a single spring allele (either at VRN-H1 or at VRN-H2) combined with mutant ppd-H2 alleles. This allelic combination is found only in alternative types and is diagnostic for alternative SGH in the collection studied. Analysis of flowering time under controlled environment found alternative varieties flowered later than spring control lines, with the difference most pronounced under short-day photoperiods. This work provides genetic characterization of the alternative SGH phenotype, allowing precise manipulation of SGH and flowering time within breeding programmes, and provides the molecular tools for classification of all three SGH categories within national variety registration processes.

Improved seasonal prediction of the hot summer of 2003 over Europe through better representation of uncertainty in the land surface

Methods to explicitly represent uncertainties in weather and climate models have been developed and refined over the past decade, and have reduced biases and improved forecast skill when implemented in the atmospheric component of models. These methods have not yet been applied to the land surface component of models. Since the land surface is strongly coupled to the atmospheric state at certain times and in certain places (such as the European summer of 2003), improvements in the representation of land surface uncertainty may potentially lead to improvements in atmospheric forecasts for such events. Here we analyse seasonal retrospective forecasts for 1981–2012 performed with the European Centre for Medium-Range Weather Forecasts’ (ECMWF) coupled ensemble forecast model. We consider two methods of incorporating uncertainty into the land surface model (H-TESSEL): stochastic perturbation of tendencies, and static perturbation of key soil parameters. We find that the perturbed parameter approach considerably improves the forecast of extreme air temperature for summer 2003, through better representation of negative soil moisture anomalies and upward sensible heat flux. Averaged across all the reforecasts the perturbed parameter experiment shows relatively little impact on the mean bias, suggesting perturbations of at least this magnitude can be applied to the land surface without any degradation of model climate. There is also little impact on skill averaged across all reforecasts and some evidence of overdispersion for soil moisture. The stochastic tendency experiments show a large overdispersion for the soil temperature fields, indicating that the perturbation here is too strong. There is also some indication that the forecast of the 2003 warm event is improved for the stochastic experiments, however the improvement is not as large as observed for the perturbed parameter experiment.

Aspects of designing and evaluating seasonal-to-interannual Arctic sea-ice prediction systems

Using lessons from idealised predictability experiments, we discuss some issues and perspectives on the design of operational seasonal to inter-annual Arctic sea-ice prediction systems. We first review the opportunities to use a hierarchy of different types of experiment to learn about the predictability of Arctic climate. We also examine key issues for ensemble system design, such as: measuring skill, the role of ensemble size and generation of ensemble members. When assessing the potential skill of a set of prediction experiments, using more than one metric is essential as different choices can significantly alter conclusions about the presence or lack of skill. We find that increasing both the number of hindcasts and ensemble size is important for reliably assessing the correlation and expected error in forecasts. For other metrics, such as dispersion, increasing ensemble size is most important. Probabilistic measures of skill can also provide useful information about the reliability of forecasts. In addition, various methods for generating the different ensemble members are tested. The range of techniques can produce surprisingly different ensemble spread characteristics. The lessons learnt should help inform the design of future operational prediction systems.

Spatial and temporal variations of the seasonal sea level cycle in the northwest Pacific

The seasonal sea level variations observed from tide gauges over 1900-2013 and gridded satellite altimeter product AVISO over 1993-2013 in the northwest Pacific have been explored. The seasonal cycle is able to explain 60-90% of monthly sea level variance in the marginal seas, while it explains less than 20% of variance in the eddy-rich regions. The maximum annual and semi-annual sea level cycles (30cm and 6cm) are observed in the north of the East China Sea and the west of the South China Sea respectively. AVISO was found to underestimate the annual amplitude by 25% compared to tide gauge estimates along the coasts of China and Russia. The forcing for the seasonal sea level cycle was identified. The atmospheric pressure and the steric height produce 8-12cm of the annual cycle in the middle continental shelf and in the Kuroshio Current regions separately. The removal of the two attributors from total sea level permits to identify the sea level residuals that still show significant seasonality in the marginal seas. Both nearby wind stress and surface currents can explain well the long-term variability of the seasonal sea level cycle in the marginal seas and the tropics because of their influence on the sea level residuals. Interestingly, the surface currents are a better descriptor in the areas where the ocean currents are known to be strong. Here, they explain 50-90% of inter-annual variability due to the strong links between the steric height and the large-scale ocean currents.

A global empirical system for probabilistic seasonal climate prediction

Preparing for episodes with risks of anomalous weather a month to a year ahead is an important challenge for governments, non-governmental organisations, and private companies and is dependent on the availability of reliable forecasts. The majority of operational seasonal forecasts are made using process-based dynamical models, which are complex, computationally challenging and prone to biases. Empirical forecast approaches built on statistical models to represent physical processes offer an alternative to dynamical systems and can provide either a benchmark for comparison or independent supplementary forecasts. Here, we present a simple empirical system based on multiple linear regression for producing probabilistic forecasts of seasonal surface air temperature and precipitation across the globe. The global CO2-equivalent concentration is taken as the primary predictor; subsequent predictors, including large-scale modes of variability in the climate system and local-scale information, are selected on the basis of their physical relationship with the predictand. The focus given to the climate change signal as a source of skill and the probabilistic nature of the forecasts produced constitute a novel approach to global empirical prediction. Hindcasts for the period 1961–2013 are validated against observations using deterministic (correlation of seasonal means) and probabilistic (continuous rank probability skill scores) metrics. Good skill is found in many regions, particularly for surface air temperature and most notably in much of Europe during the spring and summer seasons. For precipitation, skill is generally limited to regions with known El Niño–Southern Oscillation (ENSO) teleconnections. The system is used in a quasi-operational framework to generate empirical seasonal forecasts on a monthly basis.

Links between tropical Pacific seasonal, interannual and orbital variability during the Holocene

The El Niño/Southern Oscillation (ENSO) is the leading mode of interannual climate variability. However, it is unclear how ENSO has responded to external forcing, particularly orbitally induced changes in the amplitude of the seasonal cycle during the Holocene. Here we present a reconstruction of seasonal and interannual surface conditions in the tropical Pacific Ocean from a network of high-resolution coral and mollusc records that span discrete intervals of the Holocene. We identify several intervals of reduced variance in the 2 to 7 yr ENSO band that are not in phase with orbital changes in equatorial insolation, with a notable 64% reduction between 5,000 and 3,000 years ago. We compare the reconstructed ENSO variance and seasonal cycle with that simulated by nine climate models that include orbital forcing, and find that the models do not capture the timing or amplitude of ENSO variability, nor the mid-Holocene increase in seasonality seen in the observations; moreover, a simulated inverse relationship between the amplitude of the seasonal cycle and ENSO-related variance in sea surface temperatures is not found in our reconstructions. We conclude that the tropical Pacific climate is highly variable and subject to millennial scale quiescent periods. These periods harbour no simple link to orbital forcing, and are not adequately simulated by the current generation of models.

An assessment of Indian monsoon seasonal forecasts and mechanisms underlying monsoon interannual variability in the Met Office GloSea5-GC2 system

We assess Indian summer monsoon seasonal forecasts in GloSea5-GC2, the Met Office fully coupled subseasonal to seasonal ensemble forecasting system. Using several metrics, GloSea5-GC2 shows similar skill to other state-of-the-art forecast systems. The prediction skill of the large-scale South Asian monsoon circulation is higher than that of Indian monsoon rainfall. Using multiple linear regression analysis we evaluate relationships between Indian monsoon rainfall and five possible drivers of monsoon interannual variability. Over the time period studied (1992-2011), the El Nino-Southern Oscillation (ENSO) and the Indian Ocean dipole (IOD) are the most important of these drivers in both observations and GloSea5-GC2. Our analysis indicates that ENSO and its teleconnection with the Indian rainfall are well represented in GloSea5-GC2. However, the relationship between the IOD and Indian rainfall anomalies is too weak in GloSea5-GC2, which may be limiting the prediction skill of the local monsoon circulation and Indian rainfall. We show that this weak relationship likely results from a coupled mean state bias that limits the impact of anomalous wind forcing on SST variability, resulting in erroneous IOD SST anomalies. Known difficulties in representing convective precipitation over India may also play a role. Since Indian rainfall responds weakly to the IOD, it responds more consistently to ENSO than in observations. Our assessment identifies specific coupled biases that are likely limiting GloSea5-GC2 prediction skill, providing targets for model improvement.

Seasonal surface urban energy balance and wintertime stability simulated using three land-surface models in the high-latitude city Helsinki

The performance of three urban land surface models, run in offline mode, with their default external parameters, is evaluated for two distinctly different sites in Helsinki: Torni and Kumpula. The former is a dense city centre site with 22% vegetation, while the latter is a suburban site with over 50% vegetation. At both locations the models are compared against sensible and latent heat fluxes measured using the eddy covariance technique, along with snow depth observations. The cold climate experienced by the city causes strong seasonal variations that include snow cover and stable atmospheric conditions. Most of the time the three models are able to account for the differences between the study areas as well as the seasonal and diurnal variability of the energy balance components. However, the performances are not systematic across the modelled components, season and surface type. The net all-wave radiation is well simulated, with the greatest uncertainties related to snowmelt timing, when the fraction of snow cover has a key role, particularly in determining the surface albedo. For the turbulent fluxes, more variation between the models is seen which can partly be explained by the different methods in their calculation and partly by surface parameter values. For the sensible heat flux, simulation of wintertime values was the main problem, which also leads to issues in predicting near-surface stabilities particularly at the dense city centre site. All models have the most difficulties in simulating latent heat flux. This study particularly emphasizes that improvements are needed in the parameterization of anthropogenic heat flux and thermal parameters in winter, snow cover in spring and evapotranspiration in order to improve the surface energy balance modelling in cold climate cities.

Interdecadal changes on the seasonal prediction of the western North Pacific summer climate around the late 1970s and early 1990s

Identifying predictability and the corresponding sources for the western North Pacific (WNP) summer climate in the case of non-stationary teleconnections during recent decades benefits for further improvements of long-range prediction on the WNP and East Asian summers. In the past few decades, pronounced increases on the summer sea surface temperature (SST) and associated interannual variability are observed over the tropical Indian Ocean and eastern Pacific around the late 1970s and over the Maritime Continent and western–central Pacific around the early 1990s. These increases are associated with significant enhancements of the interannual variability for the lower-tropospheric wind over the WNP. In this study, we further assess interdecadal changes on the seasonal prediction of the WNP summer anomalies, using May-start retrospective forecasts from the ENSEMBLES multi-model project in the period 1960–2005. It is found that prediction of the WNP summer anomalies exhibits an interdecadal shift with higher prediction skills since the late 1970s, particularly after the early 1990s. Improvements of the prediction skills for SSTs after the late 1970s are mainly found around tropical Indian Ocean and the WNP. The better prediction of the WNP after the late 1970s may arise mainly from the improvement of the SST prediction around the tropical eastern Indian Ocean. The close teleconnections between the tropical eastern Indian Ocean and WNP summer variability work both in the model predictions and observations. After the early 1990s, on the other hand, the improvements are detected mainly around the South China Sea and Philippines for the lower-tropospheric zonal wind and precipitation anomalies, associating with a better description of the SST anomalies around the Maritime Continent. A dipole SST pattern over the Maritime Continent and the central equatorial Pacific Ocean is closely related to the WNP summer anomalies after the early 1990s. This teleconnection mode is quite predictable, which is realistically reproduced by the models, presenting more predictable signals to the WNP summer climate after the early 1990s.

Seasonal forecasts of tropical cyclone activity in a high-atmospheric-resolution coupled prediction system

Seasonal forecast skill of the basinwide and regional tropical cyclone (TC) activity in an experimental coupled prediction system based on the ECMWF System 4 is assessed. As part of a collaboration between the Center for Ocean–Land–Atmosphere Studies (COLA) and the ECMWF called Project Minerva, the system is integrated at the atmospheric horizontal spectral resolutions of T319, T639, and T1279. Seven-month hindcasts starting from 1 May for the years 1980–2011 are produced at all three resolutions with at least 15 ensemble members. The Minerva system demonstrates statistically significant skill for retrospective forecasts of TC frequency and accumulated cyclone energy (ACE) in the North Atlantic (NA), eastern North Pacific (EP), and western North Pacific. While the highest scores overall are achieved in the North Pacific, the skill in the NA appears to be limited by an overly strong influence of the tropical Pacific variability. Higher model resolution improves skill scores for the ACE and, to a lesser extent, the TC frequency, even though the influence of large-scale climate variations on these TC activity measures is largely independent of resolution changes. The biggest gain occurs in transition from T319 to T639. Significant skill in regional TC forecasts is achieved over broad areas of the Northern Hemisphere. The highest-resolution hindcasts exhibit additional locations with skill in the NA and EP, including land-adjacent areas. The feasibility of regional intensity forecasts is assessed. In the presence of the coupled model biases, the benefits of high resolution for seasonal TC forecasting may be underestimated.

The Climate-system Historical Forecast Project: do stratosphere-resolving models make better seasonal climate predictions in boreal winter?

Using an international, multi-model suite of historical forecasts from the World Climate Research Programme (WCRP) Climate-system Historical Forecast Project (CHFP), we compare the seasonal prediction skill in boreal wintertime between models that resolve the stratosphere and its dynamics (“high-top”) and models that do not (“low-top”). We evaluate hindcasts that are initialized in November, and examine the model biases in the stratosphere and how they relate to boreal wintertime (Dec-Mar) seasonal forecast skill. We are unable to detect more skill in the high-top ensemble-mean than the low-top ensemble-mean in forecasting the wintertime North Atlantic Oscillation, but model performance varies widely. Increasing the ensemble size clearly increases the skill for a given model. We then examine two major processes involving stratosphere-troposphere interactions (the El Niño-Southern Oscillation/ENSO and the Quasi-biennial Oscillation/QBO) and how they relate to predictive skill on intra-seasonal to seasonal timescales, particularly over the North Atlantic and Eurasia regions. High-top models tend to have a more realistic stratospheric response to El Niño and the QBO compared to low-top models. Enhanced conditional wintertime skill over high-latitudes and the North Atlantic region during winters with El Niño conditions suggests a possible role for a stratospheric pathway.