Inferential, non-parametric statistics to assess quality of probabilistic forecast systems

Many statistical forecast systems are available to interested users. In order to be useful for decision-making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and their statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of `quality’. However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what ‘quality’ entails and how to measure it, leading to confusion and misinformation. Here we present a generic framework to quantify aspects of forecast quality using an inferential approach to calculate nominal significance levels (p-values) that can be obtained either by directly applying non-parametric statistical tests such as Kruskal-Wallis (KW) or Kolmogorov-Smirnov (KS) or by using Monte-Carlo methods (in the case of forecast skill scores). Once converted to p-values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. Our analysis demonstrates the importance of providing p-values rather than adopting some arbitrarily chosen significance levels such as p < 0.05 or p < 0.01, which is still common practice. This is illustrated by applying non-parametric tests (such as KW and KS) and skill scoring methods (LEPS and RPSS) to the 5-phase Southern Oscillation Index classification system using historical rainfall data from Australia, The Republic of South Africa and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. We found that non-parametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system or quality measure. Eventually such inferential evidence should be complimented by descriptive statistical methods in order to fully assist in operational risk management.

The limit to wheat water-use efficiency in eastern Australia. I. Gradients in the radiation environment and atmospheric demand

In the wheatbelt of eastern Australia, rainfall shifts from winter dominated in the south (South Australia, Victoria) to summer dominated in the north (northern New South Wales, southern Queensland). The seasonality of rainfall, together with frost risk, drives the choice of cultivar and sowing date, resulting in a flowering time between October in the south and August in the north. In eastern Australia, crops are therefore exposed to contrasting climatic conditions during the critical period around flowering, which may affect yield potential, and the efficiency in the use of water (WUE) and radiation (RUE). In this work we analysed empirical and simulated data, to identify key climatic drivers of potential water- and radiation-use efficiency, derive a simple climatic index of environmental potentiality, and provide an example of how a simple climatic index could be used to quantify the spatial and temporal variability in resource-use efficiency and potential yield in eastern Australia. Around anthesis, from Horsham to Emerald, median vapour pressure deficit (VPD) increased from 0.92 to 1.28 kPa, average temperature increased from 12.9 to 15.2°C, and the fraction of diffuse radiation (FDR) decreased from 0.61 to 0.41. These spatial gradients in climatic drivers accounted for significant gradients in modelled efficiencies: median transpiration WUE (WUEB/T) increased southwards at a rate of 2.6% per degree latitude and median RUE increased southwards at a rate of 1.1% per degree latitude. Modelled and empirical data confirmed previously established relationships between WUEB/T and VPD, and between RUE and photosynthetically active radiation (PAR) and FDR. Our analysis also revealed a non-causal inverse relationship between VPD and radiation-use efficiency, and a previously unnoticed causal positive relationship between FDR and water-use efficiency. Grain yield (range 1-7 t/ha) measured in field experiments across South Australia, New South Wales, and Queensland (n = 55) was unrelated to the photothermal quotient (Pq = PAR/T) around anthesis, but was significantly associated (r2 = 0.41, P < 0.0001) with newly developed climatic index: a normalised photothermal quotient (NPq = Pq . FDR/VPD). This highlights the importance of diffuse radiation and vapour pressure deficit as sources of variation in yield in eastern Australia. Specific experiments designed to uncouple VPD and FDR and more mechanistic crop models might be required to further disentangle the relationships between efficiencies and climate drivers.

Functional dynamics of the nitrogen balance of sorghum: I. N demand of vegetative plant parts.

Stay-green, an important trait for grain yield of sorghum grown under water limitation, has been associated with a high leaf nitrogen content at the start of grain filling. This study quantifies the N demand of leaves and stems and explores effects of N stress on the N balance of vegetative plant parts of three sorghum hybrids differing in potential crop height. The hybrids were grown under well-watered conditions at three levels of N supply. Vertical profiles of biomass and N% of leaves and stems, together with leaf size and number, and specific leaf nitrogen (SLN), were measured at regular intervals. The hybrids had similar minimum but different critical and maximum SLN, associated with differences in leaf size and N partitioning, the latter associated with differences in plant height. N demand of expanding new leaves was represented by critical SLN, and structural stem N demand by minimum stem N%. The fraction of N partitioned to leaf blades increased under N stress. A framework for N dynamics of leaves and stems is developed that captures effects of N stress and genotype on N partitioning and on critical and maximum SLN.

Addressing the demand for feed grains through the development of high yielding

Development and evaluation of high yielding feed wheat grermplasm.