Inferential, non-parametric statistics to assess quality of probabilistic forecast systems

Many statistical forecast systems are available to interested users. In order to be useful for decision-making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and their statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of `quality’. However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what ‘quality’ entails and how to measure it, leading to confusion and misinformation. Here we present a generic framework to quantify aspects of forecast quality using an inferential approach to calculate nominal significance levels (p-values) that can be obtained either by directly applying non-parametric statistical tests such as Kruskal-Wallis (KW) or Kolmogorov-Smirnov (KS) or by using Monte-Carlo methods (in the case of forecast skill scores). Once converted to p-values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. Our analysis demonstrates the importance of providing p-values rather than adopting some arbitrarily chosen significance levels such as p < 0.05 or p < 0.01, which is still common practice. This is illustrated by applying non-parametric tests (such as KW and KS) and skill scoring methods (LEPS and RPSS) to the 5-phase Southern Oscillation Index classification system using historical rainfall data from Australia, The Republic of South Africa and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. We found that non-parametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system or quality measure. Eventually such inferential evidence should be complimented by descriptive statistical methods in order to fully assist in operational risk management.

Getting value out of your sensory testing - the difference from control test

Non-parametric difference tests such as triangle and duo-trio tests traditionally are used to establish differences or similarities between products. However they only supply the researcher with partial answers and often further testing is required to establish the nature, size and direction of differences. This paper looks at the advantages of the difference from control (DFC) test (also known as degree of difference test) and discusses appropriate applications of the test. The scope and principle of the test, panel composition and analysis of results are presented with the aid of suitable examples. Two of the major uses of the DFC test are in quality control and shelf-life testing. The role DFC takes in these areas and the use of other tests to complement the testing is discussed. Controls or standards are important in both these areas and the use of standard products, mental and written standards and blind controls are highlighted. The DFC test has applications in products where the duo-trio and triangle tests cannot be used because of the normal heterogeneity of the product. While the DFC test is a simple difference test it can be structured to give the researcher more valuable data and scope to make informed decisions about their product.

Three new Lasiodiplodia spp. from the tropics, recognized based on DNA sequence comparisons and morphology

Botryosphaeria rhodina (anamorph Lasiodiplodia theobromae) is a common endophyte and opportunistic pathogen on more than 500 tree species in the tropics and subtropics. During routine disease surveys of plantations in Australia and Venezuela several isolates differing from L. theobromae were identified and subsequently characterized based upon morphology and ITS and EF1-a nucleotide sequences. These isolates grouped into three strongly supported clades related to but different from the known taxa, B. rhodina and L. gonubiensis, These have been described here as three new species L. venezuelensis sp. nov., L. crassispora sp. nov. and L. rubropurpurea sp. nov. The three could be distinguished easily from each other and the two described species of Lasiodiplodia, thus confirming phylogenetic separations. Furthermore all five Lasiodiplodia spp. now recognized separated from Diplodia spp. and Dothiorella spp. with 100% bootstrap support.

Phylogenetic relationships of unclassified, satellitic Pasteurellaceae obtained from different species of birds as demonstrated by 16S rRNA gene sequence comparison

Avian haemophili demonstrating in vitro satellitic growth, also referred to as the V-factor or NAD requirement, have mainly been classified with Avibacterium paragallinarum (Haemophilus paragallinarum), Avibacterium avium (Pasteurella avium), Avibacterium volantium (Pasteurella volantium) and Avibacterium sp. A (Pasteurella species A). The aim of the present study was to assess the taxonomic position of 18 V-factor-requiring isolates of unclassified Haemophilus-like organisms isolated from galliforme, anseriforme, columbiforme and gruiforme birds as well as kestrels and psittacine birds including budgerigars by conventional phenotypic tests and 16S rRNA gene sequencing. All isolates shared phenotypical characteristics which allowed classification with Pasteurellaceae. Haemolysis of bovine red blood cells was negative. Haemin (X-factor) was not required for growth. Maximum-likelihood phylogenetic analysis including bootstrap analysis showed that six isolates were related to the avian 16S rRNA group and were classified as Avibacterium according to 16S rRNA sequence analysis. Surprisingly, the other 12 isolates were unrelated to Avibacterium. Two isolates were unrelated to any of the known 16S rRNA groups of Pasteurellaceae. Two isolates were related to Volucribacter of the avian 16S rRNA group. Seven isolates belonged to the Testudinis 16S rRNA group and out of these, two isolates were closely related to taxa 14 and 32 of Bisgaard, whereas four other isolates were found to form a genus-like group distantly related to taxon 40 and one isolated remained distantly related to other members of the Testudinis group. One isolate was closely related to taxon 26 (a member of Actinobacillus sensu stricto). The study documented major genetic diversity among V-factor-requiring avian isolates beyond the traditional interpretation that they only belong to Avibacterium, underlining the limited value of satellitic growth for identification of avian members of Pasteurellaceae. Our study also emphasized that these organisms will never be isolated without the use of special media satisfying the V-factor requirement.

IUCN classification zones concord with, but underestimate, the population genetic structure of the zebra shark Stegostoma fasciatum in the Indo-West Pacific

The Indo-West Pacific (IWP), from South Africa in the western Indian Ocean to the western Pacific Ocean, contains some of the most biologically diverse marine habitats on earth, including the greatest biodiversity of chondrichthyan fishes. The region encompasses various densities of human habitation leading to contrasts in the levels of exploitation experienced by chondrichthyans, which are targeted for local consumption and export. The demersal chondrichthyan, the zebra shark, Stegostoma fasciatum, is endemic to the IWP and has two current regional International Union for the Conservation of Nature (IUCN) Red List classifications that reflect differing levels of exploitation: ‘Least Concern’ and ‘Vulnerable’. In this study, we employed mitochondrial ND4 sequence data and 13 microsatellite loci to investigate the population genetic structure of 180 zebra sharks from 13 locations throughout the IWP to test the concordance of IUCN zones with demographic units that have conservation value. Mitochondrial and microsatellite data sets from samples collected throughout northern Australia and Southeast Asia concord with the regional IUCN classifications. However, we found evidence of genetic subdivision within these regions, including subdivision between locations connected by habitat suitable for migration. Furthermore, parametric FST analyses and Bayesian clustering analyses indicated that the primary genetic break within the IWP is not represented by the IUCN classifications but rather is congruent with the Indonesian throughflow current. Our findings indicate that recruitment to areas of high exploitation from nearby healthy populations in zebra sharks is likely to be minimal, and that severe localized depletions are predicted to occur in zebra shark populations throughout the IWP region.

Nineteenth century narratives reveal historic catch rates for Australian snapper (Pagrus auratus)

Snapper (Pagrus auratus) is widely distributed throughout subtropical and temperate southern oceans and forms a significant recreational and commercial fishery in Queensland, Australia. Using data from government reports, media sources, popular publications and a government fisheries survey carried out in 1910, we compiled information on individual snapper fishing trips that took place prior to the commencement of fisherywide organized data collection, from 1871 to 1939. In addition to extracting all available quantitative data, we translated qualitative information into bounded estimates and used multiple imputation to handle missing values, forming 287 records for which catch rate (snapper fisher−1 h−1) could be derived. Uncertainty was handled through a parametric maximum likelihood framework (a transformed trivariate Gaussian), which facilitated statistical comparisons between data sources. No statistically significant differences in catch rates were found among media sources and the government fisheries survey. Catch rates remained stable throughout the time series, averaging 3.75 snapper fisher−1 h−1 (95% confidence interval, 3.42–4.09) as the fishery expanded into new grounds. In comparison, a contemporary (1993–2002) south-east Queensland charter fishery produced an average catch rate of 0.4 snapper fisher−1 h−1 (95% confidence interval, 0.31–0.58). These data illustrate the productivity of a fishery during its earliest years of development and represent the earliest catch rate data globally for this species. By adopting a formalized approach to address issues common to many historical records – missing data, a lack of quantitative information and reporting bias – our analysis demonstrates the potential for historical narratives to contribute to contemporary fisheries management.