Inferential, non-parametric statistics to assess quality of probabilistic forecast systems

Many statistical forecast systems are available to interested users. In order to be useful for decision-making, these systems must be based on evidence of underlying mechanisms. Once causal connections between the mechanism and their statistical manifestation have been firmly established, the forecasts must also provide some quantitative evidence of `quality’. However, the quality of statistical climate forecast systems (forecast quality) is an ill-defined and frequently misunderstood property. Often, providers and users of such forecast systems are unclear about what ‘quality’ entails and how to measure it, leading to confusion and misinformation. Here we present a generic framework to quantify aspects of forecast quality using an inferential approach to calculate nominal significance levels (p-values) that can be obtained either by directly applying non-parametric statistical tests such as Kruskal-Wallis (KW) or Kolmogorov-Smirnov (KS) or by using Monte-Carlo methods (in the case of forecast skill scores). Once converted to p-values, these forecast quality measures provide a means to objectively evaluate and compare temporal and spatial patterns of forecast quality across datasets and forecast systems. Our analysis demonstrates the importance of providing p-values rather than adopting some arbitrarily chosen significance levels such as p < 0.05 or p < 0.01, which is still common practice. This is illustrated by applying non-parametric tests (such as KW and KS) and skill scoring methods (LEPS and RPSS) to the 5-phase Southern Oscillation Index classification system using historical rainfall data from Australia, The Republic of South Africa and India. The selection of quality measures is solely based on their common use and does not constitute endorsement. We found that non-parametric statistical tests can be adequate proxies for skill measures such as LEPS or RPSS. The framework can be implemented anywhere, regardless of dataset, forecast system or quality measure. Eventually such inferential evidence should be complimented by descriptive statistical methods in order to fully assist in operational risk management.

Competition of sorghum cultivars and densities with Japanese millet (Echinochloa esculenta).

Field studies were conducted at two locations in southern Queensland, Australia during the 2003-2004 and 2004-2005 growing seasons to determine the differential competitiveness of sorghum (Sorghum bicolor L. Moench) cultivars and crop densities against weeds and the sorghum yield loss due to weeds. Weed competition was investigated by growing sorghum in the presence or absence of a model grass weed, Japanese millet (Echinochloa esculenta). The correlation analyses showed that the early growth traits (height, shoot biomass, and daily growth rate of the shoot biomass) of sorghum adversely affected the height, biomass, and seed production of millet, as measured at maturity. "MR Goldrush" and "Bonus MR" were the most competitive cultivars, resulting in reduced weed biomass, weed density, and weed seed production. The density of sorghum also had a significant effect on the crop's ability to compete with millet. When compared to the density of 4.5 plants per m2, sorghum that was planted at 7.5 plants per m2 suppressed the density, biomass, and seed production of millet by 22%, 27% and 38%, respectively. Millet caused a significant yield loss in comparison with the weed-free plots. The combined weed-suppressive effects of the competitive cultivars, such as MR Goldrush, and high crop densities minimized the yield losses from the weeds. These results indicate that sorghum competition against grass weeds can be improved by choosing competitive cultivars and by using a high crop density of > 7.5 plants per m2. These non-chemical options should be included in an integrated weed management program for better weed management, particularly where the control options are limited by the evolution of herbicide resistance.

Nutrient levels in experimental tanks supplied with prawn pond effluent: the effect of artificial substrate and different densities of the banana prawn Penaeus merguiensis (de Man)

To experimentally investigate the effect of vertical artificial substrate and different densities of the banana prawn Penaeus (Fenneropenaeus) merguiensis on nutrient levels in prawn pond effluent, a time series experiment was conducted in a replicated tank system supplied periodically with discharge from a prawn production pond. Few differences (P>0.05) were detected between tanks without prawns, and tanks with low densities (5 prawns in 1700 litres) of prawns (10-12 g), in terms of nitrogen and phosphorus in the water column over the 28-day experimental period. Higher densities of prawns (starting at 25 or 50 per tank) caused an elevation of these macronutrients in the water column. This was partly due to prawn biomass losses from mortalities and weight reductions in the tank system. The survival and condition of prawns was significantly (P<0.05) reduced in tanks at these higher densities. The presence of artificial substrate (2 m2 tank-1) did not affect (P>0.05) the levels of nutrients in tank water columns, but significantly (P<0.05) increased the amount of nitrogen in tank residues left at the end of the trial when no prawns were present. The prawns had obviously been grazing on surfaces inside the tanks, and their swimming actions appeared to keep light particulate matter in suspension. Higher prawn densities increased microalgal blooms, which presumably kept ammonia levels low, and it is suggested that this association may provide the means for improved remediation of prawn farm effluent in the future.

Population dynamics of house mice in Queensland grain-growing areas

Context. Irregular plagues of house mice cause high production losses in grain crops in Australia. If plagues can be forecast through broad-scale monitoring or model-based prediction, then mice can be proactively controlled by poison baiting. Aims. To predict mouse plagues in grain crops in Queensland and assess the value of broad-scale monitoring. Methods. Regular trapping of mice at the same sites on the Darling Downs in southern Queensland has been undertaken since 1974. This provides an index of abundance over time that can be related to rainfall, crop yield, winter temperature and past mouse abundance. Other sites have been trapped over a shorter time period elsewhere on the Darling Downs and in central Queensland, allowing a comparison of mouse population dynamics and cross-validation of models predicting mouse abundance. Key results. On the regularly trapped 32-km transect on the Darling Downs, damaging mouse densities occur in 50% of years and a plague in 25% of years, with no detectable increase in mean monthly mouse abundance over the past 35 years. High mouse abundance on this transect is not consistently matched by high abundance in the broader area. Annual maximum mouse abundance in autumn–winter can be predicted (R2 = 57%) from spring mouse abundance and autumn–winter rainfall in the previous year. In central Queensland, mouse dynamics contrast with those on the Darling Downs and lack the distinct annual cycle, with peak abundance occurring in any month outside early spring.Onaverage, damaging mouse densities occur in 1 in 3 years and a plague occurs in 1 in 7 years. The dynamics of mouse populations on two transects ~70 km apart were rarely synchronous. Autumn–winter rainfall can indicate mouse abundance in some seasons (R2 = ~52%). Conclusion. Early warning of mouse plague formation in Queensland grain crops from regional models should trigger farm-based monitoring. This can be incorporated with rainfall into a simple model predicting future abundance that will determine any need for mouse control. Implications. A model-based warning of a possible mouse plague can highlight the need for local monitoring of mouse activity, which in turn could trigger poison baiting to prevent further mouse build-up.

Effects of added shelter and stocking density on growth of sleepy cod Oxyeleotris lineolatus in ponds

Sleepy cod Oxyeleotris lineolatus is a species of freshwater goby in demand in Australian markets by consumers of Asian origin. It is related to marble goby Oxyeleotris marmoratus, the most expensive freshwater food fish in Asia, which is cultured throughout southeast Asia in ponds and cages. The performance of sleepy cod in culture conditions was investigated to assess the viability of farming them in northern Australia. Sleepy cod fingerlings (62.8 +/- 0.8 mm total length and 2.56 +/- 0.095 g) were stocked into experimental ponds at 32,857 fish/ha, and grown out for 8 mo. Shelter was provided in each of three replicate ponds and was absent in three control ponds. The provision of shelter in juvenile growout was found to be of no benefit, although fish in ponds provided with shelter weighed slightly more per unit length than fish in ponds without shelter. Cannibalism was not a problem in growout, and survival was close to 100%. After the shelter trial was completed, fish were graded into large and small classes (three replicates of each), and grown out without shelter at the same density for 158 d. Following that, fish were again graded, and the largest 30% retained from growout at a density of 8,857 fish/ha (large, 198 +/-6.44 g) or 10,000 fish/ha (small, 48.9 +/-1.27 g). These were grown out for 188 d. Growth of selected stock at low densities was slower than earlier growth rates, although smaller fish gained weight more rapidly than larger fish. Growth rates were better than the only published data for marble goby. Further investigation into high density culture and different genotypes of sleepy cod needs to be undertaken to determine the viability of pond culture.

Evaluating legume species as alternative trap crops to chickpea for management of Helicoverpa spp. (Lepidoptera: Noctuidae) in central Queensland cotton cropping systems

Mounting levels of insecticide resistance within Australian Helicoverpa spp. populations have resulted in the adoption of non-chemical IPM control practices such as trap cropping with chickpea, Cicer arietinum (L.). However, a new leaf blight disease affecting chickpea in Australia has the potential to limit its use as a trap crop. Therefore this paper evaluates the potential of a variety of winter-active legume crops for use as an alternative spring trap crop to chickpea as part of an effort to improve the area-wide management strategy for Helicoverpa spp. in central Queensland’s cotton production region. The densities of Helicoverpa eggs and larvae were compared over three seasons on replicated plantings of chickpea, Cicer arietinum (L.), field pea Pisum sativum (L), vetch, Vicia sativa (L.) and faba bean, Vicia faba (L.). Of these treatments, field pea was found to harbour the highest densities of eggs. A partial life table study of the fate of eggs oviposited on field pea and chickpea suggested that large proportions of the eggs laid on field pea suffered mortality due to dislodgment from the plants after oviposition. Plantings of field pea as a replacement trap crop for chickpea under commercial conditions confirmed the high level of attractiveness of this crop to ovipositing moths. The use of field pea as a trap crop as part of an areawide management programme for Helicoverpa spp. is discussed.

Distribution and abundance of white grubs (Coleoptera: Scarabaeidae) on groundnut in southern India

Scarab species associated with groundnuts were surveyed in Andhra Pradesh, Karnataka and Tamil Nadu, southern India, between 1995 and 2001. Scarab adults were collected from trees on which they were feeding and/or mating, and larvae (white grubs) from groundnut fields. Holotrichia species, especially H. reynaudi and H. serrata were the major species associated with groundnut. H. reynaudi predominated in the central Deccan area, while H. serrata was most abundant in areas to the south and west. A new, undescribed, Holotrichia species near H. consanguinea was collected south and south-west of Hyderabad in mixed populations with H. reynaudi. However, the full extent of this new species’ distribution remains uncertain. H. rufoflava was rarely associated with groundnut, but was common as an adult at some locations. Other genera encountered during surveys were Anomala, Adoretus, Schizonycha, Autoserica. In survey data, densities of Holotrichia larvae and ‘all other white grubs’ were both very highly correlated with % of damaged groundnut plants. These correlations in combination with concurrent observations of plant damage establish a causal link between white grubs and plant damage and death in southern Indian groundnut. Ranking of preferred host trees for adults were developed from field observations for four Holotrichia species and Schizonycha spp. and will assist grower-initiated surveys of pest occurrence. In combination with insecticide efficacy data published elsewhere, the survey provides the basis for an environmentally friendly and economically viable pest-management system for white grubs on groundnut in southern India.

Climate information needs of Gascoyne-Murchison pastoralists: a representative study of the Western Australian grazing industry

The Gascoyne-Murchison region of Western Australia experiences an arid to semi-arid climate with a highly variable temporal and spatial rainfall distribution. The region has around 39.2 million hectares available for pastoral lease and supports predominantly catle and sheep grazing leases. In recent years a number of climate forecasting systems have been available offering rainfall probabilities with different lead times and a forecast period; however, the extent to which these systems are capable of fulfilling the requirements of the local pastoralists is still ambiguous. Issues can range from ensuring forecasts are issued with sufficient lead time to enable key planning or decisions to be revoked or altered, to ensuring forecast language is simple and clear, to negate possible misunderstandings in interpretation. A climate research project sought to provide an objective method to determine which available forecasting systems had the greatest forecasting skill at times of the year relevant to local property management. To aid this climate research project, the study reported here was undertaken with an overall objective of exploring local pastoralists' climate information needs. We also explored how well they understand common climate forecast terms such as 'mean', median' and 'probability', and how they interpret and apply forecast information to decisions. A stratified, proportional random sampling was used for the purpose of deriving the representative sample based on rainfall-enterprise combinations. In order to provide more time for decision-making than existing operational forecasts that are issued with zero lead time, pastoralists requested that forecasts be issued for May-July and January-March with lead times counting down from 4 to 0 months. We found forecasts of between 20 and 50 mm break-of-season or follow-up rainfall were likely to influence decisions. Eighty percent of pastoralists demonstrated in a test question that they had a poor technical understanding of how to interpret the standard wording of a probabilistic median rainfall forecast. this is worthy of further research to investigate whether inappropriate management decisions are being made because the forecasts are being misunderstood. We found more than half the respondents regularly access and use weather and climate forecasts or outlook information from a range of sources and almost three-quarters considered climate information or tools useful, with preferred methods for accessing this information by email, faxback service, internet and the Department of Agriculture Western Australia's Pastoral Memo. Despite differences in enterprise types and rainfall seasonality across the region we found seasonal climate forecasting needs were relatively consistent. It became clear that providing basic training and working with pastoralists to help them understand regional climatic drivers, climate terminology and jargon, and the best ways to apply the forecasts to enhance decision-making are important to improve their use of information. Consideration could also be given to engaging a range of producers to write the climate forecasts themselves in the language they use and understand, in consultation with the scientists who prepare the forecasts.

Formative evaluation to benchmark and improve climate-based decision support for graziers in Western Queelsland

Researchers developing climate-based forecasts, workshops, software tools and information to aid grazier decisions undertook an evaluation study to enhance planning and benchmark impact. One hundred graziers in Western Queensland were randomly selected from 7 shires and surveyed by mail and telephone (43 respondents) to explore levels of knowledge and use of climate information, practices and information needs. We found 36% of respondents apply the Southern Oscillation Index to property decisions but 92% were unaware El Niño Southern Oscillation’s predictive signal in the region is greater for pasture growth than rainfall, suggesting they may not recognise the potential of pasture growth forecasts. Almost 75% of graziers consider they are conservative or risk averse in their attitude to managing their enterprise. Mail respondents (n= 20) if given a 68%, on average, probability of exceeding median rainfall forecast may change a decision; almost two-thirds vary stocking rate based on forage available, last year’s pasture growth or the Southern Oscillation Index; the balance maintain a constant stocking rate strategy; 90% have access to a computer; 75% to the internet and 95% have a fax. This paper presents findings of the study and draws comparisons with a similar study of 174 irrigators in the Northern Murray-Darling Basin (Aust. J. Exp. Ag. 44, 247-257). New insights and information gained are helping the team better understand client needs and plan, design and extend tools and information tailored to grazier knowledge, practice, information needs and preferences. Results have also provided a benchmark against which to measure project impact and have influenced the team to make important changes to their project planning, activities and methods for transferring technology tailored to grazier preferences.

Damage potential of an introduced biological control agent Agonosoma trilineatum (F.) on bellyache bush (Jatropha gossypiifolia L.)

The seed-feeding jewel bug, Agonosoma trilineatum (F.), is an introduced biological control agent for bellyache bush, Jatropha gossypiifolia L. To quantify the damage potential of this agent, shadehouse experiments were conducted with individual bellyache bush plants exposed to a range of jewel bug densities (0, 6 or 24 jewel bugs/plant). The level of abortion of both immature and mature seed capsules and impacts on seed weight and seed viability were recorded in an initial short-term study. The ability of the jewel bug to survive and cause sustained damage was then investigated by measuring seed production, the survival of adults and nymph density across three 6-month cycles. The level of seed capsule abortion caused by the jewel bug was significantly affected by the maturity status of capsules and the density of insects present. Immature capsules were most susceptible and capsule abortion increased with jewel bug density. Similarly, on average, the insects reduced the viability of bellyache bush seeds by 79% and 89% at low and high densities, respectively. However, sustaining jewel bug populations for prolonged periods proved difficult. Adult survival at the end of three 6-month cycles averaged 11% and associated reductions in viable seed production ranged between 55% and 77%. These results suggest that the jewel bug has the potential to reduce the number of viable seeds entering the soil seed bank provided populations can be established and maintained at sufficiently high densities.

Distributions of lesser mealworm (Coleoptera: Tenebrionidae) in litter of a compacted earth floor broiler house in subtropical Queensland, Australia

Distributions of lesser mealworm, Alphitobius diaperinus (Panzer) (Coleoptera: Tenebrionidae), in litter of a compacted earth floor broiler house in southeastern Queensland, Australia, were studied over two flocks. Larvae were the predominant stage recorded. Significantly low densities occurred in open locations and under drinker cups where chickens had complete access, whereas high densities were found under feed pans and along house edges where chicken access was restricted. For each flock, lesser mealworm numbers increased at all locations over the first 14 d, especially under feed pans and along house edges, peaking at 26 d and then declining over the final 28 d. A life stage profile per flock was devised that consisted of the following: beetles emerge from the earth floor at the beginning of each flock, and females lay eggs, producing larvae that peak in numbers at 3 wk; after a further 3 to 4 wk, larvae leave litter to pupate in the earth floor, and beetles then emerge by the end of the flock time. Removing old litter from the brooder section at the end of a flock did not greatly reduce mealworm numbers over the subsequent flock, but it seemed to prevent numbers increasing, while an increase in numbers in the grow-out section was recorded after reusing litter. Areas under feed pans and along house edges accounted for 5% of the total house area, but approximately half the estimated total number of lesser mealworms in the broiler house occurred in these locations. The results of this study will be used to determine optimal deployment of site-specific treatments for lesser mealworm control.

Rainfall and streamflow response to El Niño Southern Oscillation: a case study in a semiarid catchment, Australia.

This paper aims to compare the shift in frequency distribution and skill of seasonal climate forecasting of both streamflow and rainfall in eastern Australia based on the Southern Oscillation Index (SOI) Phase system. Recent advances in seasonal forecasting of climate variables have highlighted opportunities for improving decision making in natural resources management. Forecasting of rainfall probabilities for different regions in Australia is available, but the use of similar forecasts for water resource supply has not been developed. The use of streamflow forecasts may provide better information for decision-making in irrigation supply and flow management for improved ecological outcomes. To examine the relative efficacy of seasonal forecasting of streamflow and rainfall, the shift in probability distributions and the forecast skill were evaluated using the Wilcoxon rank-sum test and the linear error in probability space (LEPS) skill score, respectively, at three river gauging stations in the Border Rivers Catchment of the Murray-Darling Basin in eastern Australia. A comparison of rainfall and streamflow distributions confirms higher statistical significance in the shift of streamflow distribution than that in rainfall distribution. Moreover, streamflow distribution showed greater skill of forecasting with 0-3 month lead time, compared to rainfall distribution.

Sampling and management of Bemisia tabaci (Genn.) biotype B in Australian cotton

Data on seasonal population abundance of Bemisia tabaci biotype B (silverleaf whitefly (SLW)) in Australian cotton fields collected over four consecutive growing seasons (2002/2003-2005/2006) were used to develop and validate a multiple-threshold-based management and sampling plan. Non-linear growth trajectories estimated from the field sampling data were used as benchmarks to classify adult SLW field populations into six density-based management zones with associated control recommendations in the context of peak flowering and open boll crop growth stages. Control options based on application of insect growth regulators (IGRs) are recommended for high-density populations (>2 adults/leaf) whereas conventional (non-IGR) products are recommended for the control of low to moderate population densities. A computerised re-sampling program was used to develop and test a binomial sampling plan. Binomial models with thresholds of T=1, 2 and 3 adults/leaf were tested using the field abundance data. A binomial plan based on a tally threshold of T=2 adults/leaf and a minimum sample of 20 leaves at nodes 3, 4 or 5 below the terminal is recommended as the most parsimonious and practical sampling protocol for Australian cotton fields. A decision support guide with management zone boundaries expressed as binomial counts and control options appropriate for various SLW density situations is presented. Appropriate use of chemical insecticides and tactics for successful field control of whiteflies are discussed.

A comparison of mark-recapture distance-sampling methods applied to aerial surveys of eastern grey kangaroos

Aerial surveys of kangaroos (Macropus spp.) in Queensland are used to make economically important judgements on the levels of viable commercial harvest. Previous analysis methods for aerial kangaroo surveys have used both mark-recapture methodologies and conventional distance-sampling analyses. Conventional distance sampling has the disadvantage that detection is assumed to be perfect on the transect line, while mark-recapture methods are notoriously sensitive to problems with unmodelled heterogeneity in capture probabilities. We introduce three methodologies for combining together mark-recapture and distance-sampling data, aimed at exploiting the strengths of both methodologies and overcoming the weaknesses. Of these methods, two are based on the assumption of full independence between observers in the mark-recapture component, and this appears to introduce more bias in density estimation than it resolves through allowing uncertain trackline detection. Both of these methods give lower density estimates than conventional distance sampling, indicating a clear failure of the independence assumption. The third method, termed point independence, appears to perform very well, giving credible density estimates and good properties in terms of goodness-of-fit and percentage coefficient of variation. Estimated densities of eastern grey kangaroos range from 21 to 36 individuals km-2, with estimated coefficients of variation between 11% and 14% and estimated trackline detection probabilities primarily between 0.7 and 0.9.

Abundance and mortality of overwintering pupae of Helicoverpa armigera (Hübner) (Lepidoptera: Noctuidae) on the Darling Downs, Queensland, Australia

Surveys were conducted between 1997 and 2001 to investigate the incidence of overwintering Helicoverpa spp. pupae under summer crop residues on the Darling Downs, Queensland. Only Helicoverpa armigera was represented in collections of overwintering pupae. The results indicated that late-season crops of cotton, sorghum, maize, soybean, mungbean and sunflower were equally likely to have overwintering pupae under them. In the absence of tillage practices, these crops had the potential to produce similar numbers of moths/ha in the spring. There were expected differences between years in the densities of overwintering pupae and the number of emerged moths/ha. Irrigated crops produced 2.5 times more moths/ha than dryland crops. Overall survival from autumn-formed pupae to emerged moths averaged 44%, with a higher proportion of pupae under maize surviving to produce moths than each of the other crops. Parasitoids killed 44.1% of pupae, with Heteropelma scaposum representing 83.3% of all parasitoids reared from pupae. Percentage parasitism levels were lower in irrigated crops (27.6%) compared with dryland crops (40.5%). Recent changes to Helicoverpa spp. management in cotton/grain-farming systems in south-eastern Queensland, including widespread adoption of Bt cotton, and use of more effective and more selective insecticides, could lead to lower densities of overwintering pupae under late summer crops.