On measuring quality of a probabilistic commodity forecast for a system that incorporates seasonal climate forecasts

Regional commodity forecasts are being used increasingly in agricultural industries to enhance their risk management and decision-making processes. These commodity forecasts are probabilistic in nature and are often integrated with a seasonal climate forecast system. The climate forecast system is based on a subset of analogue years drawn from the full climatological distribution. In this study we sought to measure forecast quality for such an integrated system. We investigated the quality of a commodity (i.e. wheat and sugar) forecast based on a subset of analogue years in relation to a standard reference forecast based on the full climatological set. We derived three key dimensions of forecast quality for such probabilistic forecasts: reliability, distribution shift, and change in dispersion. A measure of reliability was required to ensure no bias in the forecast distribution. This was assessed via the slope of the reliability plot, which was derived from examination of probability levels of forecasts and associated frequencies of realizations. The other two dimensions related to changes in features of the forecast distribution relative to the reference distribution. The relationship of 13 published accuracy/skill measures to these dimensions of forecast quality was assessed using principal component analysis in case studies of commodity forecasting using seasonal climate forecasting for the wheat and sugar industries in Australia. There were two orthogonal dimensions of forecast quality: one associated with distribution shift relative to the reference distribution and the other associated with relative distribution dispersion. Although the conventional quality measures aligned with these dimensions, none measured both adequately. We conclude that a multi-dimensional approach to assessment of forecast quality is required and that simple measures of reliability, distribution shift, and change in dispersion provide a means for such assessment. The analysis presented was also relevant to measuring quality of probabilistic seasonal climate forecasting systems. The importance of retaining a focus on the probabilistic nature of the forecast and avoiding simplifying, but erroneous, distortions was discussed in relation to applying this new forecast quality assessment paradigm to seasonal climate forecasts. Copyright (K) 2003 Royal Meteorological Society.

The effectiveness of personalized smoking cessation strategies for callers to a Quitline service

Aim To assess the effectiveness of a program of computer-generated tailored advice for callers to a telephone helpline, and to assess whether it enhanced a series of callback telephone counselling sessions in aiding smoking cessation. Design Randomized controlled trial comparing: (1) untailored self-help materials; (2) computer-generated tailored advice only, and (3) computer-generated tailored advice plus callback telephone counselling. Assessment surveys were conducted at baseline, 3, 6 and 12 months. Setting Victoria, Australia. Participants A total of 1578 smokers who called the Quitline service and agreed to participate. Measurements Smoking status at follow-up; duration of cessation, if quit; use of nicotine replacement therapy; and extent of participation in the callback service. Findings At the 3-month follow-up, significantly more (chi(2)(2) = 16.9; P < 0.001) participants in the computer-generated tailored advice plus telephone counselling condition were not smoking (21%) than in either the computer-generated advice only (12%) or the control condition (12%). Proportions reporting not smoking at the 12-month follow-up were 26%, 23% and 22%, respectively (NS) for point prevalence, and for 9 months sustained abstinence; 8.2, 6.0, and 5.0 (NS). In the telephone counselling group, those receiving callbacks were more likely than those who did not to have sustained abstinence at 12 months (10.2 compared with 4.0, P < 0.05). Logistic regression on 3-month data showed significant independent effects on cessation of telephone counselling and use of NRT, but not of computer-generated tailored advice. Conclusion Computer-generated tailored advice did not enhance telephone counselling, nor have any independent effect on cessation. This may be due to poor timing of the computer-generated tailored advice and poor integration of the two modes of advice.