Model Configuration And Data Management In The Short-Term Water Information Forecasting Tools

The Short-term Water Information and Forecasting Tools (SWIFT) is a suite of tools for flood and short-term streamflow forecasting, consisting of a collection of hydrologic model components and utilities. Catchments are modeled using conceptual subareas and a node-link structure for channel routing. The tools comprise modules for calibration, model state updating, output error correction, ensemble runs and data assimilation. Given the combinatorial nature of the modelling experiments and the sub-daily time steps typically used for simulations, the volume of model configurations and time series data is substantial and its management is not trivial. SWIFT is currently used mostly for research purposes but has also been used operationally, with intersecting but significantly different requirements. Early versions of SWIFT used mostly ad-hoc text files handled via Fortran code, with limited use of netCDF for time series data. The configuration and data handling modules have since been redesigned. The model configuration now follows a design where the data model is decoupled from the on-disk persistence mechanism. For research purposes the preferred on-disk format is JSON, to leverage numerous software libraries in a variety of languages, while retaining the legacy option of custom tab-separated text formats when it is a preferred access arrangement for the researcher. By decoupling data model and data persistence, it is much easier to interchangeably use for instance relational databases to provide stricter provenance and audit trail capabilities in an operational flood forecasting context. For the time series data, given the volume and required throughput, text based formats are usually inadequate. A schema derived from CF conventions has been designed to efficiently handle time series for SWIFT.

Modelos de previsão de produção para centrais mini-hídricas

O constante crescimento dos produtores em regime especial aliado à descentralização dos pontos injetores na rede, tem permitido uma redução da importação de energia mas também tem acarretado maiores problemas para a gestão da rede. Estes problemas estão relacionados com o facto da produção estar dependente das condições climatéricas, como é o caso dos produtores eólicos, hídricos e solares. A previsão da energia produzida em função da previsão das condições climatéricas tem sido alvo de atenção por parte da comunidade empresarial do setor, pelo facto de existir modelos razoáveis para a previsão das condições climatéricas a curto prazo, e até a longo prazo. Este trabalho trata, em concreto, do problema da previsão de produção em centrais mini-hídricas, apresentando duas propostas para essa previsão. Em ambas as propostas efetua-se inicialmente a previsão do caudal que chega à central, sendo esta depois convertida em potência que é injetada na rede. Para a previsão do caudal utilizaram-se dois métodos estatísticos: o método Holt-Winters e os modelos ARMAX. Os dois modelos de previsão propostos consideram um horizonte temporal de uma semana, com discretização horária, para uma central no norte de Portugal, designadamente a central de Penide. O trabalho também contempla um pequeno estudo da bibliografia existente tanto para a previsão da produção como de afluências de centrais hidroelétricas. Aborda, ainda, conceitos relacionados com as mini-hídricas e apresenta uma caraterização do parque de centrais mini-hídricas em Portugal.

Análise do erro de previsão de vazões mensais com diferentes horizontes de previsão

Este trabalho aborda o problema de previsão para séries de vazões médias mensais, no qual denomina-se de horizonte de previsão (h), o intervalo de tempo que separa a última observação usada no ajuste do modelo de previsão e o valor futuro a ser previsto. A análise do erro de previsão é feita em função deste horizonte de previsão. Estas séries possuem um comportamento periódico na média, na variância e na função de autocorrelação. Portanto, considera-se a abordagem amplamente usada para a modelagem destas séries que consiste inicialmente em remover a periodicidade na média e na variância das séries de vazões e em seguida calcular uma série padronizada para a qual são ajustados modelos estocásticos. Neste estudo considera-se para a série padronizada os modelos autorregressivos periódicos PAR (p m). As ordens p m dos modelos ajustados para cada mês são determinadas usando os seguintes critérios: a análise clássica da função de autocorrelação parcial periódica (FACPPe); usando-se o Bayesian Information Criterion (BIC) proposto em (MecLeod, 1994); e com a análise da FACPPe proposta em (Stedinger, 2001). Os erros de previsão são calculados, na escala original da série de vazão, em função dos parâmetros dos modelos ajustados e avaliados para horizontes de previsão h variando de 1 a 12 meses. Estes erros são comparados com as estimativas das variâncias das vazões para o mês que está sendo previsto. Como resultado tem-se uma avaliação da capacidade de previsão, em meses, dos modelos ajustados para cada mês.

Examining the large-scale spatial coherence of European drought using regional indicators of precipitation and streamflow deficit

Droughts tend to evolve slowly and affect large areas simultaneously, which suggests that improved understanding of spatial coherence of drought would enable better mitigation of drought impacts through enhanced monitoring and forecasting strategies. This study employs an up-to-date dataset of over 500 river flow time series from 11 European countries, along with a gridded precipitation dataset, to examine the spatial coherence of drought in Europe using regional indicators of precipitation and streamflow deficit. The drought indicators were generated for 24 homogeneous regions and, for selected regions, historical drought characteristics were corroborated with previous work. The spatial coherence of drought characteristics was then examined at a European scale. Historical droughts generally have distinctive signatures in their spatio-temporal development, so there was limited scope for using the evolution of historical events to inform forecasting. Rather, relationships were explored in time series of drought indicators between regions. Correlations were generally low, but multivariate analyses revealed broad continental-scale patterns, which appear to be related to large-scale atmospheric circulation indices (in particular, the North Atlantic Oscillation and the East Atlantic West Russia pattern). A novel methodology for forecasting was developed (and demonstrated with reference to the United Kingdom), which predicts drought from drought i.e. uses spatial coherence of drought to facilitate early warning of drought in a target region, from drought which is developing elsewhere in Europe.Whilst the skill of the methodology is relatively modest at present, this approach presents a potential new avenue for forecasting, which offers significant advantages in that it allows prediction for all seasons, and also shows some potential for forecasting the termination of drought conditions.

Challenges of operational river forecasting

Skillful and timely streamflow forecasts are critically important to water managers and emergency protection services. To provide these forecasts, hydrologists must predict the behavior of complex coupled human–natural systems using incomplete and uncertain information and imperfect models. Moreover, operational predictions often integrate anecdotal information and unmodeled factors. Forecasting agencies face four key challenges: 1) making the most of available data, 2) making accurate predictions using models, 3) turning hydrometeorological forecasts into effective warnings, and 4) administering an operational service. Each challenge presents a variety of research opportunities, including the development of automated quality-control algorithms for the myriad of data used in operational streamflow forecasts, data assimilation, and ensemble forecasting techniques that allow for forecaster input, methods for using human-generated weather forecasts quantitatively, and quantification of human interference in the hydrologic cycle. Furthermore, much can be done to improve the communication of probabilistic forecasts and to design a forecasting paradigm that effectively combines increasingly sophisticated forecasting technology with subjective forecaster expertise. These areas are described in detail to share a real-world perspective and focus for ongoing research endeavors.

Evaluating the usefulness of soil moisture (forecasts) in streamflow prediction for central Texas

The past decade has brought significant advancements in seasonal climate forecasting. However, water resources decision support and management continues to be based almost entirely on historical observations and does not take advantage of climate forecasts. This study builds on previous work that conditioned streamflow ensemble forecasts on observable climate indicators, such as the El Niño-Southern Oscillation (ENSO) and the Pacific Decadal Oscillation (PDO) for use in a decision support model for the Highland Lakes multi-reservoir system in central Texas operated by the Lower Colorado River Authority (LCRA). In the current study, seasonal soil moisture is explored as a climate indicator and predictor of annual streamflow for the LCRA region. The main purpose of this study is to evaluate the correlation of fractional soil moisture with streamflow using the 1950-2000 Variable Infiltration Capacity (VIC) Retrospective Land Surface Data Set over the LCRA region. Correlations were determined by examining different annual and seasonal combinations of VIC modeled fractional soil moisture and observed streamflow. The applicability of the VIC Retrospective Land Surface Data Set as a data source for this study is tested along with establishing and analyzing patterns of climatology for the watershed study area using the selected data source (VIC model) and historical data. Correlation results showed potential for the use of soil moisture as a predictor of streamflow over the LCRA region. This was evident by the good correlations found between seasonal soil moisture and seasonal streamflow during coincident seasons as well as between seasonal and annual soil moisture with annual streamflow during coincident years. With the findings of good correlation between seasonal soil moisture from the VIC Retrospective Land Surface Data Set with observed annual streamflow presented in this study, future research would evaluate the application of NOAA Climate Prediction Center (CPC) forecasts of soil moisture in predicting annual streamflow for use in the decision support model for the LCRA.

Evaluation of the accuracy of radar based precipitation for use in flow forecasting for the Fox Chain of Lakes /

"Prepared for the Illinois Dept. of Natural Resources."

Conversion to soy on the Amazonian agricultural frontier increases streamflow without affecting stormflow dynamics

Large-scale soy agriculture in the southern Brazilian Amazon now rivals deforestation for pasture as the region`s predominant form of land use change. Such landscape-level change can have substantial consequences for local and regional hydrology, but these effects remain relatively unstudied in this ecologically and economically important region. We examined how the conversion to soy agriculture influences water balances and stormflows using stream discharge (water yields) and the timing of discharge (stream hydrographs) in small (2.5-13.5 km2) forested and soy headwater watersheds in the Upper Xingu Watershed in the state of Mato Grosso, Brazil. We monitored water yield for 1 year in three forested and four soy watersheds. Mean daily water yields were approximately four times higher in soy than forested watersheds, and soy watersheds showed greater seasonal variability in discharge. The contribution of stormflows to annual streamflow in all streams was low (< 13% of annual streamflow), and the contribution of stormflow to streamflow did not differ between land uses. If the increases in water yield observed in this study are typical, landscape-scale conversion to soy substantially alters water-balance, potentially altering the regional hydrology over large areas of the southern Amazon.

Thermodynamic and topological instability approaches for forecasting glass-forming ability in the ternary Al-Ni-Y system

A thermodynamic approach to predict bulk glass-forming compositions in binary metallic systems was recently proposed. In this approach. the parameter gamma* = Delta H-amor/(Delta H-inter - Delta H-amor) indicates the glass-forming ability (GFA) from the standpoint of the driving force to form different competing phases, and Delta H-amor and Delta H-inter are the enthalpies for-lass and intermetallic formation, respectively. Good glass-forming compositions should have a large negative enthalpy for glass formation and a very small difference for intermetallic formation, thus making the glassy phase easily reachable even under low cooling rates. The gamma* parameter showed a good correlation with GFA experimental data in the Ni-Nb binary system. In this work, a simple extension of the gamma* parameter is applied in the ternary Al-Ni-Y system. The calculated gamma* isocontours in the ternary diagram are compared with experimental results of glass formation in that system. Despite sonic misfitting, the best glass formers are found quite close to the highest gamma* values, leading to the conclusion that this thermodynamic approach can lie extended to ternary systems, serving as a useful tool for the development of new glass-forming compositions. Finally the thermodynamic approach is compared with the topological instability criteria used to predict the thermal behavior of glassy Al alloys. (C) 2007 Elsevier B. V. All rights reserved.

Electric Power Forecasting Methodologies of Some South American Countries: A Comparative Analysis

In this paper, a comparative analysis of the long-term electric power forecasting methodologies used in some South American countries, is presented. The purpose of this study is to compare and observe if such methodologies have some similarities, and also examine the behavior of the results when they are applied to the Brazilian electric market. The abovementioned power forecasts were performed regarding the main four consumption classes (residential, industrial, commercial and rural) which are responsible for approximately 90% of the national consumption. The tool used in this analysis was the SAS (c) program. The outcome of this study allowed identifying various methodological similarities, mainly those related to the econometric variables used by these methods. This fact strongly conditioned the comparative results obtained.

Comparison between detailed model simulation and artificial neural network for forecasting building energy consumption

There are several ways to attempt to model a building and its heat gains from external sources as well as internal ones in order to evaluate a proper operation, audit retrofit actions, and forecast energy consumption. Different techniques, varying from simple regression to models that are based on physical principles, can be used for simulation. A frequent hypothesis for all these models is that the input variables should be based on realistic data when they are available, otherwise the evaluation of energy consumption might be highly under or over estimated. In this paper, a comparison is made between a simple model based on artificial neural network (ANN) and a model that is based on physical principles (EnergyPlus) as an auditing and predicting tool in order to forecast building energy consumption. The Administration Building of the University of Sao Paulo is used as a case study. The building energy consumption profiles are collected as well as the campus meteorological data. Results show that both models are suitable for energy consumption forecast. Additionally, a parametric analysis is carried out for the considered building on EnergyPlus in order to evaluate the influence of several parameters such as the building profile occupation and weather data on such forecasting. (C) 2008 Elsevier B.V. All rights reserved.

A hybrid commodity price-forecasting model applied to the sugar-alcohol sector

Accurate price forecasting for agricultural commodities can have significant decision-making implications for suppliers, especially those of biofuels, where the agriculture and energy sectors intersect. Environmental pressures and high oil prices affect demand for biofuels and have reignited the discussion about effects on food prices. Suppliers in the sugar-alcohol sector need to decide the ideal proportion of ethanol and sugar to optimise their financial strategy. Prices can be affected by exogenous factors, such as exchange rates and interest rates, as well as non-observable variables like the convenience yield, which is related to supply shortages. The literature generally uses two approaches: artificial neural networks (ANNs), which are recognised as being in the forefront of exogenous-variable analysis, and stochastic models such as the Kalman filter, which is able to account for non-observable variables. This article proposes a hybrid model for forecasting the prices of agricultural commodities that is built upon both approaches and is applied to forecast the price of sugar. The Kalman filter considers the structure of the stochastic process that describes the evolution of prices. Neural networks allow variables that can impact asset prices in an indirect, nonlinear way, what cannot be incorporated easily into traditional econometric models.

Forecasting fuel ethanol consumption in Brazil by time series models: 2006-2012

This article analysed scenarios for Brazilian consumption of ethanol for the period 2006 to 2012. The results show that if the country`s GDP sustains a 4.6% a year growth, domestic consumption of fuel ethanol could increase to 25.16 billion liters in this period, which is a volume relatively close to the forecasted gasoline consumption of 31 billion liters. At a lower GDP growth of 1.22% a year, gasoline consumption would be reduced and domestic ethanol consumption in Brazil would be no higher than 18.32 billion liters. Contrary to the current situation, forecasts indicated that hydrated ethanol consumption could become much higher than anhydrous consumption in Brazil. The former is being consumed in cars moved exclusively by ethanol and flex-fuel cars, successfully introduced in the country at 2003. Flex cars allow Brazilian consumers to choose between gasoline and hydrated ethanol and immediately switch to whichever fuel presents the most favourable relative price.

An object-oriented neural network approach to short-term traffic forecasting

This paper discusses an object-oriented neural network model that was developed for predicting short-term traffic conditions on a section of the Pacific Highway between Brisbane and the Gold Coast in Queensland, Australia. The feasibility of this approach is demonstrated through a time-lag recurrent network (TLRN) which was developed for predicting speed data up to 15 minutes into the future. The results obtained indicate that the TLRN is capable of predicting speed up to 5 minutes into the future with a high degree of accuracy (90-94%). Similar models, which were developed for predicting freeway travel times on the same facility, were successful in predicting travel times up to 15 minutes into the future with a similar degree of accuracy (93-95%). These results represent substantial improvements on conventional model performance and clearly demonstrate the feasibility of using the object-oriented approach for short-term traffic prediction. (C) 2001 Elsevier Science B.V. All rights reserved.

Forecasting regional crop production using SOI phases: an example for the Australian peanut industry

Using peanuts as an example, a generic methodology is presented to forward-estimate regional crop production and associated climatic risks based on phases of the Southern Oscillation Index (SOI). Yield fluctuations caused by a highly variable rainfall environment are of concern to peanut processing and marketing bodies. The industry could profitably use forecasts of likely production to adjust their operations strategically. Significant, physically based lag-relationships exist between an index of ocean/atmosphere El Nino/Southern Oscillation phenomenon and future rainfall in Australia and elsewhere. Combining knowledge of SOI phases in November and December with output from a dynamic simulation model allows the derivation of yield probability distributions based on historic rainfall data. This information is available shortly after planting a crop and at least 3-5 months prior to harvest. The study shows that in years when the November-December SOI phase is positive there is an 80% chance of exceeding average district yields. Conversely, in years when the November-December SOI phase is either negative or rapidly falling there is only a 5% chance of exceeding average district yields, but a 95% chance of below average yields. This information allows the industry to adjust strategically for the expected volume of production. The study shows that simulation models can enhance SOI signals contained in rainfall distributions by discriminating between useful and damaging rainfall events. The methodology can be applied to other industries and regions.