Improving prediction interval quality : a genetic algorithm-based method applied to neural networks

The delta technique has been proposed in literature for constructing
prediction intervals for targets estimated by neural networks. Quality of constructed prediction intervals using this technique highly depends on neural network characteristics. Unfortunately, literature is void of information about how these dependences can be managed in order to optimize prediction intervals. This study attempts to optimize length and coverage probability of prediction intervals through modifying structure and parameters of the underlying neural networks. In an evolutionary optimization, genetic algorithm is applied for finding the optimal values of network size and training hyper-parameters. The applicability and efficiency of the proposed optimization technique is examined and demonstrated using a real case study. It is shown that application of the proposed optimization technique significantly improves quality of constructed prediction intervals in term of length and coverage probability.

Load forecasting and neural networks : a prediction interval-based perspective

Successfully determining competitive optimal schedules for electricity generation intimately hinges on the forecasts of loads. The nonstationarity and high volatility of loads make their accurate prediction somewhat problematic. Presence of uncertainty in data also significantly degrades accuracy of point predictions produced by deterministic load forecasting models. Therefore, operation planning utilizing these predictions will be unreliable. This paper aims at developing prediction intervals rather than producing exact point prediction. Prediction intervals are theatrically more reliable and practical than predicted values. The delta and Bayesian techniques for constructing prediction intervals for forecasted loads are implemented here. To objectively and comprehensively assess quality of constructed prediction intervals, a new index based on length and coverage probability of prediction intervals is developed. In experiments with real data, and through calculation of global statistics, it is shown that neural network point prediction performance is unreliable. In contrast, prediction intervals developed using the delta and Bayesian techniques are satisfactorily narrow, with a high coverage probability.

Prediction interval construction using interval type-2 fuzzy logic systems

This study proposes a novel non-parametric method for construction of prediction intervals (PIs) using interval type-2 Takagi-Sugeno-Kang fuzzy logic systems (IT2 TSK FLSs). The key idea in the proposed method is to treat the left and right end points of the type-reduced set as the lower and upper bounds of a PI. This allows us to construct PIs without making any special assumption about the data distribution. A new training algorithm is developed to satisfy conditions imposed by the associated confidence level on PIs. Proper adjustment of premise and consequent parameters of IT2 TSK FLSs is performed through the minimization of a PI-based objective function, rather than traditional error-based cost functions. This new cost function covers both validity and informativeness aspects of PIs. A metaheuristic method is applied for minimization of the non-linear non-differentiable cost function. Quantitative measures are applied for assessing the quality of PIs constructed using IT2 TSK FLSs. The demonstrated results for four benchmark case studies with homogenous and heterogeneous noise clearly show the proposed method is capable of generating high quality PIs useful for decision-making.

Combined nonparametric prediction intervals for wind power generation

Prediction intervals (PIs) are a promising tool for quantification of uncertainties associated with point forecasts of wind power. However, construction of PIs using parametric methods is questionable, as forecast errors do not follow a standard distribution. This paper proposes a nonparametric method for construction of reliable PIs for neural network (NN) forecasts. A lower upper bound estimation (LUBE) method is adapted for construction of PIs for wind power generation. A new framework is proposed for synthesizing PIs generated using an ensemble of NN models in the LUBE method. This is done to guard against NN performance instability in generating reliable and informative PIs. A validation set is applied for short listing NNs based on the quality of PIs. Then, PIs constructed using filtered NNs are aggregated to obtain combined PIs. Performance of the proposed method is examined using data sets taken from two wind farms in Australia. Simulation results indicate that the quality of combined PIs is significantly superior to the quality of PIs constructed using NN models ranked and filtered by the validation set.

Prediction interval-based neural network modelling of polystyrene polymerization reactor - a new perspective of data-based modelling

In this paper, prediction interval (PI)-based modelling techniques are introduced and applied to capture the nonlinear dynamics of a polystyrene batch reactor system. Traditional NN models are developed using experimental datasets with and without disturbances. Simulation results indicate that traditional NNs cannot properly handle disturbances in reactor data and demonstrate a poor forecasting performance, with an average MAPE of 22% in the presence of disturbances. The lower upper bound estimation (LUBE) method is applied for the construction of PIs to quantify uncertainties associated with forecasts. The simulated annealing optimization technique is employed to adjust NN parameters for minimization of an innovative PI-based cost function. The simulation results reveal that the LUBE method generates quality PIs without requiring prohibitive computations. As both calibration and sharpness of PIs are practically and theoretically satisfactory, the constructed PIs can be used as part of the decision-making and control process of polymerization reactors. © 2014 The Institution of Chemical Engineers.

Prediction interval-based modelling of polymerization reactor: a new modelling strategy for chemical reactors

Precise and reliable modelling of polymerization reactor is challenging due to its complex reaction mechanism and non-linear nature. Researchers often make several assumptions when deriving theories and developing models for polymerization reactor. Therefore, traditional available models suffer from high prediction error. In contrast, data-driven modelling techniques provide a powerful framework to describe the dynamic behaviour of polymerization reactor. However, the traditional NN prediction performance is significantly dropped in the presence of polymerization process disturbances. Besides, uncertainty effects caused by disturbances present in reactor operation can be properly quantified through construction of prediction intervals (PIs) for model outputs. In this study, we propose and apply a PI-based neural network (PI-NN) model for the free radical polymerization system. This strategy avoids assumptions made in traditional modelling techniques for polymerization reactor system. Lower upper bound estimation (LUBE) method is used to develop PI-NN model for uncertainty quantification. To further improve the quality of model, a new method is proposed for aggregation of upper and lower bounds of PIs obtained from individual PI-NN models. Simulation results reveal that combined PI-NN performance is superior to those individual PI-NN models in terms of PI quality. Besides, constructed PIs are able to properly quantify effects of uncertainties in reactor operation, where these can be later used as part of the control process. © 2014 Taiwan Institute of Chemical Engineers.

An interval type-2 fuzzy logic system-based method for prediction interval construction

This paper introduces a new non-parametric method for uncertainty quantification through construction of prediction intervals (PIs). The method takes the left and right end points of the type-reduced set of an interval type-2 fuzzy logic system (IT2FLS) model as the lower and upper bounds of a PI. No assumption is made in regard to the data distribution, behaviour, and patterns when developing intervals. A training method is proposed to link the confidence level (CL) concept of PIs to the intervals generated by IT2FLS models. The new PI-based training algorithm not only ensures that PIs constructed using IT2FLS models satisfy the CL requirements, but also reduces widths of PIs and generates practically informative PIs. Proper adjustment of parameters of IT2FLSs is performed through the minimization of a PI-based objective function. A metaheuristic method is applied for minimization of the non-linear non-differentiable cost function. Performance of the proposed method is examined for seven synthetic and real world benchmark case studies with homogenous and heterogeneous noise. The demonstrated results indicate that the proposed method is capable of generating high quality PIs. Comparative studies also show that the performance of the proposed method is equal to or better than traditional neural network-based methods for construction of PIs in more than 90% of cases. The superiority is more evident for the case of data with a heterogeneous noise. © 2014 Elsevier B.V.

Prediction interval estimation for electricity price and demand using support vector machines

Uncertainty is known to be a concomitant factor of almost all the real world commodities such as oil prices, stock prices, sales and demand of products. As a consequence, forecasting problems are becoming more and more challenging and ridden with uncertainty. Such uncertainties are generally quantified by statistical tools such as prediction intervals (Pis). Pis quantify the uncertainty related to forecasts by estimating the ranges of the targeted quantities. Pis generated by traditional neural network based approaches are limited by high computational burden and impractical assumptions about the distribution of the data. A novel technique for constructing high quality Pis using support vector machines (SVMs) is being proposed in this paper. The proposed technique directly estimates the upper and lower bounds of the PI in a short time and without any assumptions about the data distribution. The SVM parameters are tuned using particle swarm optimization technique by minimization of a modified Pi-based objective function. Electricity price and demand data of the Ontario electricity market is used to validate the performance of the proposed technique. Several case studies for different months indicate the superior performance of the proposed method in terms of high quality PI generation and shorter computational times.

Prediction interval estimation of electricity prices using PSO-tuned support vector machines

Uncertainty of the electricity prices makes the task of accurate forecasting quite difficult for the electricity market participants. Prediction intervals (PIs) are statistical tools which quantify the uncertainty related to forecasts by estimating the ranges of the future electricity prices. Traditional approaches based on neural networks (NNs) generate PIs at the cost of high computational burden and doubtful assumptions about data distributions. In this work, we propose a novel technique that is not plagued with the above limitations and it generates high-quality PIs in a short time. The proposed method directly generates the lower and upper bounds of the future electricity prices using support vector machines (SVM). Optimal model parameters are obtained by the minimization of a modified PI-based objective function using a particle swarm optimization (PSO) technique. The efficiency of the proposed method is illustrated using data from Ontario, Pennsylvania-New Jersey-Maryland (PJM) interconnection day-ahead and real-time markets.

Prediction interval-based modelling and control of nonlinear processes

 Novel computational intelligence-based methods have been investigated to quantify uncertainties prevalent in the operation of chemical plants. A new family of predication interval-based controlling algorithms is proposed and successfully applied to chemical reactors in order to minimise energy consumption and operational cost.

Prediction interval-based control of nonlinear systems using neural networks

Prediction interval (PI) is a promising tool for quantifying uncertainties associated with point predictions. Despite its informativeness, the design and deployment of PI-based controller for complex systems is very rare. As a pioneering work, this paper proposes a framework for design and implementation of PI-based controller (PIC) for nonlinear systems. Neural network (NN)-based inverse model within internal model control structure is used to develop the PIC. Firstly, a PI-based model is developed to construct PIs for the system output. This model is then used as an online estimator for PIs. The PIs from this model are fed to the NN inverse model along with other traditional inputs to generate the control signal. The performance of the proposed PIC is examined for two case studies. This includes a nonlinear batch polymerization reactor and a numerical nonlinear plant. Simulation results demonstrated that the proposed PIC tracking performance is better than the traditional NN-based controller.

Prediction interval-based neural network controller for nonlinear processes

Prediction interval (PI) has been extensively used to predict the forecasts for nonlinear systems as PI-based forecast is superior over point-forecast to quantify the uncertainties and disturbances associated with the real processes. In addition, PIs bear more information than point-forecasts, such as forecast accuracy. The aim of this paper is to integrate the concept of informative PIs in the control applications to improve the tracking performance of the nonlinear controllers. In the present work, a PI-based controller (PIC) is proposed to control the nonlinear processes. Neural network (NN) inverse model is used as a controller in the proposed method. Firstly, a PI-based model is developed to construct PIs for every sample or time instance. The PIs are then fed to the NN inverse model along with other effective process inputs and outputs. The PI-based NN inverse model predicts the plant input to get the desired plant output. The performance of the proposed PIC controller is examined for a nonlinear process. Simulation results indicate that the tracking performance of the PIC is highly acceptable and better than the traditional NN inverse model-based controller.