Improving load forecast accuracy by clustering consumers using smart meter data

Utility companies provide electricity to a large number of consumers. These companies need to have an accurate forecast of the next day electricity demand. Any forecast errors will result in either reliability issues or increased costs for the company. Because of the widespread roll-out of smart meters, a large amount of high resolution consumption data is now accessible which was not available in the past. This new data can be used to improve the load forecast and as a result increase the reliability and decrease the expenses of electricity providers. In this paper, a number of methods for improving load forecast using smart meter data are discussed. In these methods, consumers are first divided into a number of clusters. Then a neural network is trained for each cluster and forecasts of these networks are added together in order to form the prediction for the aggregated load. In this paper, it is demonstrated that clustering increases the forecast accuracy significantly. Criteria used for grouping consumers play an important role in this process. In this work, three different feature selection methods for clustering consumers are explained and the effect of feature extraction methods on forecast error is investigated.

A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings

Electrical load forecasting plays a vital role in order to achieve the concept of next generation power system such as smart grid, efficient energy management and better power system planning. As a result, high forecast accuracy is required for multiple time horizons that are associated with regulation, dispatching, scheduling and unit commitment of power grid. Artificial Intelligence (AI) based techniques are being developed and deployed worldwide in on Varity of applications, because of its superior capability to handle the complex input and output relationship. This paper provides the comprehensive and systematic literature review of Artificial Intelligence based short term load forecasting techniques. The major objective of this study is to review, identify, evaluate and analyze the performance of Artificial Intelligence (AI) based load forecast models and research gaps. The accuracy of ANN based forecast model is found to be dependent on number of parameters such as forecast model architecture, input combination, activation functions and training algorithm of the network and other exogenous variables affecting on forecast model inputs. Published literature presented in this paper show the potential of AI techniques for effective load forecasting in order to achieve the concept of smart grid and buildings.

Improving the quality of load forecasts using smart meter data

For the operator of a power system, having an accurate forecast of the day-ahead load is imperative in order to guaranty the reliability of supply and also to minimize generation costs and pollution. Furthermore, in a restructured power system, other parties, like utility companies, large consumers and in some cases even ordinary consumers, can benefit from a higher quality demand forecast. In this paper, the application of smart meter data for producing more accurate load forecasts has been discussed. First an ordinary neural network model is used to generate a forecast for the total load of a number of consumers. The results of this step are used as a benchmark for comparison with the forecast results of a more sophisticated method. In this new method, using wavelet decomposition and a clustering technique called interactive k-means, the consumers are divided into a number of clusters. Then for each cluster an individual neural network is trained. Consequently, by adding the outputs of all of the neural networks, a forecast for the total load is generated. A comparison between the forecast using a single model and the forecast generated by the proposed method, proves that smart meter data can be used to significantly improve the quality of load forecast.

A computational framework for uncertainty integration in stochastic unit commitment with intermittent renewable energy sources

The penetration of intermittent renewable energy sources (IRESs) into power grids has increased in the last decade. Integration of wind farms and solar systems as the major IRESs have significantly boosted the level of uncertainty in operation of power systems. This paper proposes a comprehensive computational framework for quantification and integration of uncertainties in distributed power systems (DPSs) with IRESs. Different sources of uncertainties in DPSs such as electrical load, wind and solar power forecasts and generator outages are covered by the proposed framework. Load forecast uncertainty is assumed to follow a normal distribution. Wind and solar forecast are implemented by a list of prediction intervals (PIs) ranging from 5% to 95%. Their uncertainties are further represented as scenarios using a scenario generation method. Generator outage uncertainty is modeled as discrete scenarios. The integrated uncertainties are further incorporated into a stochastic security-constrained unit commitment (SCUC) problem and a heuristic genetic algorithm is utilized to solve this stochastic SCUC problem. To demonstrate the effectiveness of the proposed method, five deterministic and four stochastic case studies are implemented. Generation costs as well as different reserve strategies are discussed from the perspectives of system economics and reliability. Comparative results indicate that the planned generation costs and reserves are different from the realized ones. The stochastic models show better robustness than deterministic ones. Power systems run a higher level of risk during peak load hours.

Short term load forecasting using a hybrid neural network

Short Term Load Forecasting (STLF) is very important from the power systems grid operation point of view. STLF involves forecasting load demand in a short term time frame. The short term time frame may consist of half hourly prediction up to weekly prediction. Accurate forecasting would benefit the utility in terms of reliability and stability of the grid ensuring adequate supply is present to meet with the load demand. Apart from that it would also affect the financial performance of the utility company. An accurate forecast would result in better savings while maintaining the security of the grid. This paper outlines the STLF using a novel hybrid online learning neural network, known as the Gaussian Regression (GR). This new hybrid neural network is a combination of two existing online learning neural networks which are the Gaussian Adaptive Resonance Theory (GA) and the Generalized Regression Neural Network (GRNN). Both GA and GRNN implemented online learning, but each of them suffers from limitation. Originally GA is used for unsupervised clustering by compressing the training samples into several categories. A supervised version of GA is available, namely Gaussian ARTMAP (GAM). However, the GAM is still not capable on solving regression problem. On the other hand, GRNN is designed for solving real value estimation (regression) problem, but the learning process would involve of memorizing all training samples, hence high computational cost. The hybrid GR is considered an enhanced version of GRNN with compression ability while still maintains online learning properties. Simulation results show that GR has comparable prediction accuracy and has less prototype as compared to the original GRNN as well as the Support Vector Regression.

Improving load forecasting accuracy through combination of best forecasts

Neural network (NN) models have been widely used in the literature for short-term load forecasting. Their popularity is mainly due to their excellent learning and approximation capability. However, their forecasting performance significantly depends on several factors including initializing parameters, training algorithm, and NN structure. To minimize negative effects of these factors, this paper proposes a practically simple, yet effective and an efficient method to combine forecasts generated by NN models. The proposed method includes three main phases: (i) training NNs with different structures, (ii) selecting best NN models based on their forecasting performance for a validation set, and (iii) combination of forecasts for selected best NNs. Forecast combination is performed through calculating the mean of forecasts generated by best NN models. The performance of the proposed method is examined using real world data set. Comparative studies demonstrate that the accuracy of combined forecasts is significantly superior to those obtained from individual NN models.

Bayesian model averaging of load demand forecasts from neural network models

Creating a set of a number of neural network (NN) models in an ensemble and accumulating them can achieve better overview capability as compared to single neural network. Neural network ensembles are designed to provide solutions to particular problems. Many researchers and academicians have adopted this NN ensemble technique, especially in machine learning, and has been applied in various fields of engineering, medicine and information technology. This paper present a robust aggregation methodology for load demand forecasting based on Bayesian Model Averaging of a set of neural network models in an ensemble. This paper estimate a vector of coefficient for individual NN models' forecasts using validation data-set. These coefficients, also known as weights, are equal to posterior probabilities of the models generating the forecasts. These BMA weights are then used in combining forecasts generated from NN models with test data-set. By comparing the Bayesian results with the Simple Averaging method, it was observed that benefits are obtained by utilizing an advanced method like BMA for forecast combinations.

A systematic design of interval type-2 fuzzy logic system using extreme learning machine for electricity load demand forecasting

This paper presents a novel design of interval type-2 fuzzy logic systems (IT2FLS) by utilizing the theory of extreme learning machine (ELM) for electricity load demand forecasting. ELM has become a popular learning algorithm for single hidden layer feed-forward neural networks (SLFN). From the functional equivalence between the SLFN and fuzzy inference system, a hybrid of fuzzy-ELM has gained attention of the researchers. This paper extends the concept of fuzzy-ELM to an IT2FLS based on ELM (IT2FELM). In the proposed design the antecedent membership function parameters of the IT2FLS are generated randomly, whereas the consequent part parameters are determined analytically by the Moore-Penrose pseudo inverse. The ELM strategy ensures fast learning of the IT2FLS as well as optimality of the parameters. Effectiveness of the proposed design of IT2FLS is demonstrated with the application of forecasting nonlinear and chaotic data sets. Nonlinear data of electricity load from the Australian National Electricity Market for the Victoria region and from the Ontario Electricity Market are considered here. The proposed model is also applied to forecast Mackey-glass chaotic time series data. Comparative analysis of the proposed model is conducted with some traditional models such as neural networks (NN) and adaptive neuro fuzzy inference system (ANFIS). In order to verify the structure of the proposed design of IT2FLS an alternate design of IT2FLS based on Kalman filter (KF) is also utilized for the comparison purposes.

A hybrid metaheuritic technique developed for hourly load forecasting

Electricity load forecasting has become one of the most functioning tools in energy efficiency and load management and utility companies which has been made very complex due to deregulation. Due to the importance of providing a secure and economic electricty for the consumers, having a reliable and robust enough forecast engine in short-term load management is very needful. Fuzzy inference system is one of primal branches of Artificial Intelligence techniques which has been widely used for different applications of decision making in complex systems. This paper aims to develop a Fuzzy inference system as a main forecast engine for Short term Load Forecasting (STLF) of a city in Iran. However, the optimization of this platform for this special case remains a basic problem. Hence, to address this issue, the Radial Movement Optimization (RMO) technique is proposed to optimize the whole Fuzzy platform. To support this idea, the accuracy of the proposed model is analyzed using MAPE index and an average error of 1.38% is obtained for the forecast load demand which represents the reliability of the proposed method. Finally, results achieved by this method, demonstrate that an adaptive two-stage hybrid system consisting of Fuzzy & RMO can be an accurate and robust enough choice for STLF problems.

Multi-temporal land use mapping using remotely sensed techniques and the integration of a pollutant load model in a GIS

Estimation of nutrient load production based on multi-temporal remotely sensed land-use data for the Glenelg-Hopkins region in southwest Victoria, Australia, is discussed. Changes in land use were mapped using archived Landsat data and computerized classification techniques. Land-use
change is unparalleled in recent history, with 13% of the region transformed in the last decade. Total nitrogen and phosphorus loading were estimated using an export coefficient model. The analysis demonstrated a disturbing increase in nitrogen and phosphorus loadings from 1995 to 2002. Whilst such increases were suspected from past anecdotal and ad-hoc evidence, our modelling quantitatively estimated such increases and thus demonstrated the enormous potential of using remote sensing and GIS for monitoring land-use change and hence improve land-use management.

A load balancing algorithm for web based server grids

Load balance is a critical issue in distributed systems, such as server grids. In this paper, we propose a Balanced Load Queue (BLQ) model, which combines the queuing theory and hydro-dynamic theory, to model load balance in server grids. Base on the BLQ model, we claim that if the system is in the state of global fairness, then the performance of the whole system is the best. We propose a load balanced algorithm based on the model: the algorithm tries its best to keep the system in the global fairness status using job deviation. We present three strategies: best node, best neighbour, and random selection, for job deviation. A number of experiments are conducted for the comparison of the three strategies, and the results show that the best neighbour strategy is the best among the proposed strategies. Furthermore, the proposed algorithm with best neighbour strategy is better than the traditional round robin algorithm in term of processing delay, and the proposed algorithm needs very limited system information and is robust.

An MPI implementation supported by process migration and load balancing

This report describes an implementation of MPI-1 on the GENESIS cluster operating system and compares this implementation to a UNIX based MPI implementation. The changes that were made to the implementation are compared between the two, and the advantages of porting to GENESIS are detailed. This report demonstrates how GENESIS load balancing supported by process migration improves the execution performance of an MPI application. The significance of this report is in demonstrating how these services can enhance parallel programming tools to improve performance and how future parallel programming tool design could take advantage of these services.

Load balance algorithms for anycast

Increasingly, replicated anycast servers are being used to deliver network applications and service ever increasing user requests. Therefore, the strategies used to guarantee network bandwidth prerequisites and perform load balancing across the nodes of an anycast group are critical to the performance of online applications. In this paper, we model user requests, network congestion and latency, and server load using a combination of hydro-dynamics and queuing theory to develop an efficient job distribution strategy. Current, anycast research does not explicitly consider the system load of nodes within an anycast groups when distributing requests. Therefore, the performance of a heavily loaded anycast system can quickly become congested and uneven as jobs are routed to closely linked nodes which are already saturated with requests. In comparison, the nodes of further away systems remain relatively unused because of other issues such as network bandwidth and latency during these times. Our system redirects requests from busy systems to the idle, remotely linked nodes, to process requests faster in spite of slower network access. Using an empirical study, we show this technique can improve request performance, and throughput with minimal network probing overhead.

Adaptive load shedding for mining frequent patterns from data streams

Most algorithms that focus on discovering frequent patterns from data streams assumed that the machinery is capable of managing all the incoming transactions without any delay; or without the need to drop transactions. However, this assumption is often impractical due to the inherent characteristics of data stream environments. Especially under high load conditions, there is often a shortage of system resources to process the incoming transactions. This causes unwanted latencies that in turn, affects the applicability of the data mining models produced – which often has a small window of opportunity. We propose a load shedding algorithm to address this issue. The algorithm adaptively detects overload situations and drops transactions from data streams using a probabilistic model. We tested our algorithm on both synthetic and real-life datasets to verify the feasibility of our algorithm.