Transfer learning using the online Fuzzy Min-Max neural network

In this paper, we present an empirical analysis on transfer learning using the Fuzzy Min–Max (FMM) neural network with an online learning strategy. Three transfer learning benchmark data sets, i.e., 20 Newsgroups, WiFi Time, and Botswana, are used for evaluation. In addition, the data samples are corrupted with white Gaussian noise up to 50 %, in order to assess the robustness of the online FMM network in handling noisy transfer learning tasks. The results are analyzed and compared with those from other methods. The outcomes indicate that the online FMM network is effective for undertaking transfer learning tasks in noisy environments.

Short-term load and wind power forecasting using neural network-based prediction intervals

Electrical power systems are evolving from today's centralized bulk systems to more decentralized systems. Penetrations of renewable energies, such as wind and solar power, significantly increase the level of uncertainty in power systems. Accurate load forecasting becomes more complex, yet more important for management of power systems. Traditional methods for generating point forecasts of load demands cannot properly handle uncertainties in system operations. To quantify potential uncertainties associated with forecasts, this paper implements a neural network (NN)-based method for the construction of prediction intervals (PIs). A newly introduced method, called lower upper bound estimation (LUBE), is applied and extended to develop PIs using NN models. A new problem formulation is proposed, which translates the primary multiobjective problem into a constrained single-objective problem. Compared with the cost function, this new formulation is closer to the primary problem and has fewer parameters. Particle swarm optimization (PSO) integrated with the mutation operator is used to solve the problem. Electrical demands from Singapore and New South Wales (Australia), as well as wind power generation from Capital Wind Farm, are used to validate the PSO-based LUBE method. Comparative results show that the proposed method can construct higher quality PIs for load and wind power generation forecasts in a short time.

Construction of neural network-based prediction intervals for short-term electrical load forecasting

Short-term load forecasting (STLF) is of great importance for control and scheduling of electrical power systems. The uncertainty of power systems increases due to the random nature of climate and the penetration of the renewable energies such as wind and solar power. Traditional methods for generating point forecasts of load demands cannot properly handle uncertainties in datasets. To quantify these potential uncertainties associated with forecasts, this paper implements a neural network (NN)-based method for construction of prediction intervals (PIs). A newly proposed method, called lower upper bound estimation (LUBE), is applied to develop PIs using NN models. The primary multi-objective problem is firstly transformed into a constrained single-objective problem. This new problem formulation is closer to the original problem and has fewer parameters than the cost function. Particle swarm optimization (PSO) integrated with the mutation operator is used to solve the problem. Two case studies from Singapore and New South Wales (Australia) historical load datasets are used to validate the PSO-based LUBE method. Demonstrated results show that the proposed method can construct high quality PIs for load forecasting applications.

An accelerated particle swarm optimization based levenberg marquardt back propagation algorithm

The Levenberg Marquardt (LM) algorithm is one of the most effective algorithms in speeding up the convergence rate of the Artificial Neural Networks (ANN) with Multilayer Perceptron (MLP) architectures. However, the LM algorithm suffers the problem of local minimum entrapment. Therefore, we introduce several improvements to the Levenberg Marquardt algorithm by training the ANNs with meta-heuristic nature inspired algorithm. This paper proposes a hybrid technique Accelerated Particle Swarm Optimization using Levenberg Marquardt (APSO_LM) to achieve faster convergence rate and to avoid local minima problem. These techniques are chosen since they provide faster training for solving pattern recognition problems using the numerical optimization technique.The performances of the proposed algorithm is evaluated using some bench mark of classification’s datasets. The results are compared with Artificial Bee Colony (ABC) Algorithm using Back Propagation Neural Network (BPNN) algorithm and other hybrid variants. Based on the experimental result, the proposed algorithms APSO_LM successfully demonstrated better performance as compared to other existing algorithms in terms of convergence speed and Mean Squared Error (MSE) by introducing the error and accuracy in network convergence.

Patient admission prediction using a pruned fuzzy min–max neural network with rule extraction

A useful patient admission prediction model that helps the emergency department of a hospital admit patients efficiently is of great importance. It not only improves the care quality provided by the emergency department but also reduces waiting time of patients. This paper proposes an automatic prediction method for patient admission based on a fuzzy min–max neural network (FMM) with rules extraction. The FMM neural network forms a set of hyperboxes by learning through data samples, and the learned knowledge is used for prediction. In addition to providing predictions, decision rules are extracted from the FMM hyperboxes to provide an explanation for each prediction. In order to simplify the structure of FMM and the decision rules, an optimization method that simultaneously maximizes prediction accuracy and minimizes the number of FMM hyperboxes is proposed. Specifically, a genetic algorithm is formulated to find the optimal configuration of the decision rules. The experimental results using a large data set consisting of 450740 real patient records reveal that the proposed method achieves comparable or even better prediction accuracy than state-of-the-art classifiers with the additional ability to extract a set of explanatory rules to justify its predictions.

Prediction interval-based neural network modelling of polystyrene polymerization reactor - a new perspective of data-based modelling

In this paper, prediction interval (PI)-based modelling techniques are introduced and applied to capture the nonlinear dynamics of a polystyrene batch reactor system. Traditional NN models are developed using experimental datasets with and without disturbances. Simulation results indicate that traditional NNs cannot properly handle disturbances in reactor data and demonstrate a poor forecasting performance, with an average MAPE of 22% in the presence of disturbances. The lower upper bound estimation (LUBE) method is applied for the construction of PIs to quantify uncertainties associated with forecasts. The simulated annealing optimization technique is employed to adjust NN parameters for minimization of an innovative PI-based cost function. The simulation results reveal that the LUBE method generates quality PIs without requiring prohibitive computations. As both calibration and sharpness of PIs are practically and theoretically satisfactory, the constructed PIs can be used as part of the decision-making and control process of polymerization reactors. © 2014 The Institution of Chemical Engineers.

Uncertainty handling using neural network-based prediction intervals for electrical load forecasting

The complexity and level of uncertainty present in operation of power systems have significantly grown due to penetration of renewable resources. These complexities warrant the need for advanced methods for load forecasting and quantifying uncertainties associated with forecasts. The objective of this study is to develop a framework for probabilistic forecasting of electricity load demands. The proposed probabilistic framework allows the analyst to construct PIs (prediction intervals) for uncertainty quantification. A newly introduced method, called LUBE (lower upper bound estimation), is applied and extended to develop PIs using NN (neural network) models. The primary problem for construction of intervals is firstly formulated as a constrained single-objective problem. The sharpness of PIs is treated as the key objective and their calibration is considered as the constraint. PSO (particle swarm optimization) enhanced by the mutation operator is then used to optimally tune NN parameters subject to constraints set on the quality of PIs. Historical load datasets from Singapore, Ottawa (Canada) and Texas (USA) are used to examine performance of the proposed PSO-based LUBE method. According to obtained results, the proposed probabilistic forecasting method generates well-calibrated and informative PIs. Furthermore, comparative results demonstrate that the proposed PI construction method greatly outperforms three widely used benchmark methods. © 2014 Elsevier Ltd.

An online transfer learning RBF neural network for cross domain data classification

In this paper, a Radial Basis Function Network (RBFN) trained with the Dynamic Decay Adjustment (DDA) algorithm (i.e., RBFNDDA) is deployed as an incremental learning model for tackling transfer learning problems. An online learning strategy is exploited to allow the RBFNDDA model to transfer knowledge from one domain and applied to classification tasks in a different yet related domain. An experimental study is carried out to evaluate the effectiveness of the online RBFNDDA model using a benchmark data set obtained from a public domain. The results are analyzed and compared with those from other methods. The outcomes positively reveal the potentials of the online RBFNDDA model in handling transfer learning tasks. © 2014 The authors and IOS Press. All rights reserved.

Application of neural network to rock slope stability assessments

It is known that rock masses are inhomogeneous, discontinuous media composed of rock material and naturally occurring discontinuities such as joints, fractures and bedding planes. These features make any analysis very difficult using simple theoretical solutions. Generally speaking, back analysis technique can be used to capture some implicit parameters for geotechnical problems. In order to perform back analyses, the procedure of trial and error is generally required. However, it would be time-consuming. This study aims at applying a neural network to do the back analysis for rock slope failures. The neural network tool will be trained by using the solutions of finite element upper and lower bound limit analysis methods. Therefore, the uncertain parameter can be obtained, particularly for rock mass disturbance.

An enhanced fuzzy min-max neural network for pattern classification

An enhanced fuzzy min-max (EFMM) network is proposed for pattern classification in this paper. The aim is to overcome a number of limitations of the original fuzzy min-max (FMM) network and improve its classification performance. The key contributions are three heuristic rules to enhance the learning algorithm of FMM. First, a new hyperbox expansion rule to eliminate the overlapping problem during the hyperbox expansion process is suggested. Second, the existing hyperbox overlap test rule is extended to discover other possible overlapping cases. Third, a new hyperbox contraction rule to resolve possible overlapping cases is provided. Efficacy of EFMM is evaluated using benchmark data sets and a real medical diagnosis task. The results are better than those from various FMM-based models, support vector machine-based, Bayesian-based, decision tree-based, fuzzy-based, and neural-based classifiers. The empirical findings show that the newly introduced rules are able to realize EFMM as a useful model for undertaking pattern classification problems.