An adaptive fuzzy min-max conflict-resolving classifier

This paper describes a novel adaptive network, which agglomerates a procedure based on the fuzzy min-max clustering method, a supervised ART (Adaptive Resonance Theory) neural network, and a constructive conflict-resolving algorithm, for pattern classification. The proposed classifier is a fusion of the ordering algorithm, Fuzzy ARTMAP (FAM) and the Dynamic Decay Adjustment (DDA) algorithm. The network, called Ordered FAMDDA, inherits the benefits of the trio, viz . an ability to identify a fixed order of training pattern presentation for good generalisation; stable and incrementally learning architecture; and dynamic width adjustment of the weights of hidden nodes of conflicting classes. Classification performance of the Ordered FAMDDA is assessed using two benchmark datasets. The performances are analysed and compared with those from FAM and Ordered FAM. The results indicate that the Ordered FAMDDA classifier performs at least as good as the mentioned networks. The proposed Ordered FAMDDA network is then applied to a condition monitoring problem in a power generation station. The process under scrutiny is the Circulating Water (CW) system, with prime attention to condition monitoring of the heat transfer efficiency of the condensers. The results and their implications are analysed and discussed.

Evolving an adaptive artificial neural network with a gravitational search algorithm

In this paper, a supervised fuzzy adaptive resonance theory neural network, i.e., Fuzzy ARTMAP (FAM), is integrated with a heuristic Gravitational Search Algorithm (GSA) that is inspired from the laws of Newtonian gravity. The proposed FAM-GSA model combines the unique features of both constituents to perform data classification. The classification performance of FAM-GSA is benchmarked against other state-of-art machine learning classifiers using an artificially generated data set and two real data sets from different domains. Comparatively, the empirical results indicate that FAM-GSA generally is able to achieve a better classification performance with a parsimonious network size, but with the expense of a higher computational load.

An active stereo vision-based learning approach for robotic tracking, fixating and grasping control

In this paper, an active stereo vision-based learning approach is proposed for a robot to track, fixate and grasp an object in unknown environments. First, the functional mapping relationships between the joint angles of the active stereo vision system and the spatial representations of the object are derived and expressed in a three-dimensional workspace frame. Next, the self-adaptive resonance theory-based neural networks and the feedforward neural networks are used to learn the mapping relationships in a self-organized way. Then, the approach is verified by simulation using the models of an active stereo vision system which is installed in the end-effector of a robot. Finally, the simulation results confirm the effectiveness of the present approach.

A microscopic competition model and its dynamics analysis on network attacks

Modeling network traffic has been a critical task in the development of Internet. Attacks and defense are prevalent in the current Internet. Traditional network models such as Poisson-related models do not consider the competition behaviors between the attack and defense parties. In this paper, we present a microscopic competition model to analyze the dynamics among the nodes, benign or malicious, connected to a router, which compete for the bandwidth. The dynamics analysis demonstrates that the model can well describe the competition behavior among normal users and attackers. Based on this model, an anomaly attack detection method is presented. The method is based on the adaptive resonance theory, which is used to learn the model by normal traffic data. The evaluation shows that it can effectively detect the network attacks.

A hybrid ART-GRNN online learning neural network with a ε-insensitive loss function

In this brief, a new neural network model called generalized adaptive resonance theory (GART) is introduced. GART is a hybrid model that comprises a modified Gaussian adaptive resonance theory (MGA) and the generalized regression neural network (GRNN). It is an enhanced version of the GRNN, which preserves the online learning properties of adaptive resonance theory (ART). A series of empirical studies to assess the effectiveness of GART in classification, regression, and time series prediction tasks is conducted. The results demonstrate that GART is able to produce good performances as compared with those of other methods, including the online sequential extreme learning machine (OSELM) and sequential learning radial basis function (RBF) neural network models.

A hybrid neural network classifier combining ordered fuzzy ARTMAP and the dynamic decay adjustment algorithm

This paper presents a novel conflict-resolving neural network classifier that combines the ordering algorithm, fuzzy ARTMAP (FAM), and the dynamic decay adjustment (DDA) algorithm, into a unified framework. The hybrid classifier, known as Ordered FAMDDA, applies the DDA algorithm to overcome the limitations of FAM and ordered FAM in achieving a good generalization/performance. Prior to network learning, the ordering algorithm is first used to identify a fixed order of training patterns. The main aim is to reduce and/or avoid the formation of overlapping prototypes of different classes in FAM during learning. However, the effectiveness of the ordering algorithm in resolving overlapping prototypes of different classes is compromised when dealing with complex datasets. Ordered FAMDDA not only is able to determine a fixed order of training patterns for yielding good generalization, but also is able to reduce/resolve overlapping regions of different classes in the feature space for minimizing misclassification during the network learning phase. To illustrate the effectiveness of Ordered FAMDDA, a total of ten benchmark datasets are experimented. The results are analyzed and compared with those from FAM and Ordered FAM. The outcomes demonstrate that Ordered FAMDDA, in general, outperforms FAM and Ordered FAM in tackling pattern classification problems.

A hybrid neural network model for noisy data regression

A hybrid neural network model, based on the fusion of fuzzy adaptive resonance theory (FA ART) and the general regression neural network (GRNN), is proposed in this paper. Both FA and the GRNN are incremental learning systems and are very fast in network training. The proposed hybrid model, denoted as GRNNFA, is able to retain these advantages and, at the same time, to reduce the computational requirements in calculating and storing information of the kernels. A clustering version of the GRNN is designed with data compression by FA for noise removal. An adaptive gradient-based kernel width optimization algorithm has also been devised. Convergence of the gradient descent algorithm can be accelerated by the geometric incremental growth of the updating factor. A series of experiments with four benchmark datasets have been conducted to assess and compare effectiveness of GRNNFA with other approaches. The GRNNFA model is also employed in a novel application task for predicting the evacuation time of patrons at typical karaoke centers in Hong Kong in the event of fire. The results positively demonstrate the applicability of GRNNFA in noisy data regression problems.

Robust modular artmap for multi-class shape recognition

This paper presents a fuzzy ARTMAP (FAM) based modular architecture for multi-class pattern recognition known as modular adaptive resonance theory map (MARTMAP). The prediction of class membership is made collectively by combining outputs from multiple novelty detectors. Distance-based familiarity discrimination is introduced to improve the robustness of MARTMAP in the presence of noise. The effectiveness of the proposed architecture is analyzed and compared with ARTMAP-FD network, FAM network, and One-Against-One Support Vector Machine (OAO-SVM). Experimental results show that MARTMAP is able to retain effective familiarity discrimination in noisy environment, and yet less sensitive to class imbalance problem as compared to its counterparts.

Short term load forecasting using a hybrid neural network

Short Term Load Forecasting (STLF) is very important from the power systems grid operation point of view. STLF involves forecasting load demand in a short term time frame. The short term time frame may consist of half hourly prediction up to weekly prediction. Accurate forecasting would benefit the utility in terms of reliability and stability of the grid ensuring adequate supply is present to meet with the load demand. Apart from that it would also affect the financial performance of the utility company. An accurate forecast would result in better savings while maintaining the security of the grid. This paper outlines the STLF using a novel hybrid online learning neural network, known as the Gaussian Regression (GR). This new hybrid neural network is a combination of two existing online learning neural networks which are the Gaussian Adaptive Resonance Theory (GA) and the Generalized Regression Neural Network (GRNN). Both GA and GRNN implemented online learning, but each of them suffers from limitation. Originally GA is used for unsupervised clustering by compressing the training samples into several categories. A supervised version of GA is available, namely Gaussian ARTMAP (GAM). However, the GAM is still not capable on solving regression problem. On the other hand, GRNN is designed for solving real value estimation (regression) problem, but the learning process would involve of memorizing all training samples, hence high computational cost. The hybrid GR is considered an enhanced version of GRNN with compression ability while still maintains online learning properties. Simulation results show that GR has comparable prediction accuracy and has less prototype as compared to the original GRNN as well as the Support Vector Regression.

An experimental study of original and ordered fuzzy ARTMAP neural networks in pattern classification tasks

This paper investigates the effectiveness of an ordering algorithm applied to the supervised Fuzzy ARTMAP (FAM) neural network in pattern classification tasks. Before presenting the input patterns to the FAM network (known as ordered FAM), a fixed order of input patterns is first identified using the ordering algorithm. An experimental study is conducted to compare the results from ordered FAM with the average and voting results from original FAM. In the study, a pool of the original FAM networks is trained using different sequences of input patterns, and the results are averaged. Outputs from various original FAM networks can also be combined using a majority voting strategy to reach a final result. A database comprising various symptoms and measurements of patients suffering from heart attack is used to evaluate the various schemes of the FAM network in medical pattern classification tasks. The results are compared, analyzed, and discussed.