Evaluation of the fuzzy ARTMAP neural network using off-line and on-line learning strategies

This paper describes an experimental study of the Fuzzy ARTMAP (FAM) neural network as an autonomous learning system for pattern classification tasks. A benchmark database of radar signals from ionosphere has been employed for the system to classify arbitrary sequences of pattern into distinct categories. A number of simulations have been conducted systematically to evaluate the applicability and usefulness of FAM in this context. First, we identify the 'optimum' parameter settings of FAM for the problem at hand, and investigate the effects of different training schemes and learning rules on classification results, using an off-line learning methodology. We then examine a voting strategy to improve classification accuracy by combining results from multiple FAM classifiers. In addition to off-line learning, we evaluate the prospect of using FAM as an autonomously learning pattern classification system for on-line, non-stationary environments. The performance of FAM is comparable with other reported results, but with the added advantage of on-line and incremental learning.

Feature extraction and classification of metal detector signals using the wavelet transform and the fuzzy ARTMAP neural network

In this paper, the Fuzzy ARTMAP (FAM) neural network is used to classify metal detector signals into different categories for automated target discrimination. Feature extraction of the metal detector signals is conducted using a wavelet transform technique. The FAM neural network is then employed to classify the extracted features into different target groups. A series of experiments using individual FAM networks and a voting FAM network is conducted. Promising classification accuracy rates are obtained from using individual and voting FAM networks, respectively. The experimental outcomes positively demonstrate the effectiveness of the generated features, and of the FAM network in classifying metal detector signals for automated target discrimination tasks.

A new neural network-based type reduction algorithm for interval type-2 fuzzy logic systems

This paper introduces a new type reduction (TR) algorithm for interval type-2 fuzzy logic systems (IT2 FLSs). Flexibility and adaptiveness are the key features of the proposed non-parametric algorithm. Lower and upper firing strengths of rules as well as their consequent coefficients are fed into a neural network (NN). NN output is a crisp value that corresponds to the defuzzified output of IT2 FLSs. The NN type reducer is trained through minimization of an error-based cost function with the purpose of improving modelling and forecasting performance of IT2 FLS models. Simulation results indicate that application of the proposed TR algorithm greatly enhances modelling and forecasting performance of IT2 FLS models. This benefit is achieved in no cost, as the computational requirement of the proposed algorithm is less than or at most equivalent to traditional TR algorithms.

Neural network and interval type-2 fuzzy system for stock price forecasting

Stock price forecast has long been received special attention of investors and financial institutions. As stock prices are changeable over time and increasingly uncertain in modern financial markets, their forecasting becomes more important than ever before. A hybrid approach consisting of two components, a neural network and a fuzzy logic system, is proposed in this paper for stock price prediction. The first component of the hybrid, i.e. a feedforward neural network (FFNN), is used to select inputs that are highly relevant to the dependent variables. An interval type-2 fuzzy logic system (IT2 FLS) is employed as the second component of the hybrid forecasting method. The IT2 FLS’s parameters are initialized through deployment of the k-means clustering method and they are adjusted by the genetic algorithm. Experimental results demonstrate the efficiency of the FFNN input selection approach as it reduces the complexity and increase the accuracy of the forecasting models. In addition, IT2 FLS outperforms the widely used type-1 FLS and FFNN models in stock price forecasting. The combination of the FFNN and the IT2 FLS produces dominant forecasting accuracy compared to employing only the IT2 FLSs without the FFNN input selection.

Categorical Missing Data Imputation Using Fuzzy Neural Networks with Numerical and Categorical Inputs

There are many situations where input feature vectors are incomplete and methods to tackle the problem have been studied for a long time. A commonly used procedure is to replace each missing value with an imputation. This paper presents a method to perform categorical missing data imputation from numerical and categorical variables. The imputations are based on Simpson’s fuzzy min-max neural networks where the input variables for learning and classification are just numerical. The proposed method extends the input to categorical variables by introducing new fuzzy sets, a new operation and a new architecture. The procedure is tested and compared with others using opinion poll data.

A mutation-based evolving neural network model and its application to condition monitoring

Data analysis using intelligent systems is a key solution to many industrial problems. In this paper, a mutation-based evolving artificial neural network, which is based on an integration of the Fuzzy ARTMAP (FAM) neural network and evolutionary programming (EP), is proposed. The proposed FAMEP model is applied to detect and classify possible faults from a number of sensory signals of a circulating water system in a power generation plant. The efficiency of FAM-EP is assessed and compared with that of the original FAM network in terms of classification accuracy as well as network complexity. In addition, the bootstrap method is used to quantify the performance statistically. The results positively demonstrate the usefulness of FAM-EP in tackling data classification problems.

Application of an adaptive neural network with symbolic rule extraction to fault detection and diagnosis in a power generation plant

Artificial neural networks have a good potential to be employed for fault diagnosis and condition monitoring problems in complex processes. In this paper, the applicability of the fuzzy ARTMAP (FAM) neural network as an intelligent learning system for fault detection and diagnosis in a power generation plant is described. The process under scrutiny is the circulating water (CW) system, with specific attention to the conditions of heat transfer and tube blockage in the CW system. A series of experiments has been conducted systematically to investigate the effectiveness of FAM in fault detection and diagnosis tasks. In addition, a set of domain rules has been extracted from the trained FAM network so that its predictions can be explained and justified. The outcomes demonstrate the benefits of employing FAM as an intelligent fault detection and diagnosis tool with an explanatory capability for monitoring and diagnosing complex processes in power generation plants.

Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma

X. Wang, J. Yang, R. Jensen and X. Liu, 'Rough Set Feature Selection and Rule Induction for Prediction of Malignancy Degree in Brain Glioma,' Computer Methods and Programs in Biomedicine, vol. 83, no. 2, pp. 147-156, 2006.

An experimental study of original and ordered fuzzy ARTMAP neural networks in pattern classification tasks

This paper investigates the effectiveness of an ordering algorithm applied to the supervised Fuzzy ARTMAP (FAM) neural network in pattern classification tasks. Before presenting the input patterns to the FAM network (known as ordered FAM), a fixed order of input patterns is first identified using the ordering algorithm. An experimental study is conducted to compare the results from ordered FAM with the average and voting results from original FAM. In the study, a pool of the original FAM networks is trained using different sequences of input patterns, and the results are averaged. Outputs from various original FAM networks can also be combined using a majority voting strategy to reach a final result. A database comprising various symptoms and measurements of patients suffering from heart attack is used to evaluate the various schemes of the FAM network in medical pattern classification tasks. The results are compared, analyzed, and discussed.

Method for improving classification performance of neural network based on fuzzy input and network inversion

In order to effectively improve the classification performance of neural network, first architecture of fuzzy neural network with fuzzy input was proposed. Next a cost function of fuzzy outputs and non-fuzzy targets was defined. Then a learning algorithm from the cost function for adjusting weights was derived. And then the fuzzy neural network was inversed and fuzzified inversion algorithm was proposed. Finally, computer simulations on real-world pattern classification problems examine the effectives of the proposed approach. The experiment results show that the proposed approach has the merits of high learning efficiency, high classification accuracy and high generalization capability.

A Neural Network Realization of Fuzzy ART

A neural network realization of the fuzzy Adaptive Resonance Theory (ART) algorithm is described. Fuzzy ART is capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns, thus enabling the network to learn both analog and binary input patterns. In the neural network realization of fuzzy ART, signal transduction obeys a path capacity rule. Category choice is determined by a combination of bottom-up signals and learned category biases. Top-down signals impose upper bounds on feature node activations.

Trajectory Control of Electro Hydraulic Excavator using Fuzzy Self Tuning Algorithm with Neural Network

This paper presents the trajectory control of a 2DOF mini electro-hydraulic excavator by using fuzzy self tuning with neural network algorithm. First, the mathematical model is derived for the 2DOF mini electro-hydraulic excavator. The fuzzy PID and fuzzy self tuning with neural network are designed for circle trajectory following. Its two links are driven by an electric motor controlled pump system. The experimental results demonstrated that the proposed controllers have better control performance than the conventional controller.