Fuzzy ARTMAP and a hybrid chaos genetic algorithm for medical pattern classification

In this paper, an Evolutionary Artificial Neural Network (EANN), which combines the Fuzzy ARTMAP (FAM) neural network and a hybrid Chaos Genetic Algorithm (CGA), is proposed for undertaking pattern classification tasks. The hybrid CGA is a modified version of the hybrid real-coded genetic algorithms that includes a Chaotic Mapping Operator (CMO) in its search and adaptation process. It is used to evolve the connection weights in FAM, and the resulting EANN is known as FAM-hybrid CGA. The CMO in the hybrid CGA is used to generate a group of chromosomes that incorporates the characteristics of chaos. The chromosomes are then adapted with an arbitrary small amount of variation in every generation. As the evolution procedure proceeds, chromosomes with considerable differences are produced. Such chromosomes, which are located at different regions of interest in the solution space, are able to provide good solutions to undertake search and adaption problems. The effectiveness of the proposed FAM-hybrid CGA model is first evaluated using benchmark medical data sets from the UCI machine learning repository. Its applicability to medical decision support is then demonstrated using a real database of patient records with suspected Acute Coronary Syndrome. The results indicate that FAM-hybrid CGA is able to outperform its neural network counterpart (i.e., FAM), and it can be employed as a useful pattern classification tool for tackling medical decision support tasks.

Keystroke patterns classification using the ARTMAP-FD neural network

This paper presents the development of a keystroke dynamics-based user authentication system using the ARTMAP-FD neural network. The effectiveness of ARTMAPFD in classifying keystroke patterns is analyzed and compared against a number of widely used machine learning systems. The results show that ARTMAP-FD performs well against many of its counterparts in keystroke patterns classification. Apart from that, instead of using the conventional typing timing characteristics, the applicability of typing pressure to ascertaining user's identity is investigated. The experimental results show that combining both latency and pressure patterns can improve the Equal Error Rate (ERR) of the system.

Feature extraction and classification of metal detector signals using the wavelet transform and the fuzzy ARTMAP neural network

In this paper, the Fuzzy ARTMAP (FAM) neural network is used to classify metal detector signals into different categories for automated target discrimination. Feature extraction of the metal detector signals is conducted using a wavelet transform technique. The FAM neural network is then employed to classify the extracted features into different target groups. A series of experiments using individual FAM networks and a voting FAM network is conducted. Promising classification accuracy rates are obtained from using individual and voting FAM networks, respectively. The experimental outcomes positively demonstrate the effectiveness of the generated features, and of the FAM network in classifying metal detector signals for automated target discrimination tasks.

Fuzzy ARTMAP and hybrid evolutionary programming for pattern classification

In this paper, an Evolutionary Artificial Neural Network (EANN) that combines the Fuzzy ARTMAP (FAM) network and a Hybrid Evolutionary Programming (HEP) model is introduced. The proposed FAM-HEP model, which combines the strengths of FAM and HEP, is able to construct its network structure autonomously as well as to perform learning and evolutionary search and adaptation concurrently. The effectiveness of the proposed FAM-HEP network is assessed empirically using several benchmark data sets and a real medical diagnosis problem. The performance of FAM-HEP is analyzed, and the results are compared with those of FAM-EP, FAM, and other classification models. In general, the results of FAM-HEP are better than those of FAM-EP and FAM, and are comparable with those from other classification models. The study also reveals the potential of FAM-HEP as an innovative EANN model for undertaking pattern classification problems in general, and a promising computerized decision support tool for tackling medical diagnosis tasks in particular.

Application of fuzzy ARTMAP and fuzzy c-means clustering to pattern classification with incomplete data

I

An experimental study of original and ordered fuzzy ARTMAP neural networks in pattern classification tasks

This paper investigates the effectiveness of an ordering algorithm applied to the supervised Fuzzy ARTMAP (FAM) neural network in pattern classification tasks. Before presenting the input patterns to the FAM network (known as ordered FAM), a fixed order of input patterns is first identified using the ordering algorithm. An experimental study is conducted to compare the results from ordered FAM with the average and voting results from original FAM. In the study, a pool of the original FAM networks is trained using different sequences of input patterns, and the results are averaged. Outputs from various original FAM networks can also be combined using a majority voting strategy to reach a final result. A database comprising various symptoms and measurements of patients suffering from heart attack is used to evaluate the various schemes of the FAM network in medical pattern classification tasks. The results are compared, analyzed, and discussed.

Improved GART neural network model for pattern classification and rule extraction with application to power systems

Generalized adaptive resonance theory (GART) is a neural network model that is capable of online learning and is effective in tackling pattern classification tasks. In this paper, we propose an improved GART model (IGART), and demonstrate its applicability to power systems. IGART enhances the dynamics of GART in several aspects, which include the use of the Laplacian likelihood function, a new vigilance function, a new match-tracking mechanism, an ordering algorithm for determining the sequence of training data, and a rule extraction capability to elicit if-then rules from the network. To assess the effectiveness of IGART and to compare its performances with those from other methods, three datasets that are related to power systems are employed. The experimental results demonstrate the usefulness of IGART with the rule extraction capability in undertaking classification problems in power systems engineering.

Online pattern classification with multiple neural network systems: an experimental study

In this paper, an empirical study of the development and application of a committee of neural networks on online pattern classification tasks is presented. A multiple classifier framework is designed by adopting an Adaptive Resonance Theory-based (ART) autonomously learning neural network as the building block. A number of algorithms for combining outputs from multiple neural classifiers are considered, and two benchmark data sets have been used to evaluate the applicability of the proposed system. Different learning strategies coupling offline and online learning approaches, as well as different input pattern representation schemes, including the "ensemble" and "modular" methods, have been examined experimentally. Benefits and shortcomings of each approach are systematically analyzed and discussed. The results are comparable, and in some cases superior, with those from other classification algorithms. The experiments demonstrate the potentials of the proposed multiple neural network systems in offering an alternative to handle online pattern classification tasks in possibly nonstationary environments.

Multi-scale local pattern co-occurrence matrix for textural image classification

Textural image classification technologies have been extensively explored and widely applied in many areas. It is advantageous to combine both the occurrence and spatial distribution of local patterns to describe a texture. However, most existing state-of-the-art approaches for textural image classification only employ the occurrence histogram of local patterns to describe textures, without considering their co-occurrence information. And they are usually very time-consuming because of the vector quantization involved. Moreover, those feature extraction paradigms are implemented at a single scale. In this paper we propose a novel multi-scale local pattern co-occurrence matrix (MS_LPCM) descriptor to characterize textural images through four major steps. Firstly, Gaussian filtering pyramid preprocessing is employed to obtain multi-scale images; secondly, a local binary pattern (LBP) operator is applied on each textural image to create a LBP image; thirdly, the gray-level co-occurrence matrix (GLCM) is utilized to extract local pattern co-occurrence matrix (LPCM) from LBP images as the features; finally, all LPCM features from the same textural image at different scales are concatenated as the final feature vectors for classification. The experimental results on three benchmark databases in this study have shown a higher classification accuracy and lower computing cost as compared with other state-of-the-art algorithms.