Construction and optimisation of prediction intervals for neural network models

This thesis makes contributions to basic and fundamental research in the field of prediction interval construction using neural network models. It proposes novel methods for objective assessment, rapid construction, and optimisation of neural network-based prediction intervals for uncertainty quantification.

Spatial modeling of electrical conductivity with neural network

Many policy decisions for agricultural management in the coastal region closely depend on the extent of intrusion of sea water. In this study, Artificial Neural Network (ANN) is used to model the spatial variation of Electrical Conductivity to determine the extent of sea water intrusion in the coastal area of Brisbane, Australia. Quarterly EC data obtained from the observation (monitoring) wells located along the coast is used for training ANN architecture. The study demonstrates that ANN is able to model the spatial variation of EC with very good accuracy (even with very less training records) when some spatial information is used as one of the inputs in the network training. The results considerable improvement when compared with the network trained without the distance information.

Adaptive data based neural network leader-follower control of multi-agent networks

In this paper, we propose a data based neural network leader-follower control for multi-agent networks where each agent is described by a class of high-order uncertain nonlinear systems with input perturbation. The control laws are developed using multiple-surface sliding control technique. In particular, novel set of sliding variables are proposed to guarantee leader-follower consensus on the sliding surfaces. Novel switching is proposed to overcome the unavailability of instantaneous control output from the neighbor. By utilizing RBF neural network and Fourier series to approximate the unknown functions, leader-follower consensus can be reached, under the condition that the dynamic equations of all agents are unknown. An O(n) data based algorithm is developed, using only the network’s measurable input/output data to generate the distributed virtual control laws. Simulation results demonstrate the effectiveness of the approach.

A hybrid ART-GRNN online learning neural network with a ε-insensitive loss function

In this brief, a new neural network model called generalized adaptive resonance theory (GART) is introduced. GART is a hybrid model that comprises a modified Gaussian adaptive resonance theory (MGA) and the generalized regression neural network (GRNN). It is an enhanced version of the GRNN, which preserves the online learning properties of adaptive resonance theory (ART). A series of empirical studies to assess the effectiveness of GART in classification, regression, and time series prediction tasks is conducted. The results demonstrate that GART is able to produce good performances as compared with those of other methods, including the online sequential extreme learning machine (OSELM) and sequential learning radial basis function (RBF) neural network models.

A hybrid neural network classifier combining ordered fuzzy ARTMAP and the dynamic decay adjustment algorithm

This paper presents a novel conflict-resolving neural network classifier that combines the ordering algorithm, fuzzy ARTMAP (FAM), and the dynamic decay adjustment (DDA) algorithm, into a unified framework. The hybrid classifier, known as Ordered FAMDDA, applies the DDA algorithm to overcome the limitations of FAM and ordered FAM in achieving a good generalization/performance. Prior to network learning, the ordering algorithm is first used to identify a fixed order of training patterns. The main aim is to reduce and/or avoid the formation of overlapping prototypes of different classes in FAM during learning. However, the effectiveness of the ordering algorithm in resolving overlapping prototypes of different classes is compromised when dealing with complex datasets. Ordered FAMDDA not only is able to determine a fixed order of training patterns for yielding good generalization, but also is able to reduce/resolve overlapping regions of different classes in the feature space for minimizing misclassification during the network learning phase. To illustrate the effectiveness of Ordered FAMDDA, a total of ten benchmark datasets are experimented. The results are analyzed and compared with those from FAM and Ordered FAM. The outcomes demonstrate that Ordered FAMDDA, in general, outperforms FAM and Ordered FAM in tackling pattern classification problems.

A hybrid neural network model for noisy data regression

A hybrid neural network model, based on the fusion of fuzzy adaptive resonance theory (FA ART) and the general regression neural network (GRNN), is proposed in this paper. Both FA and the GRNN are incremental learning systems and are very fast in network training. The proposed hybrid model, denoted as GRNNFA, is able to retain these advantages and, at the same time, to reduce the computational requirements in calculating and storing information of the kernels. A clustering version of the GRNN is designed with data compression by FA for noise removal. An adaptive gradient-based kernel width optimization algorithm has also been devised. Convergence of the gradient descent algorithm can be accelerated by the geometric incremental growth of the updating factor. A series of experiments with four benchmark datasets have been conducted to assess and compare effectiveness of GRNNFA with other approaches. The GRNNFA model is also employed in a novel application task for predicting the evacuation time of patrons at typical karaoke centers in Hong Kong in the event of fire. The results positively demonstrate the applicability of GRNNFA in noisy data regression problems.

A modified fuzzy min-max neural network with a genetic-algorithm-based rule extractor for pattern classification

In this paper, a two-stage pattern classification and rule extraction system is proposed. The first stage consists of a modified fuzzy min-max (FMM) neural-network-based pattern classifier, while the second stage consists of a genetic-algorithm (GA)-based rule extractor. Fuzzy if-then rules are extracted from the modified FMM classifier, and a ??don't care?? approach is adopted by the GA rule extractor to minimize the number of features in the extracted rules. Five benchmark problems and a real medical diagnosis task are used to empirically evaluate the effectiveness of the proposed FMM-GA system. The results are analyzed and compared with other published results. In addition, the bootstrap hypothesis analysis is conducted to quantify the results of the medical diagnosis task statistically. The outcomes reveal the efficacy of FMM-GA in extracting a set of compact and yet easily comprehensible rules while maintaining a high classification performance for tackling pattern classification tasks.

A mutation-based evolving neural network model and its application to condition monitoring

Data analysis using intelligent systems is a key solution to many industrial problems. In this paper, a mutation-based evolving artificial neural network, which is based on an integration of the Fuzzy ARTMAP (FAM) neural network and evolutionary programming (EP), is proposed. The proposed FAMEP model is applied to detect and classify possible faults from a number of sensory signals of a circulating water system in a power generation plant. The efficiency of FAM-EP is assessed and compared with that of the original FAM network in terms of classification accuracy as well as network complexity. In addition, the bootstrap method is used to quantify the performance statistically. The results positively demonstrate the usefulness of FAM-EP in tackling data classification problems.