A taxonomy for wavelet neural networks applied to nonlinear modelling

This article presents a novel classification of wavelet neural networks based on the orthogonality/non-orthogonality of neurons and the type of nonlinearity employed. On the basis of this classification different network types are studied and their characteristics illustrated by means of simple one-dimensional nonlinear examples. For multidimensional problems, which are affected by the curse of dimensionality, the idea of spherical wavelet functions is considered. The behaviour of these networks is also studied for modelling of a low-dimension map.

Robust fuzzy Gustafson-Kessel clustering for nonlinear system identification

This paper deals with Takagi-Sugeno (TS) fuzzy model identification of nonlinear systems using fuzzy clustering. In particular, an extended fuzzy Gustafson-Kessel (EGK) clustering algorithm, using robust competitive agglomeration (RCA), is developed for automatically constructing a TS fuzzy model from system input-output data. The EGK algorithm can automatically determine the 'optimal' number of clusters from the training data set. It is shown that the EGK approach is relatively insensitive to initialization and is less susceptible to local minima, a benefit derived from its agglomerate property. This issue is often overlooked in the current literature on nonlinear identification using conventional fuzzy clustering. Furthermore, the robust statistical concepts underlying the EGK algorithm help to alleviate the difficulty of cluster identification in the construction of a TS fuzzy model from noisy training data. A new hybrid identification strategy is then formulated, which combines the EGK algorithm with a locally weighted, least-squares method for the estimation of local sub-model parameters. The efficacy of this new approach is demonstrated through function approximation examples and also by application to the identification of an automatic voltage regulation (AVR) loop for a simulated 3 kVA laboratory micro-machine system.

Moving window kernel PCA for adaptive monitoring of nonlinear processes

This paper discusses the monitoring of complex nonlinear and time-varying processes. Kernel principal component analysis (KPCA) has gained significant attention as a monitoring tool for nonlinear systems in recent years but relies on a fixed model that cannot be employed for time-varying systems. The contribution of this article is the development of a numerically efficient and memory saving moving window KPCA (MWKPCA) monitoring approach. The proposed technique incorporates an up- and downdating procedure to adapt (i) the data mean and covariance matrix in the feature space and (ii) approximates the eigenvalues and eigenvectors of the Gram matrix. The article shows that the proposed MWKPCA algorithm has a computation complexity of O(N2), whilst batch techniques, e.g. the Lanczos method, are of O(N3). Including the adaptation of the number of retained components and an l-step ahead application of the MWKPCA monitoring model, the paper finally demonstrates the utility of the proposed technique using a simulated nonlinear time-varying system and recorded data from an industrial distillation column.

Improved Nonlinear PCA for Process Monitoring Using Support Vector Data Description

Nonlinear principal component analysis (PCA) based on neural networks has drawn significant attention as a monitoring tool for complex nonlinear processes, but there remains a difficulty with determining the optimal network topology. This paper exploits the advantages of the Fast Recursive Algorithm, where the number of nodes, the location of centres, and the weights between the hidden layer and the output layer can be identified simultaneously for the radial basis function (RBF) networks. The topology problem for the nonlinear PCA based on neural networks can thus be solved. Another problem with nonlinear PCA is that the derived nonlinear scores may not be statistically independent or follow a simple parametric distribution. This hinders its applications in process monitoring since the simplicity of applying predetermined probability distribution functions is lost. This paper proposes the use of a support vector data description and shows that transforming the nonlinear principal components into a feature space allows a simple statistical inference. Results from both simulated and industrial data confirm the efficacy of the proposed method for solving nonlinear principal component problems, compared with linear PCA and kernel PCA.

Automated nonlinear system modelling with multiple neural networks

This article discusses the identification of nonlinear dynamic systems using multi-layer perceptrons (MLPs). It focuses on both structure uncertainty and parameter uncertainty, which have been widely explored in the literature of nonlinear system identification. The main contribution is that an integrated analytic framework is proposed for automated neural network structure selection, parameter identification and hysteresis network switching with guaranteed neural identification performance. First, an automated network structure selection procedure is proposed within a fixed time interval for a given network construction criterion. Then, the network parameter updating algorithm is proposed with guaranteed bounded identification error. To cope with structure uncertainty, a hysteresis strategy is proposed to enable neural identifier switching with guaranteed network performance along the switching process. Both theoretic analysis and a simulation example show the efficacy of the proposed method.

Fast automatic two-stage nonlinear model identification based on the extreme learning machine

It is convenient and effective to solve nonlinear problems with a model that has a linear-in-the-parameters (LITP) structure. However, the nonlinear parameters (e.g. the width of Gaussian function) of each model term needs to be pre-determined either from expert experience or through exhaustive search. An alternative approach is to optimize them by a gradient-based technique (e.g. Newton’s method). Unfortunately, all of these methods still need a lot of computations. Recently, the extreme learning machine (ELM) has shown its advantages in terms of fast learning from data, but the sparsity of the constructed model cannot be guaranteed. This paper proposes a novel algorithm for automatic construction of a nonlinear system model based on the extreme learning machine. This is achieved by effectively integrating the ELM and leave-one-out (LOO) cross validation with our two-stage stepwise construction procedure [1]. The main objective is to improve the compactness and generalization capability of the model constructed by the ELM method. Numerical analysis shows that the proposed algorithm only involves about half of the computation of orthogonal least squares (OLS) based method. Simulation examples are included to confirm the efficacy and superiority of the proposed technique.

Nonlinear time series prediction based on a power-law noise model

In this paper we investigate the influence of a power-law noise model, also called noise, on the performance of a feed-forward neural network used to predict time series. We introduce an optimization procedure that optimizes the parameters the neural networks by maximizing the likelihood function based on the power-law model. We show that our optimization procedure minimizes the mean squared leading to an optimal prediction. Further, we present numerical results applying method to time series from the logistic map and the annual number of sunspots demonstrate that a power-law noise model gives better results than a Gaussian model.

Numerical simulation of a patent technology for sealing of deep-sea oil wells using nonlinear finite element method

For over 50 years bridge plugs and cement have been used for well abandonment and work over and are still the material of choice. However the failures of cement abandonments using bridge plugs has been reported on many occasions, some of which have resulted in fatal consequences. A new patented product is designed to address the shortcomings associated with using bridge plugs and cement. The new developed tools use an alloy based on bismuth that is melted in situ using Thermite reaction. The tool uses the expansion properties of bismuth to seal the well. Testing the new technology in real field under more than 2 km deep sea water can be expensive. Virtual simulation of the new device under simulated thermal and mechanical environment can be achieved using nonlinear finite element method to validate the product and reduce cost. Experimental testing in the lab is performed to measure heat generated due to thermite reaction. Then, a sequential thermal mechanical explicit/implicit finite element solver is used to simulate the device under both testing lab and deep water conditions.

Non-parametric nonlinear system identification: A data-driven orthogonal basis function approach

In this paper, a data driven orthogonal basis function approach is proposed for non-parametric FIR nonlinear system identification. The basis functions are not fixed a priori and match the structure of the unknown system automatically. This eliminates the problem of blindly choosing the basis functions without a priori structural information. Further, based on the proposed basis functions, approaches are proposed for model order determination and regressor selection along with their theoretical justifications. © 2008 IEEE.

Harmonic generation and wave mixing in nonlinear metamaterials and photonic crystals (Invited paper)

The basic concepts and phenomenology of wave mixing and harmonic generation are reviewed in context of the recent advances in the enhanced nonlinear activity in metamaterials and photonic crystals. The effects of dispersion, field confinement and phase synchronism are illustrated by the examples of the on-purpose designed artificial nonlinear structures. (c) 2012 Wiley Periodicals, Inc. Int J RF and Microwave CAE 22:469482, 2012.

Modelling the nonlinear behaviour and fracture process of AS4/PEKK thermoplastic composite under shear loading

The accurate determination of non-linear shear behaviour and fracture toughness of continuous carbon-fibre/polymer composites remains a considerable challenge. These measurements are often necessary to generate material parameters for advanced computational damage models. In particular, there is a dearth of detailed shear fracture toughness characterisation for thermoplastic composites which are increasingly generating renewed interest within the aerospace and automotive sectors. In this work, carbon fibre (AS4)/ thermoplastic Polyetherketoneketone (PEKK) composite V-notched cross-ply specimens were manufactured to investigate their non-linear response under pure shear loading. Both monotonic and cyclic loading were applied to study the shear modulus degradation and progressive failure. For the first time in the reported literature, we use the essential work of fracture approach to measure the shear fracture toughness of continuous fibre reinforced composite laminates. Excellent geometric similarity in the load-displacement curves was observed for ligament-scaled specimens. The laminate fracture toughness was determined by linear regression, of the specific work of fracture values, to zero ligament thickness, and verified with computational models. The matrix intralaminar fracture toughness (ply level fracture toughness), associated with shear loading was determined by the area method. This paper also details the numerical implementation of a new three-dimensional phenomenological model for carbon fibre thermoplastic composites using the measured values, which is able to accurately represent the full non-linear mechanical response and fracture process. The constitutive model includes a new non-linear shear profile, shear modulus degradation and load reversal. It is combined with a smeared crack model for representing ply-level damage initiation and propagation. The model is shown to accurately predict the constitutive response in terms of permanent plastic strain, degraded modulus as well as load reversal. Predictions are also shown to compare favourably with the evolution of damage leading to final fracture.