Model selection approaches for non-linear system identification: a review

The identification of non-linear systems using only observed finite datasets has become a mature research area over the last two decades. A class of linear-in-the-parameter models with universal approximation capabilities have been intensively studied and widely used due to the availability of many linear-learning algorithms and their inherent convergence conditions. This article presents a systematic overview of basic research on model selection approaches for linear-in-the-parameter models. One of the fundamental problems in non-linear system identification is to find the minimal model with the best model generalisation performance from observational data only. The important concepts in achieving good model generalisation used in various non-linear system-identification algorithms are first reviewed, including Bayesian parameter regularisation and models selective criteria based on the cross validation and experimental design. A significant advance in machine learning has been the development of the support vector machine as a means for identifying kernel models based on the structural risk minimisation principle. The developments on the convex optimisation-based model construction algorithms including the support vector regression algorithms are outlined. Input selection algorithms and on-line system identification algorithms are also included in this review. Finally, some industrial applications of non-linear models are discussed.

Modelling the MAPK signalling pathway using a two-stage identification algorithm

Signal transduction pathways describe the dynamics of cellular response to input signalling molecules at receptors on the cell membrane. The Mitogen-Activated Protein Kinase (MAPK) cascade is one of such pathways that are involved in many important cellular processes including cell growth and proliferation. This paper describes a black-box model of this pathway created using an advanced two-stage identification algorithm. Identification allows us to capture the unique features and dynamics of the pathway and also opens up the possibility of regulatory control design. In the approach described, an optimal model is obtained by performing model subset selection in two stages, where the terms are first determined by a forward selection method and then modified using a backward selection model refinement. The simulation results demonstrate that the model selected using the two-stage algorithm performs better than with the forward selection method alone.

On velocity-based local model networks for nonlinear identification

This paper exposes the strengths and weaknesses of the recently proposed velocity-based local model (LM) network. The global dynamics of the velocity-based blended representation are directly related to the dynamics of the underlying local models, an important property in the design of local controller networks. Furthermore, the sub-models are continuous-time and linear providing continuity with established linear theory and methods. This is not true for the conventional LM framework, where the global dynamics are only weakly related to the affine sub-models. In this paper, a velocity-based multiple model network is identified for a highly nonlinear dynamical system. The results show excellent dynamical modelling performances, highlighting the value of the velocity-based approach for the design and analysis of LM based control. Three important practical issues are also addressed. These relate to the blending of the velocity-based local models, the use of normalised Gaussian basis functions and the requirement of an input derivative.

Robust fuzzy Gustafson-Kessel clustering for nonlinear system identification

This paper deals with Takagi-Sugeno (TS) fuzzy model identification of nonlinear systems using fuzzy clustering. In particular, an extended fuzzy Gustafson-Kessel (EGK) clustering algorithm, using robust competitive agglomeration (RCA), is developed for automatically constructing a TS fuzzy model from system input-output data. The EGK algorithm can automatically determine the 'optimal' number of clusters from the training data set. It is shown that the EGK approach is relatively insensitive to initialization and is less susceptible to local minima, a benefit derived from its agglomerate property. This issue is often overlooked in the current literature on nonlinear identification using conventional fuzzy clustering. Furthermore, the robust statistical concepts underlying the EGK algorithm help to alleviate the difficulty of cluster identification in the construction of a TS fuzzy model from noisy training data. A new hybrid identification strategy is then formulated, which combines the EGK algorithm with a locally weighted, least-squares method for the estimation of local sub-model parameters. The efficacy of this new approach is demonstrated through function approximation examples and also by application to the identification of an automatic voltage regulation (AVR) loop for a simulated 3 kVA laboratory micro-machine system.

Techniques for multiple-set synchronous islanding control

Power system islanding can improve the continuity of power supply. Synchronous islanded operation enables the islanded system to remain in phase with the main power system while not electrically connected, so avoiding out-of-synchronism re-closure. Specific consideration is required for the multiple-set scenario. In this paper a suitable island management system is proposed, with the emphasis being on maximum island flexibility by allowing passive islanding transitions to occur, facilitated by intelligent control. These transitions include: island detection, identification, fragmentation, merging and return-to-mains. It can be challenging to detect these transitions while maintaining syn-chronous islanded operation. The performance of this control system in the presence of a variable wind power in-feed is also examined. A Mathworks SimPowerSystems simulation is used to investigate the performance of the island management system. The benefit and requirements for energy storage, com-munications and distribution system protection for this application are considered.

A rapid PCR-based assay for identification of cryptic Myotis spp (Myotis mystacinus, Myotis brandtii and Myotis alcathoe).

The development of a quick PCR-based method to distinguish European cryptic Myotis spp., Myotis mystacinus, Myotis brandtii and Myotis alcathoe is described. Primers were designed around species-specific single nucleotide polymorphisms (SNP’s) in the ND1 mitochondrial gene, and a pair of control primers was designed in the 12S mitochondrial gene. A multiplex of seven primer combinations produces clear species-specific bands using gel electrophoresis. Robustness of the method was tested on 33 M. mystacinus, 16 M. brandtii and 15 M. alcathoe samples from across the European range of these species. The method worked well on faecal samples collected from maternity roosts of M. mystacinus. The test is intended to aid collection of data on these species through a rapid and easy identification method with the ability to use DNA obtained from a range of sources including faecal matter.

Convergence of the iterative algorithm for a general Hammerstein system identification

The convergence of the iterative identification algorithm for a general Hammerstein system has been an open problem for a long time. In this paper, it is shown that the convergence can be achieved by incorporating a regularization procedure on the nonlinearity in addition to a normalization step on the parameters.

Identification of MRP-8 (calgranulin A) as a major responsive protein in chronic periodontitis

The purpose of the study was to analyse how the protein composition of the inflammatory exudate associated with chronic periodontitis differed from the exudate in periodontal health. Gingival crevicular fluid (GCF) was collected from sites with chronic periodontal inflammation and from non-diseased sites in healthy control subjects. Microbore HPLC analysis revealed one major difference in GCF protein profiles between healthy controls and periodontitis patients. The protein enhanced in periodontitis patients was identified as migration inhibitory factor-related protein-8 (MRP-8) by a combination of N-terminal amino acid sequencing, mass spectrometry, and SDS-PAGE. Together, these data demonstrate, for the first time, the presence of monomeric MRP-8 in an inflammatory exudate. Whether monomeric MRP-8 is a unique feature of chronic periodontal inflammation is not yet clear, but the chemotactic properties of this peptide support a functional role for MRP-8 in periodontal inflammation. Copyright (C) 2000 John Wiley & Sons, Ltd.

Predictive position and force control for shape memory alloy cylinders

In this paper, a linear lightweight electric cylinder constructed using shape memory alloy (SMA) is proposed. Spring SMA is used as the actuator to control the position and force of the cylinder rod. The model predictive control algorithm is investigated to compensate SMA hysteresis phenomenon and control the cylinder. In the predictive algorithm, the future output of the cylinder is computed based on the cylinder model, and the control signal is computed to minimize the error and power criterion. The cylinder model parameters are estimated by an online identification algorithm. Experimental results show that the SMA cylinder is able to precisely control position and force by using the predictive control strategy though the hysteresis effect existing in the actuator. The performance of the proposed controller is compared with that of a conventional PID controller

RFID based Efficient Lighting Control

The Kyoto Protocol and the European Energy Performance of Buildings Directive put an onus on governments
and organisations to lower carbon footprint in order to contribute towards reducing global warming. A key
parameter to be considered in buildings towards energy and cost savings is its indoor lighting that has a major
impact on overall energy usage and Carbon Dioxide emissions. Lighting control in buildings using Passive
Infrared sensors is a reliable and well established approach; however, the use of only Passive Infrared does not
offer much savings towards reducing carbon, energy, and cost. Accurate occupancy monitoring information can
greatly affect a building’s lighting control strategy towards a greener usage. This paper presents an approach for
data fusion of Passive Infrared sensors and passive Radio Frequency Identification (RFID) based occupancy
monitoring. The idea is to have efficient, need-based, and reliable control of lighting towards a green indoor
environment, all while considering visual comfort of occupants. The proposed approach provides an estimated
13% electrical energy savings in one open-plan office of a University building in one working day. Practical
implementation of RFID gateways provide real-world occupancy profiling data to be fused with Passive
Infrared sensing towards analysis and improvement of building lighting usage and control.