Fuzzy neural networks for control of dynamic systems

This thesis provides a unified and comprehensive treatment of the fuzzy neural networks as the intelligent controllers. This work has been motivated by a need to develop the solid control methodologies capable of coping with the complexity, the nonlinearity, the interactions, and the time variance of the processes under control. In addition, the dynamic behavior of such processes is strongly influenced by the disturbances and the noise, and such processes are characterized by a large degree of uncertainty. Therefore, it is important to integrate an intelligent component to increase the control system ability to extract the functional relationships from the process and to change such relationships to improve the control precision, that is, to display the learning and the reasoning abilities. The objective of this thesis was to develop a self-organizing learning controller for above processes by using a combination of the fuzzy logic and the neural networks. An on-line, direct fuzzy neural controller using the process input-output measurement data and the reference model with both structural and parameter tuning has been developed to fulfill the above objective. A number of practical issues were considered. This includes the dynamic construction of the controller in order to alleviate the bias/variance dilemma, the universal approximation property, and the requirements of the locality and the linearity in the parameters. Several important issues in the intelligent control were also considered such as the overall control scheme, the requirement of the persistency of excitation and the bounded learning rates of the controller for the overall closed loop stability. Other important issues considered in this thesis include the dependence of the generalization ability and the optimization methods on the data distribution, and the requirements for the on-line learning and the feedback structure of the controller. Fuzzy inference specific issues such as the influence of the choice of the defuzzification method, T-norm operator and the membership function on the overall performance of the controller were also discussed. In addition, the e-completeness requirement and the use of the fuzzy similarity measure were also investigated. Main emphasis of the thesis has been on the applications to the real-world problems such as the industrial process control. The applicability of the proposed method has been demonstrated through the empirical studies on several real-world control problems of industrial complexity. This includes the temperature and the number-average molecular weight control in the continuous stirred tank polymerization reactor, and the torsional vibration, the eccentricity, the hardness and the thickness control in the cold rolling mills. Compared to the traditional linear controllers and the dynamically constructed neural network, the proposed fuzzy neural controller shows the highest promise as an effective approach to such nonlinear multi-variable control problems with the strong influence of the disturbances and the noise on the dynamic process behavior. In addition, the applicability of the proposed method beyond the strictly control area has also been investigated, in particular to the data mining and the knowledge elicitation. When compared to the decision tree method and the pruned neural network method for the data mining, the proposed fuzzy neural network is able to achieve a comparable accuracy with a more compact set of rules. In addition, the performance of the proposed fuzzy neural network is much better for the classes with the low occurrences in the data set compared to the decision tree method. Thus, the proposed fuzzy neural network may be very useful in situations where the important information is contained in a small fraction of the available data.

Potential applications of discrete-event simulation and fuzzy rule-based systems to structural reliability and availability

This chapter discusses and illustrates some potential applications of discrete-event simulation (DES) techniques in structural reliability and availability analysis, emphasizing the convenience of using probabilistic approaches in modern building and civil engineering practices. After reviewing existing literature on the topic, some advantages of probabilistic techniques over analytical ones are highlighted. Then, we introduce a general framework for performing structural reliability and availability analysis through DES. Our methodology proposes the use of statistical distributions and techniques – such as survival analysis – to model component-level reliability. Then, using failure- and repair-time distributions and information about the structural logical topology (which allows determination of the structural state from their components’ state), structural reliability, and availability information can be inferred. Two numerical examples illustrate some potential applications of the proposed methodology to achieving more reliable and structural designs. Finally, an alternative approach to model uncertainty at component level is also introduced as ongoing work. This new approach is based on the use of fuzzy rule-based systems and it allows the introduction of experts’ opinions and evaluations in our methodology.

Short term load forecasting using interval type-2 fuzzy logic systems

Accurate Short Term Load Forecasting (STLF) is essential for a variety of decision making processes. However, forecasting accuracy may drop due to presence of uncertainty in the operation of energy systems or unexpected behavior of exogenous variables. This paper proposes the application of Interval Type-2 Fuzzy Logic Systems (IT2 FLSs) for the problem of STLF. IT2 FLSs, with extra degrees of freedom, are an excellent tool for handling prevailing uncertainties and improving the prediction accuracy. Experiments conducted with real datasets show that IT2 FLS models appropriately approximate future load demands with an acceptable accuracy. Furthermore, they demonstrate an encouraging degree of accuracy superior to feedforward neural networks used in this study.

Interval type-2 fuzzy logic systems for load forecasting : a comparative study

Accurate short term load forecasting (STLF) is essential for a variety of decision-making processes. However, forecasting accuracy can drop due to the presence of uncertainty in the operation of energy systems or unexpected behavior of exogenous variables. This paper proposes the application of Interval Type-2 Fuzzy Logic Systems (IT2 FLSs) for the problem of STLF. IT2 FLSs, with additional degrees of freedom, are an excellent tool for handling uncertainties and improving the prediction accuracy. Experiments conducted with real datasets show that IT2 FLS models precisely approximate future load demands with an acceptable accuracy. Furthermore, they demonstrate an encouraging degree of accuracy superior to feedforward neural networks and traditional type-1 Takagi-Sugeno-Kang (TSK) FLSs.

A mutation-based evolving neural network model and its application to condition monitoring

Data analysis using intelligent systems is a key solution to many industrial problems. In this paper, a mutation-based evolving artificial neural network, which is based on an integration of the Fuzzy ARTMAP (FAM) neural network and evolutionary programming (EP), is proposed. The proposed FAMEP model is applied to detect and classify possible faults from a number of sensory signals of a circulating water system in a power generation plant. The efficiency of FAM-EP is assessed and compared with that of the original FAM network in terms of classification accuracy as well as network complexity. In addition, the bootstrap method is used to quantify the performance statistically. The results positively demonstrate the usefulness of FAM-EP in tackling data classification problems.

A non-linear programming-based similarity reasoning scheme for modelling of monotonicity-preserving multi-input fuzzy inference systems

In this paper, the zero-order Sugeno Fuzzy Inference System (FIS) that preserves the monotonicity property is studied. The sufficient conditions for the zero-order Sugeno FIS model to satisfy the monotonicity property are exploited as a set of useful governing equations to facilitate the FIS modelling process. The sufficient conditions suggest a fuzzy partition (at the rule antecedent part) and a monotonically-ordered rule base (at the rule consequent part) that can preserve the monotonicity property. The investigation focuses on the use of two Similarity Reasoning (SR)-based methods, i.e., Analogical Reasoning (AR) and Fuzzy Rule Interpolation (FRI), to deduce each conclusion separately. It is shown that AR and FRI may not be a direct solution to modelling of a multi-input FIS model that fulfils the monotonicity property, owing to the difficulty in getting a set of monotonically-ordered conclusions. As such, a Non-Linear Programming (NLP)-based SR scheme for constructing a monotonicity-preserving multi-input FIS model is proposed. In the proposed scheme, AR or FRI is first used to predict the rule conclusion of each observation. Then, a search algorithm is adopted to look for a set of consequents with minimized root means square errors as compared with the predicted conclusions. A constraint imposed by the sufficient conditions is also included in the search process. Applicability of the proposed scheme to undertaking fuzzy Failure Mode and Effect Analysis (FMEA) tasks is demonstrated. The results indicate that the proposed NLP-based SR scheme is useful for preserving the monotonicity property for building a multi-input FIS model with an incomplete rule base.

Prediction interval construction using interval type-2 fuzzy logic systems

This study proposes a novel non-parametric method for construction of prediction intervals (PIs) using interval type-2 Takagi-Sugeno-Kang fuzzy logic systems (IT2 TSK FLSs). The key idea in the proposed method is to treat the left and right end points of the type-reduced set as the lower and upper bounds of a PI. This allows us to construct PIs without making any special assumption about the data distribution. A new training algorithm is developed to satisfy conditions imposed by the associated confidence level on PIs. Proper adjustment of premise and consequent parameters of IT2 TSK FLSs is performed through the minimization of a PI-based objective function, rather than traditional error-based cost functions. This new cost function covers both validity and informativeness aspects of PIs. A metaheuristic method is applied for minimization of the non-linear non-differentiable cost function. Quantitative measures are applied for assessing the quality of PIs constructed using IT2 TSK FLSs. The demonstrated results for four benchmark case studies with homogenous and heterogeneous noise clearly show the proposed method is capable of generating high quality PIs useful for decision-making.

Optimization of gaussian fuzzy membership functions and evaluation of the monotonicity property of fuzzy inference systems

In this paper, two issues relating to modeling of a monotonicity-preserving Fuzzy Inference System (FIS) are examined. The first is on designing or tuning of Gaussian Membership Functions (MFs) for a monotonic FIS. Designing Gaussian MFs for an FIS is difficult because of its spreading and curvature characteristics. In this study, the sufficient conditions are exploited, and the procedure of designing Gaussian MFs is formulated as a constrained optimization problem. The second issue is on the testing procedure for a monotonic FIS. As such, a testing procedure for a monotonic FIS model is proposed. Applicability of the proposed approach is demonstrated with a real world industrial application, i.e., Failure Mode and Effect Analysis. The results obtained are analysis and discussed. The outcomes show that the proposed approach is useful in designing a monotonicity-preserving FIS model.

On monotonic sufficient conditions of fuzzy inference systems and their applications

An important and difficult issue in designing a Fuzzy Inference System (FIS) is the specification of fuzzy sets and fuzzy rules. In this paper, two useful qualitative properties of the FIS model, i.e., the monotonicity and sub-additivity properties, are studied. The monotonic sufficient conditions of the FIS model with Gaussian membership functions are further analyzed. The aim is to incorporate the sufficient conditions into the FIS modeling process, which serves as a simple (which can be easily understood by domain users), easy-to-use (which can be easily applied to or can be a part of the FIS model), and yet reliable (which has a sound mathematical foundation) method to preserve the monotonicity property of the FIS model. Another aim of this paper is to demonstrate how these additional qualitative information can be exploited and extended to be part of the FIS designing procedure (i.e., for fuzzy sets and fuzzy rules design) via the sufficient conditions (which act as a set of useful governing equations for designing the FIS model). The proposed approach is able to avoid the "trial and error" procedure in obtaining a monotonic FIS model. To assess the applicability of the proposed approach, two practical problems are examined. The first is an FIS-based model for water level control, while the second is an FIS-based Risk Priority Number (RPN) model in Failure Mode and Effect Analysis (FMEA). To further illustrate the importance of the sufficient conditions as the governing equations, an analysis on the consequences of violating the sufficient conditions of the FIS-based RPN model is presented.

An evolutionary-based similarity reasoning scheme for monotonic multi-input fuzzy inference systems

In this paper, an Evolutionary-based Similarity Reasoning (ESR) scheme for preserving the monotonicity property of the multi-input Fuzzy Inference System (FIS) is proposed. Similarity reasoning (SR) is a useful solution for undertaking the incomplete rule base problem in FIS modeling. However, SR may not be a direct solution to designing monotonic multi-input FIS models, owing to the difficulty in getting a set of monotonically-ordered conclusions. The proposed ESR scheme, which is a synthesis of evolutionary computing, sufficient conditions, and SR, provides a useful solution to modeling and preserving the monotonicity property of multi-input FIS models. A case study on Failure Mode and Effect Analysis (FMEA) is used to demonstrate the effectiveness of the proposed ESR scheme in undertaking real world problems that require the monotonicity property of FIS models.

Sliding mode-like learning control for SISO complex systems with T-S fuzzy models

In this paper, a sliding mode-like learning control scheme is developed for a class of single input single output (SISO) complex systems. First, the Takagi-Sugeno (T-S) fuzzy modelling technique is employed to model the uncertain complex dynamical systems. Second, a sliding mode-like learning control is designed to drive the sliding variable to converge to the sliding surface, and the system states can then asymptotically converge to zero on the sliding surface. The advantages of this scheme are that: 1) the information about the uncertain system dynamics and the system model structure is not required for the design of the learning controller; 2) the closed-loop system behaves with a strong robustness with respect to uncertainties; 3) the control input is chattering-free. The sufficient conditions for the sliding mode-like learning control to stabilise the global fuzzy model are discussed in detail. A simulation example for the control of an inverted pendulum cart is presented to demonstrate the effectiveness of the proposed control scheme.

A robust learning control for SISO Nonlinear systems with T-S Fuzzy Model : C02-robust control

In this paper, a robust learning control is developed for a class of single input single output (SISO) nonlinear systems with T-S fuzzy model. It is seen that the proposed sliding mode learning control with the powerful Lipshitz-like condition can guarantee the stability, convergence and robustness of the closed-loop system without involving any assumptions on uncertain system dynamics. In addition, theconcept that the local system with the maximum membership function dominates the system dynamic behaviours helps to greatly simplify the control system design. It will be further seen that the continuous learning control ensures the advantage of chattering-free that may occur in conventional sliding mode systems. Simulation examples are presented to demonstrate the effectiveness of the proposed learning control through the comparison with the H-infinity control.

Enhancing an evolving tree-based text document visualization model with fuzzy c-Means clustering

An improved evolving model, i.e., Evolving Tree (ETree) with Fuzzy c-Means (FCM), is proposed for undertaking text document visualization problems in this study. ETree forms a hierarchical tree structure in which nodes (i.e., trunks) are allowed to grow and split into child nodes (i.e., leaves), and each node represents a cluster of documents. However, ETree adopts a relatively simple approach to split its nodes. Thus, FCM is adopted as an alternative to perform node splitting in ETree. An experimental study using articles from a flagship conference of Universiti Malaysia Sarawak (UNIMAS), i.e., Engineering Conference (ENCON), is conducted. The experimental results are analyzed and discussed, and the outcome shows that the proposed ETree-FCM model is effective for undertaking text document clustering and visualization problems.

A new neural network-based type reduction algorithm for interval type-2 fuzzy logic systems

This paper introduces a new type reduction (TR) algorithm for interval type-2 fuzzy logic systems (IT2 FLSs). Flexibility and adaptiveness are the key features of the proposed non-parametric algorithm. Lower and upper firing strengths of rules as well as their consequent coefficients are fed into a neural network (NN). NN output is a crisp value that corresponds to the defuzzified output of IT2 FLSs. The NN type reducer is trained through minimization of an error-based cost function with the purpose of improving modelling and forecasting performance of IT2 FLS models. Simulation results indicate that application of the proposed TR algorithm greatly enhances modelling and forecasting performance of IT2 FLS models. This benefit is achieved in no cost, as the computational requirement of the proposed algorithm is less than or at most equivalent to traditional TR algorithms.

A new framework with similarity reasoning and monotone fuzzy rule relabeling for fuzzy inference systems

A complete and monotonically-ordered fuzzy rule base is necessary to maintain the monotonicity property of a Fuzzy Inference System (FIS). In this paper, a new monotone fuzzy rule relabeling technique to relabel a non-monotone fuzzy rule base provided by domain experts is proposed. Even though the Genetic Algorithm (GA)-based monotone fuzzy rule relabeling technique has been investigated in our previous work [7], the optimality of the approach could not be guaranteed. The new fuzzy rule relabeling technique adopts a simple brute force search, and it can produce an optimal result. We also formulate a new two-stage framework that encompasses a GA-based rule selection scheme, the optimization based-Similarity Reasoning (SR) scheme, and the proposed monotone fuzzy rule relabeling technique for preserving the monotonicity property of the FIS model. Applicability of the two-stage framework to a real world problem, i.e., failure mode and effect analysis, is further demonstrated. The results clearly demonstrate the usefulness of the proposed framework.