Development of a speaker recognition system using wavelets and artificial neural networks

This paper addresses the problem of speaker recognition from speech signals. The study focuses on the development of a speaker recognition system comprising two modules: a wavelet-based feature extractor, and a neural-network-based classifier. We have conducted a number of experiments to investigate the applicability of Discrete Wavelet Transform (D WT) in extracting discriminative features from the speech signals, and have examined various models from the Adaptive Resonance Theory (ART) family of neural networks in classijjing the extracted features. The results indicate that DWT could be a potential feature extraction tool for speaker recognition. In addition, the ART-based classijiers have yielded very promising recognition accuracy at more than 81%.

Derivative-free optimization and neural networks for robust regression

Large outliers break down linear and nonlinear regression models. Robust regression methods allow one to filter out the outliers when building a model. By replacing the traditional least squares criterion with the least trimmed squares (LTS) criterion, in which half of data is treated as potential outliers, one can fit accurate regression models to strongly contaminated data. High-breakdown methods have become very well established in linear regression, but have started being applied for non-linear regression only recently. In this work, we examine the problem of fitting artificial neural networks (ANNs) to contaminated data using LTS criterion. We introduce a penalized LTS criterion which prevents unnecessary removal of valid data. Training of ANNs leads to a challenging non-smooth global optimization problem. We compare the efficiency of several derivative-free optimization methods in solving it, and show that our approach identifies the outliers correctly when ANNs are used for nonlinear regression.

Design of H∞ control of neural networks with time-varying delays

This paper deals with the H∞ control problem of neural networks with time-varying delays. The system under consideration is subject to time-varying delays and various activation functions. Based on constructing some suitable Lyapunov-Krasovskii functionals, we establish new sufficient conditions for H∞ control for two cases of time-varying delays: (1) the delays are differentiable and have an upper bound of the delay-derivatives and (2) the delays are bounded but not necessary to be differentiable. The derived conditions are formulated in terms of linear matrix inequalities, which allow simultaneous computation of two bounds that characterize the exponential stability rate of the solution. Numerical examples are given to illustrate the effectiveness of our results.

Observer-based control for time-varying delay neural networks with nonlinear observation

This paper studies the problem of designing observer-based controllers for a class of delayed neural networks with nonlinear observation. The system under consideration is subject to nonlinear observation and an interval time-varying delay. The nonlinear observation output is any nonlinear Lipschitzian function and the time-varying delay is not required to be differentiable nor its lower bound be zero. By constructing a set of appropriate Lyapunov-Krasovskii functionals and utilizing the Newton-Leibniz formula, some delay-dependent stabilizability conditions which are expressed in terms of Linear Matrix Inequalities (LMIs) are derived. The derived conditions allow simultaneous computation of two bounds that characterize the exponential stability rate of the closed-loop system. The unknown observer gain and the state feedback observer-based controller are directly obtained upon the feasibility of the derived LMIs stabilizability conditions. A simulation example is presented to verify the effectiveness of the proposed result.

Prediction intervals for electricity load forecasting using neural networks

Most of the research in time series is concerned with point forecasting. In this paper we focus on interval forecasting and its application for electricity load prediction. We extend the LUBE method, a neural network-based method for computing prediction intervals. The extended method, called LUBEX, includes an advanced feature selector and an ensemble of neural networks. Its performance is evaluated using Australian electricity load data for one year. The results showed that LUBEX is able to generate high quality prediction intervals, using a very small number of previous lag variables and having acceptable training time requirements. The use of ensemble is shown to be critical for the accuracy of the results.

Use of artificial neural networks as explicit finite difference operators

Results of a numerical exercise, substituting a numerical operator by an artificial neural network (ANN) are presented in this paper. The numerical operator used is the explicit form of the finite difference (FD) scheme. The FD scheme was used to discretize the one-dimensional transport equation, which included both the advection and dispersion terms. Inputs to the ANN are the FD representation of the transport equation, and the concentration was designated as the output. Concentration values used for training the ANN were obtained from analytical solutions. The numerical operator was reconstructed from a back calculation of the weights of the ANN. Linear transfer functions were used for this purpose. The ANN was able to accurately recover the velocity used in the training data, but not the dispersion coefficient. This capability was improved when numerical dispersion was taken into account; however, it is limited to the condition: C/P<0.5 , where C is the Courant number and P , the Peclet number (i.e., the restriction imposed by the Neumann stability condition).

Comparison between response surface models and artificial neural networks in hydrologic forecasting

Developing an efficient and accurate hydrologic forecasting model is crucial to managing water resources and flooding issues. In this study, response surface (RS) models including multiple linear regression (MLR), quadratic response surface (QRS), and nonlinear response surface (NRS) were applied to daily runoff (e.g., discharge and water level) prediction. Two catchments, one in southeast China and the other in western Canada, were used to demonstrate the applicability of the proposed models. Their performances were compared with artificial neural network (ANN) models, trained with the learning algorithms of the gradient descent with adaptive learning rate (ANN-GDA) and Levenberg-Marquardt (ANN-LM). The performances of both RS and ANN in relation to the lags used in the input data, the length of the training samples, long-term (monthly and yearly) predictions, and peak value predictions were also analyzed. The results indicate that the QRS and NRS were able to obtain equally good performance in runoff prediction, as compared with ANN-GDA and ANN-LM, but require lower computational efforts. The RS models bring practical benefits in their application to hydrologic forecasting, particularly in the cases of short-term flood forecasting (e.g., hourly) due to fast training capability, and could be considered as an alternative to ANN

Existence and global asymptotic stability of positive periodic solution of delayed Cohen-Grossberg neural networks

In this paper, a class of periodic Cohen-Grossberg neural networks with discrete and distributed time-varying delays is considered. By an extension of the Lyapunov-Krasovskii functional method, a novel criterion for the existence and uniqueness and global asymptotic stability of positive periodic solution is derived in terms of M-matrix without any restriction on uniform positiveness of the amplification functions. Comparison and illustrative examples are given to illustrate the effectiveness of the obtained results. © 2014 Elsevier Inc. All rights reserved.