Data based constructive identification - overcoming the curse of dimensionality

The modelling of a nonlinear stochastic dynamical processes from data involves solving the problems of data gathering, preprocessing, model architecture selection, learning or adaptation, parametric evaluation and model validation. For a given model architecture such as associative memory networks, a common problem in non-linear modelling is the problem of "the curse of dimensionality". A series of complementary data based constructive identification schemes, mainly based on but not limited to an operating point dependent fuzzy models, are introduced in this paper with the aim to overcome the curse of dimensionality. These include (i) a mixture of experts algorithm based on a forward constrained regression algorithm; (ii) an inherent parsimonious delaunay input space partition based piecewise local lineal modelling concept; (iii) a neurofuzzy model constructive approach based on forward orthogonal least squares and optimal experimental design and finally (iv) the neurofuzzy model construction algorithm based on basis functions that are Bézier Bernstein polynomial functions and the additive decomposition. Illustrative examples demonstrate their applicability, showing that the final major hurdle in data based modelling has almost been removed.

Adaptive recursive control of a soil testing load frame

Recursive Learning Control (RLC) has the potential to significantly reduce the tracking error in many repetitive trajectory applications. This paper presents an application of RLC to a soil testing load frame where non-adaptive techniques struggle with the highly nonlinear nature of soil. The main purpose of the controller is to apply a sinusoidal force reference trajectory on a soil sample with a high degree of accuracy and repeatability. The controller uses a feedforward control structure, recursive least squares adaptation algorithm and RLC to compensate for periodic errors. Tracking error is reduced and stability is maintained across various soil sample responses.

Bias correction in a multivariate normal regression model with general parameterization

This paper derives the second-order biases Of maximum likelihood estimates from a multivariate normal model where the mean vector and the covariance matrix have parameters in common. We show that the second order bias can always be obtained by means of ordinary weighted least-squares regressions. We conduct simulation studies which indicate that the bias correction scheme yields nearly unbiased estimators. (C) 2009 Elsevier B.V. All rights reserved.

Essays on Spatial Econometrics

Esta dissertação concentra-se nos processos estocásticos espaciais definidos em um reticulado, os chamados modelos do tipo Cliff & Ord. Minha contribuição nesta tese consiste em utilizar aproximações de Edgeworth e saddlepoint para investigar as propriedades em amostras finitas do teste para detectar a presença de dependência espacial em modelos SAR (autoregressivo espacial), e propor uma nova classe de modelos econométricos espaciais na qual os parâmetros que afetam a estrutura da média são distintos dos parâmetros presentes na estrutura da variância do processo. Isto permite uma interpretação mais clara dos parâmetros do modelo, além de generalizar uma proposta de taxonomia feita por Anselin (2003). Eu proponho um estimador para os parâmetros do modelo e derivo a distribuição assintótica do estimador. O modelo sugerido na dissertação fornece uma interpretação interessante ao modelo SARAR, bastante comum na literatura. A investigação das propriedades em amostras finitas dos testes expande com relação a literatura permitindo que a matriz de vizinhança do processo espacial seja uma função não-linear do parâmetro de dependência espacial. A utilização de aproximações ao invés de simulações (mais comum na literatura), permite uma maneira fácil de comparar as propriedades dos testes com diferentes matrizes de vizinhança e corrigir o tamanho ao comparar a potência dos testes. Eu obtenho teste invariante ótimo que é também localmente uniformemente mais potente (LUMPI). Construo o envelope de potência para o teste LUMPI e mostro que ele é virtualmente UMP, pois a potência do teste está muito próxima ao envelope (considerando as estruturas espaciais definidas na dissertação). Eu sugiro um procedimento prático para construir um teste que tem boa potência em uma gama de situações onde talvez o teste LUMPI não tenha boas propriedades. Eu concluo que a potência do teste aumenta com o tamanho da amostra e com o parâmetro de dependência espacial (o que está de acordo com a literatura). Entretanto, disputo a visão consensual que a potência do teste diminui a medida que a matriz de vizinhança fica mais densa. Isto reflete um erro de medida comum na literatura, pois a distância estatística entre a hipótese nula e a alternativa varia muito com a estrutura da matriz. Fazendo a correção, concluo que a potência do teste aumenta com a distância da alternativa à nula, como esperado.

Identificação fuzzy-multimodelos para sistemas não lineares

This paper presents a new multi-model technique of dentification in ANFIS for nonlinear systems. In this technique, the structure used is of the fuzzy Takagi-Sugeno of which the consequences are local linear models that represent the system of different points of operation and the precursors are membership functions whose adjustments are realized by the learning phase of the neuro-fuzzy ANFIS technique. The models that represent the system at different points of the operation can be found with linearization techniques like, for example, the Least Squares method that is robust against sounds and of simple application. The fuzzy system is responsible for informing the proportion of each model that should be utilized, using the membership functions. The membership functions can be adjusted by ANFIS with the use of neural network algorithms, like the back propagation error type, in such a way that the models found for each area are correctly interpolated and define an action of each model for possible entries into the system. In multi-models, the definition of action of models is known as metrics and, since this paper is based on ANFIS, it shall be denominated in ANFIS metrics. This way, ANFIS metrics is utilized to interpolate various models, composing a system to be identified. Differing from the traditional ANFIS, the created technique necessarily represents the system in various well defined regions by unaltered models whose pondered activation as per the membership functions. The selection of regions for the application of the Least Squares method is realized manually from the graphic analysis of the system behavior or from the physical characteristics of the plant. This selection serves as a base to initiate the linear model defining technique and generating the initial configuration of the membership functions. The experiments are conducted in a teaching tank, with multiple sections, designed and created to show the characteristics of the technique. The results from this tank illustrate the performance reached by the technique in task of identifying, utilizing configurations of ANFIS, comparing the developed technique with various models of simple metrics and comparing with the NNARX technique, also adapted to identification

Evolução da biodegradabilidade da matéria orgânica em um sistema de lagoas de estabilização

Waste stabilization ponds (WSP) have been widely used for sewage treatment in hot climate regions because they are economic and environmentally sustainable. In the present study a WSP complex comprising a primary facultative pond (PFP) followed by two maturation ponds (MP-1 and MP-2) was studied, in the city of Natal-RN. The main objective was to study the bio-degradability of organic matter through the determination of the kinetic constant k throughout the system. The work was carried out in two phases. In the first, the variability in BOD, COD and TOC concentrations and an analysis of the relations between these parameters, in the influent raw sewage, pond effluents and in specific areas inside the ponds was studied. In the second stage, the decay rate for organic matter (k) was determined throughout the system based on BOD tests on the influent sewage, pond effluents and water column samples taken from fixed locations within the ponds, using the mathematical methods of Least Squares and the Thomas equation. Subsequently k was estimated as a function of a hydrodynamic model determined from the dispersion number (d), using empirical methods and a Partial Hydrodynamic Evaluation (PHE), obtained from tracer studies in a section of the primary facultative pond corresponding to 10% of its total length. The concentrations of biodegradable organic matter, measured as BOD and COD, gradually reduced through the series of ponds, giving overall removal efficiencies of 71.95% for BOD and of 52.45% for COD. Determining the values for k, in the influent and effluent samples of the ponds using the mathematical method of Least Squares, gave the following values respectively: primary facultative pond (0,23 day-1 and 0,09 day-1), maturation 1 (0,04 day-1 and 0,03 day-1) and maturation 2 (0,03 day-1 and 0,08 day-1). When using the Thomas method, the values of k in the influents and effluents of the ponds were: primary facultative pond (0,17 day-1 and 0,07 day-1), maturation 1 (0,02 day-1 and 0,01 day-1) and maturation 2 (0,01 day-1 and 0,02 day-1). From the Partial Hydrodynamic Evaluation, in the first section of the facultative pond corresponding to 10% of its total length, it can be concluded from the dispersion number obtained of d = 0.04, that the hydraulic regime is one of dispersed flow with a kinetic constant value of 0.20 day-1

Stochastic modelling considering ionospheric scintillation effects on GNSS relative and point positioning

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

A neural system to robust Nonlinear optimization subject to disjoint and constrained sets

The ability of neural networks to realize some complex nonlinear function makes them attractive for system identification. This paper describes a novel method using artificial neural networks to solve robust parameter estimation problems for nonlinear models with unknown-but-bounded errors and uncertainties. More specifically, a modified Hopfield network is developed and its internal parameters are computed using the valid-subspace technique. These parameters guarantee the network convergence to the equilibrium points. A solution for the robust estimation problem with unknown-but-bounded error corresponds to an equilibrium point of the network. Simulation results are presented as an illustration of the proposed approach.

Espectroscopia no infravermelho próximo e métodos de calibração multivariada aplicados à determinação simultânea de parâmetros bioquímicos em plasma sanguíneo

In this work, the quantitative analysis of glucose, triglycerides and cholesterol (total and HDL) in both rat and human blood plasma was performed without any kind of pretreatment of samples, by using near infrared spectroscopy (NIR) combined with multivariate methods. For this purpose, different techniques and algorithms used to pre-process data, to select variables and to build multivariate regression models were compared between each other, such as partial least squares regression (PLS), non linear regression by artificial neural networks, interval partial least squares regression (iPLS), genetic algorithm (GA), successive projections algorithm (SPA), amongst others. Related to the determinations of rat blood plasma samples, the variables selection algorithms showed satisfactory results both for the correlation coefficients (R²) and for the values of root mean square error of prediction (RMSEP) for the three analytes, especially for triglycerides and cholesterol-HDL. The RMSEP values for glucose, triglycerides and cholesterol-HDL obtained through the best PLS model were 6.08, 16.07 e 2.03 mg dL-1, respectively. In the other case, for the determinations in human blood plasma, the predictions obtained by the PLS models provided unsatisfactory results with non linear tendency and presence of bias. Then, the ANN regression was applied as an alternative to PLS, considering its ability of modeling data from non linear systems. The root mean square error of monitoring (RMSEM) for glucose, triglycerides and total cholesterol, for the best ANN models, were 13.20, 10.31 e 12.35 mg dL-1, respectively. Statistical tests (F and t) suggest that NIR spectroscopy combined with multivariate regression methods (PLS and ANN) are capable to quantify the analytes (glucose, triglycerides and cholesterol) even when they are present in highly complex biological fluids, such as blood plasma

DETERMINATION of SILICON IN LUBRICANT OIL BY HIGH-RESOLUTION CONTINUUM SOURCE FLAME ATOMIC ABSORPTION SPECTROMETRY USING LEAST-SQUARE BACKGROUND CORRECTION and INTERNAL STANDARDIZATION

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Comparative ontogenetic shape changes in the skull of Caiman species (Crocodylia, Alligatoridae)

Ontogenetic shape changes in the skull of three species of the genus Caiman (C. latirostris, C. sclerops, and C. yacare) are compared by geometric morphometrics for three-dimensional configurations (the least-squares analysis). The technique for obtaining the landmark coordinates is a simplification of the algorithm for multidimensional scaling. The ontogenetic nonlinear shape changes are similar in the three species but occur in a lesser extent in C. latirostris. These seem to be correlated with functional changes in the skull. The uniform shape change corresponds to an elongation of the skull, dorsoventral flattening, and lateral compression in C. sclerops and C. yacare. There is some lateral broadening in C. latirostris. Differences in the ontogenetic processes probably cause the differences in diet observed between C. latirostris and the other two species. Neotenic evolution seems to have acted in the skull of C. latirostris, and a posterior amplification of the early divergence led to a repatterning of the shape ontogenetic trajectory in this species. (C) 1997 Wiley-Liss, Inc.

Transmission-expansion planning using the DC model and nonlinear-programming technique

The paper presents a constructive heuristic algorithm (CHA) for solving directly the long-term transmission-network-expansion-planning (LTTNEP) problem using the DC model. The LTTNEP is a very complex mixed-integer nonlinear-programming problem and presents a combinatorial growth in the search space. The CHA is used to find a solution for the LTTNEP problem of good quality. A sensitivity index is used in each step of the CHA to add circuits to the system. This sensitivity index is obtained by solving the relaxed problem of LTTNEP, i.e. considering the number of circuits to be added as a continuous variable. The relaxed problem is a large and complex nonlinear-programming problem and was solved through the interior-point method (IPM). Tests were performed using Garver's system, the modified IEEE 24-Bus system and the Southern Brazilian reduced system. The results presented show the good performance of IPM inside the CHA.

Electronic spectra, ESR and crystal structure of tetrahedral halocuprates(II). The existence of cations (2tbpo·H+) with a very short hydrogen bond

Two compounds [2tbpo·H+)2[CuCl4]= (yellow) and (2tbpo·H+)2[CuBr4]= (dark purple) (tbpo = tribenzylphosphine oxide) have been prepared and investigated by means of crystal structure, electronic, vibrational and ESR spectra. The crystal structure of the (2tbpo·H+)2[CuCl4]= complex was determined by three-dimensional X-ray diffraction. The compound crystallizes in the space group P42/n with unit-cell dimensions a = 19.585(2), c = 9.883(1)Å, V = 3790 (1)Å3, Z = 2, Dm = 1.303 (flotation) Dx = 1.302 Mg m-3. The structure was solved by direct methods and refined by blocked full-matrix least-squares to R = 0.053 for 2583 observed reflections. Cu(II) is coordinated to four chlorides in a tetrahedral arrangement. Tribenzylphosphine oxide molecules, related by a centre of inversion, are connected by a short hydrogen bridge. Chemical analysis, electronic and vibrational spectra showed that the bromide compound is similar to the chloride one and can be formulated as (2tbpo·H+)2[CuBr4]=. The position of the dd transition bands, the charge transfer bands, the ESR and the vibrational spectra of both complexes are discussed. The results are compared with analogous complexes cited in the literature. © 1983.

A barrier method for constrained nonlinear optimization using a modified Hopfield network

The ability of neural networks to realize some complex nonlinear function makes them attractive for system identification. This paper describes a novel barrier method using artificial neural networks to solve robust parameter estimation problems for nonlinear model with unknown-but-bounded errors and uncertainties. This problem can be represented by a typical constrained optimization problem. More specifically, a modified Hopfield network is developed and its internal parameters are computed using the valid-subspace technique. These parameters guarantee the network convergence to the equilibrium points. A solution for the robust estimation problem with unknown-but-bounded error corresponds to an equilibrium point of the network. Simulation results are presented as an illustration of the proposed approach.

Growth curves for ostriches (Struthio camelus) in a Brazilian population

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)