Context-free and context-sensitive dynamics in recurrent neural networks

Continuous-valued recurrent neural networks can learn mechanisms for processing context-free languages. The dynamics of such networks is usually based on damped oscillation around fixed points in state space and requires that the dynamical components are arranged in certain ways. It is shown that qualitatively similar dynamics with similar constraints hold for a(n)b(n)c(n), a context-sensitive language. The additional difficulty with a(n)b(n)c(n), compared with the context-free language a(n)b(n), consists of 'counting up' and 'counting down' letters simultaneously. The network solution is to oscillate in two principal dimensions, one for counting up and one for counting down. This study focuses on the dynamics employed by the sequential cascaded network, in contrast to the simple recurrent network, and the use of backpropagation through time. Found solutions generalize well beyond training data, however, learning is not reliable. The contribution of this study lies in demonstrating how the dynamics in recurrent neural networks that process context-free languages can also be employed in processing some context-sensitive languages (traditionally thought of as requiring additional computation resources). This continuity of mechanism between language classes contributes to our understanding of neural networks in modelling language learning and processing.

Applying linear time-varying constraints to econometric models: With an application to demand systems

When linear equality constraints are invariant through time they can be incorporated into estimation by restricted least squares. If, however, the constraints are time-varying, this standard methodology cannot be applied. In this paper we show how to incorporate linear time-varying constraints into the estimation of econometric models. The method involves the augmentation of the observation equation of a state-space model prior to estimation by the Kalman filter. Numerical optimisation routines are used for the estimation. A simple example drawn from demand analysis is used to illustrate the method and its application.

Path integrals for continuous-time Markov chains

This note presents a method of evaluating the distribution of a path integral for Markov chains on a countable state space.

Integrals for continuous-time Markov chains

This paper presents a method of evaluating the expected value of a path integral for a general Markov chain on a countable state space. We illustrate the method with reference to several models, including birth-death processes and the birth, death and catastrophe process. (C) 2002 Elsevier Science Inc. All rights reserved.

A uniform white-noise model for fixed-point roundoff errors in digital systems

Fixed-point roundoff noise in digital implementation of linear systems arises due to overflow, quantization of coefficients and input signals, and arithmetical errors. In uniform white-noise models, the last two types of roundoff errors are regarded as uniformly distributed independent random vectors on cubes of suitable size. For input signal quantization errors, the heuristic model is justified by a quantization theorem, which cannot be directly applied to arithmetical errors due to the complicated input-dependence of errors. The complete uniform white-noise model is shown to be valid in the sense of weak convergence of probabilistic measures as the lattice step tends to zero if the matrices of realization of the system in the state space satisfy certain nonresonance conditions and the finite-dimensional distributions of the input signal are absolutely continuous.

Robust model-order reduction of complex biological processes

This paper addresses robust model-order reduction of a high dimensional nonlinear partial differential equation (PDE) model of a complex biological process. Based on a nonlinear, distributed parameter model of the same process which was validated against experimental data of an existing, pilot-scale BNR activated sludge plant, we developed a state-space model with 154 state variables in this work. A general algorithm for robustly reducing the nonlinear PDE model is presented and based on an investigation of five state-of-the-art model-order reduction techniques, we are able to reduce the original model to a model with only 30 states without incurring pronounced modelling errors. The Singular perturbation approximation balanced truncating technique is found to give the lowest modelling errors in low frequency ranges and hence is deemed most suitable for controller design and other real-time applications. (C) 2002 Elsevier Science Ltd. All rights reserved.

Evaluating plant breeding strategies by simulating gene action and dryland environment effects

Functional genomics is the systematic study of genome-wide effects of gene expression on organism growth and development with the ultimate aim of understanding how networks of genes influence traits. Here, we use a dynamic biophysical cropping systems model (APSIM-Sorg) to generate a state space of genotype performance based on 15 genes controlling four adaptive traits and then search this spice using a quantitative genetics model of a plant breeding program (QU-GENE) to simulate recurrent selection. Complex epistatic and gene X environment effects were generated for yield even though gene action at the trait level had been defined as simple additive effects. Given alternative breeding strategies that restricted either the cultivar maturity type or the drought environment type, the positive (+) alleles for 15 genes associated with the four adaptive traits were accumulated at different rates over cycles of selection. While early maturing genotypes were favored in the Severe-Terminal drought environment type, late genotypes were favored in the Mild-Terminal and Midseason drought environment types. In the Severe-Terminal environment, there was an interaction of the stay-green (SG) trait with other traits: Selection for + alleles of the SG genes was delayed until + alleles for genes associated with the transpiration efficiency and osmotic adjustment traits had been fixed. Given limitations in our current understanding of trait interaction and genetic control, the results are not conclusive. However, they demonstrate how the per se complexity of gene X gene X environment interactions will challenge the application of genomics and marker-assisted selection in crop improvement for dryland adaptation.

Análise funcional comparativa de algoritmos de aprendizagem por reforço

De entre todos os paradigmas de aprendizagem actualmente identificados, a Aprendizagem por Reforço revela-se de especial interesse e aplicabilidade nos inúmeros processos que nos rodeiam: desde a solitária sonda que explora o planeta mais remoto, passando pelo programa especialista que aprende a apoiar a decisão médica pela experiencia adquirida, até ao cão de brincar que faz as delícias da criança interagindo com ela e adaptando-se aos seus gostos, e todo um novo mundo que nos rodeia e apela crescentemente a que façamos mais e melhor nesta área. Desde o aparecimento do conceito de aprendizagem por reforço, diferentes métodos tem sido propostos para a sua concretização, cada um deles abordando aspectos específicos. Duas vertentes distintas, mas complementares entre si, apresentam-se como características chave do processo de aprendizagem por reforço: a obtenção de experiência através da exploração do espaço de estados e o aproveitamento do conhecimento obtido através dessa mesma experiência. Esta dissertação propõe-se seleccionar alguns dos métodos propostos mais promissores de ambas as vertentes de exploração e aproveitamento, efectuar uma implementação de cada um destes sobre uma plataforma modular que permita a simulação do uso de agentes inteligentes e, através da sua aplicação na resolução de diferentes configurações de ambientes padrão, gerar estatísticas funcionais que permitam inferir conclusões que retractem entre outros aspectos a sua eficiência e eficácia comparativas em condições específicas.

Systematic and liquidity risk in sub-prime mortgage-backed assets

The mis-evaluation of risk in securitized financial products is central to understanding the global financial crisis. This paper characterizes the evolution of risk factors affecting collateralized debt obligations (CDOs) based on subprime mortgages. A key feature of subprime mortgage-backed indices is that they are distinct in their vintage of issuance. Using a latent factor framework that incorporates this vintage effect, we show the increasing importance of common factors on more senior tranches during the crisis. An innovation of the paper is that we use the unbalanced panel structure of the data to identify the vintage, credit, common and idiosyncratic effects from a state-space specification.

Modelação do comportamento dinâmico de sistemas barragem-fundação-albufeira: formulação no espaço de estados com amortecimento generalizado

Com este trabalho mostra-se a importância da utilização integrada de modelos numéricos e de resultados da observação do comportamento dinâmico de barragens com vista ao controlo da segurança de sistemas barragem-fundação-albufeira. Neste trabalho utilizou-se o MATLAB para desenvolver um programa de elementos finitos 3D (DySSA 1.0, “Dynamic State Space Analysis”) para análise do comportamento dinâmico de sistemas barragem-fundação-albufeira considerando uma formulação em deslocamentos com a albufeira discretizada em elementos finitos com módulo de distorção nulo. Utiliza-se uma formulação no espaço de estados o que permite considerar amortecimento não proporcional à massa e à rigidez e conduz a modos de vibração complexos. Apresentam-se os fundamentos do método dos elementos finitos na perspetiva da sua implementação computacional para análise dinâmica de estruturas, e apresenta-se sumariamente o programa DySSA 1.0, o qual permite a análise estática e dinâmica de estruturas utilizando elementos finitos tridimensionais isoparamétricos do segundo grau (tipo cubo com 20 pontos nodais), e correspondentes elementos de junta (com 16 pontos nodais, 8 por cada face). O programa foi testado com base na análise dinâmica de uma parede em consola submetida à pressão hidrodinâmica. Os resultados numéricos foram comparados com soluções analíticas e com resultados experimentais obtidos no laboratório de estruturas do ISEL. Descrevem-se os fundamentos da análise dinâmica de estruturas no domínio do tempo, e referem-se os princípios em que se baseiam as metodologias de identificação modal no domínio da frequência. Analisa-se o comportamento dinâmico da barragem do Cabril em termos de frequências naturais e configurações modais, utilizando um modelo 3D representativo do sistema. Os resultados deste modelo numérico são comparados com resultados experimentais obtidos com base no sistema de monitorização dinâmica em contínuo, que foi instalado pelo LNEC em 2008.

Sei whale (Balaenoptera borealis) ecology and management in the North Atlantic

Tese de Doutoramento em Ciências do Mar, especialidade em Ecologia Marinha.

Optimização do posicionamento de câmaras de vídeo-vigilância

Dissertação de Mestrado em Engenharia de Redes de Comunicação e Multimédia

Modelação e monitorização do comportamento dinâmico de barragens abóbada: identificação modal automática

Trabalho Final de Mestrado elaborado no Laboratório de Engenharia Civil (LNEC) para obtenção do grau de Mestre em Engenharia Civil pelo Instituto Superior de Engenharia de Lisboa no âmbito do protocolo de cooperação entre o ISEL e o LNEC

Shannon entropy analysis of the genome code

This paper studies the chromosome information of twenty five species, namely, mammals, fishes, birds, insects, nematodes, fungus, and one plant. A quantifying scheme inspired in the state space representation of dynamical systems is formulated. Based on this algorithm, the information of each chromosome is converted into a bidimensional distribution. The plots are then analyzed and characterized by means of Shannon entropy. The large volume of information is integrated by averaging the lengths and entropy quantities of each species. The results can be easily visualized revealing quantitative global genomic information.

Accessing complexity from genome information

This paper studies the information content of the chromosomes of 24 species. In a first phase, a scheme inspired in dynamical system state space representation is developed. For each chromosome the state space dynamical evolution is shed into a two dimensional chart. The plots are then analyzed and characterized in the perspective of fractal dimension. This information is integrated in two measures of the species’ complexity addressing its average and variability. The results are in close accordance with phylogenetics pointing quantitative aspects of the species’ genomic complexity.