Spiking Neural Network Connectivity and its Potential for Temporal Sensory Processing and Variable Binding

The most biologically-inspired artificial neurons are those of the third generation, and are termed spiking neurons, as individual pulses or spikes are the means by which stimuli are communicated. In essence, a spike is a short-term change in electrical potential and is the basis of communication between biological neurons. Unlike previous generations of artificial neurons, spiking neurons operate in the temporal domain, and exploit time as a resource in their computation. In 1952, Alan Lloyd Hodgkin and Andrew Huxley produced the first model of a spiking neuron; their model describes the complex electro-chemical process that enables spikes to propagate through, and hence be communicated by, spiking neurons. Since this time, improvements in experimental procedures in neurobiology, particularly with in vivo experiments, have provided an increasingly more complex understanding of biological neurons. For example, it is now well understood that the propagation of spikes between neurons requires neurotransmitter, which is typically of limited supply. When the supply is exhausted neurons become unresponsive. The morphology of neurons, number of receptor sites, amongst many other factors, means that neurons consume the supply of neurotransmitter at different rates. This in turn produces variations over time in the responsiveness of neurons, yielding various computational capabilities. Such improvements in the understanding of the biological neuron have culminated in a wide range of different neuron models, ranging from the computationally efficient to the biologically realistic. These models enable the modelling of neural circuits found in the brain. In recent years, much of the focus in neuron modelling has moved to the study of the connectivity of spiking neural networks. Spiking neural networks provide a vehicle to understand from a computational perspective, aspects of the brain’s neural circuitry. This understanding can then be used to tackle some of the historically intractable issues with artificial neurons, such as scalability and lack of variable binding. Current knowledge of feed-forward, lateral, and recurrent connectivity of spiking neurons, and the interplay between excitatory and inhibitory neurons is beginning to shed light on these issues, by improved understanding of the temporal processing capabilities and synchronous behaviour of biological neurons. This research topic aims to amalgamate current research aimed at tackling these phenomena.

A neural network seismic detector

This experimental study focuses on a detection system at the seismic station level that should have a similar role to the detection algorithms based on the ratio STA/LTA. We tested two types of neural network: Multi-Layer Perceptrons and Support Vector Machines, trained in supervised mode. The universe of data consisted of 2903 patterns extracted from records of the PVAQ station, of the seismography network of the Institute of Meteorology of Portugal. The spectral characteristics of the records and its variation in time were reflected in the input patterns, consisting in a set of values of power spectral density in selected frequencies, extracted from a spectro gram calculated over a segment of record of pre-determined duration. The universe of data was divided, with about 60% for the training and the remainder reserved for testing and validation. To ensure that all patterns in the universe of data were within the range of variation of the training set, we used an algorithm to separate the universe of data by hyper-convex polyhedrons, determining in this manner a set of patterns that have a mandatory part of the training set. Additionally, an active learning strategy was conducted, by iteratively incorporating poorly classified cases in the training set. The best results, in terms of sensitivity and selectivity in the whole data ranged between 98% and 100%. These results compare very favorably with the ones obtained by the existing detection system, 50%.

Anytime information processing based on fuzzy and neural network models

In modern measurement and control systems, the available time and resources are often not only limited, but could change during the operation of the system. In these cases, the so-called anytime algorithms could be used advantageously. While diflerent soft computing methods are wide-spreadly used in system modeling, their usability in these cases are limited.

Identification of aircraft gas-turbines dynamics: comparison of classical and neural techniques

A gas turbine is made up of three basic components: a compressor, a combustion chamber and a turbine. Air is drawn into the engine by the compressor, which compresses it and delivers it to the combustion chamber. There, the air is mixed with the fuel and the mixture ignited, producing a rise of temperature and therefore an expansion of the gases. These are expelled through the engine nozzle, but first pass through the turbine, designed to extract energy to keep the compressor rotating [1]. The work described here uses data recorded from a Rolls Royce Spey MK 202 turbine, whose simplified diagram can be seen in Fig. 1. Both the compressor and the turbine are split into low pressure (LP) and high pressure (HP) stages. The HP turbine drives the HP compressor and the LP turbine drives the LP compressor. They are connected by concentric shafts that rotate at different speeds, denoted as NH and NL.

Neural network classification of cerebral embolic signals

The presence of circulating cerebral emboli represents an increased risk of stroke. The detection of such emboli is possible with the use of a transcranial Doppler ultrasound (TCD) system.

On-line adaptation of neural network

The Proportional Integral and Devirative (PID) controller autotuning is an important problem, both in practical and theoretical terms. The autotuning procedure must take place in real-time, and therefore the corresponding optimisation procedure must also be executed in real-time and without disturbing on-line control.

Recent developments in neural network PID autotuning

PID controllers are widely used in industrial applications. Because the plant can be time variant, methods of autotuning of this type of controllers, are of great economical importance, see (Astrom, 1996). Since 1942, with the work of Ziegler and Nichols (Ziegler and Nichols, 1942), several methods have been proposed in the literature. Recently, a new technique using neural networks was proposed (Ruano et al., 1992). This technique has been shown to produce good tunings as long as certain limitations are met.

New methods for PID autotuning

In this paper a recent approach for PID autotuning, involving neural networks, is ferther developed. To make this approach adaptive, optimal PID values must be known on-line. In this paper neural network models of tuning criteria, together with the use of genetic algorithms, are proposed to solve this problem.

Neural network assisted autotuning of industrial PID controllers

A recent servey (1) has reported that the majority of industrial loops are controlled by PID-type controllers and many of the PID controllers in operation are poorly tuned. poor PID tuning is due to the lack of a simple and practical tuning method for avarage users, and due to the tedious procedurs involved in the tuning and retuning of PID controllers.

Comparison of alternative approaches to neural network PID autotuning

In this paper, a scheme for the automatic tuning of PID controllers on-line, with the assistance of trained neural networks, is proposed. The alternative approaches are presented and compared.

A neural network PID autotuner

Proportional, Integral and Derivative (PID) regulators are standard building blocks for industrial automation. Their popularity comes from their rebust performance and also from their functional simplicity. Whether because the plant is time-varying, or because of components ageing, these controllers need to be regularly retuned.

An artificial neural network approach for short-term wind power forecasting in Portugal

This paper presents an artificial neural network approach for short-term wind power forecasting in Portugal. The increased integration of wind power into the electric grid, as nowadays occurs in Portugal, poses new challenges due to its intermittency and volatility. Hence, good forecasting tools play a key role in tackling these challenges. The accuracy of the wind power forecasting attained with the proposed approach is evaluated against persistence and ARIMA approaches, reporting the numerical results from a real-world case study.

Mixed integer non linear programming and artificial neural network based approach to ancillary services dispatch in competitive electricity markets

Ancillary services represent a good business opportunity that must be considered by market players. This paper presents a new methodology for ancillary services market dispatch. The method considers the bids submitted to the market and includes a market clearing mechanism based on deterministic optimization. An Artificial Neural Network is used for day-ahead prediction of Regulation Down, regulation-up, Spin Reserve and Non-Spin Reserve requirements. Two test cases based on California Independent System Operator data concerning dispatch of Regulation Down, Regulation Up, Spin Reserve and Non-Spin Reserve services are included in this paper to illustrate the application of the proposed method: (1) dispatch considering simple bids; (2) dispatch considering complex bids.

Neural control of an autonomous robot

This article aims to apply the concepts associated with artificial neural networks (ANN) in the control of an autonomous robot system that is intended to be used in competitions of robots. The robot was tested in several arbitrary paths in order to verify its effectiveness. The results show that the robot performed the tasks with success. Moreover, in the case of arbitrary paths the ANN control outperforms other methodologies, such as fuzzy logic control (FLC).

Projecto de Controladores usando Redes Neuronais

Neste documento descreve-se o projeto desenvolvido na unidade curricular de Tese e Dissertação durante o 2º ano do Mestrado de Engenharia Eletrotécnica e de Computadores no ramo de Automação e Sistemas, no Departamento de Engenharia Eletrotécnica (DEE) do Instituto Superior de Engenharia do Porto (ISEP). O projeto escolhido teve como base o uso da tecnologia das redes neuronais para implementação em sistemas de controlo. Foi necessário primeiro realizar um estudo desta tecnologia, perceber como esta surgiu e como é estruturada. Por último, abordar alguns casos de estudo onde as redes neuronais foram aplicadas com sucesso. Relativamente à implementação, foram consideradas diferentes estruturas de controlo, e entre estas escolhidas a do sistema de controlo estabilizador e sistema de referência adaptativo. No entanto, como o objetivo deste trabalho é o estudo de desempenho quando aplicadas as redes neuronais, não se utilizam apenas estas como controlador. A análise exposta neste trabalho trata de perceber em que medida é que a introdução das redes neuronais melhora o controlo de um processo. Assim sendo, os sistemas de controlo utilizados devem conter pelo menos uma rede neuronal e um controlador PID. Os testes de desempenho são aplicados no controlo de um motor DC, sendo realizados através do recurso ao software MATLAB. As simulações efetuadas têm diferentes configurações de modo a tirar conclusões o mais gerais possível. Assim, os sistemas de controlo são simulados para dois tipos de entrada diferentes, e com ou sem a adição de ruído no sensor. Por fim, é efetuada uma análise das respostas de cada sistema implementado e calculados os índices de desempenho das mesmas.