Neural Networks

We present an overview of current research on artificial neural networks, emphasizing a statistical perspective. We view neural networks as parameterized graphs that make probabilistic assumptions about data, and view learning algorithms as methods for finding parameter values that look probable in the light of the data. We discuss basic issues in representation and learning, and treat some of the practical issues that arise in fitting networks to data. We also discuss links between neural networks and the general formalism of graphical models.

Cultured neural networks

This article looks at the use of cultured neural networks as the decision-making mechanism of a control system. In this case biological neurons are grown and trained to act as an artificial intelligence engine. Such research has immediate medical implications as well as enormous potential in computing and robotics. An experimental system involving closed-loop control of a mobile robot by a culture of neurons has been successfully created and is described here. This article gives a brief overview of the problem area and ongoing research. Questions are asked as to where this will lead in the future.

Dealing with complexity: an overview of the neural network approach

The problem of complexity is particularly relevant to the field of control engineering, since many engineering problems are inherently complex. The inherent complexity is such that straightforward computational problem solutions often produce very poor results. Although parallel processing can alleviate the problem to some extent, it is artificial neural networks (in various forms) which have recently proved particularly effective, even in dealing with the causes of the problem itself. This paper presents an overview of the current neural network research being undertaken. Such research aims to solve the complex problems found in many areas of science and engineering today.

A Learning Function for Parameter Reduction in Spiking Neural Networks with Radial Basis Function

Spiking neural networks - networks that encode information in the timing of spikes - are arising as a new approach in the artificial neural networks paradigm, emergent from cognitive science. One of these new models is the pulsed neural network with radial basis function, a network able to store information in the axonal propagation delay of neurons. Learning algorithms have been proposed to this model looking for mapping input pulses into output pulses. Recently, a new method was proposed to encode constant data into a temporal sequence of spikes, stimulating deeper studies in order to establish abilities and frontiers of this new approach. However, a well known problem of this kind of network is the high number of free parameters - more that 15 - to be properly configured or tuned in order to allow network convergence. This work presents for the first time a new learning function for this network training that allow the automatic configuration of one of the key network parameters: the synaptic weight decreasing factor.

Wine classification by taste sensors made from ultra-thin films and using neural networks

This paper reports on a sensor array able to distinguish tastes and used to classify red wines. The array comprises sensing units made from Langmuir-Blodgett (LB) films of conducting polymers and lipids and layer-by-layer (LBL) films from chitosan deposited onto gold interdigitated electrodes. Using impedance spectroscopy as the principle of detection, we show that distinct clusters can be identified in principal component analysis (PCA) plots for six types of red wine. Distinction can be made with regard to vintage, vineyard and brands of the red wine. Furthermore, if the data are treated with artificial neural networks (ANNs), this artificial tongue can identify wine samples stored under different conditions. This is illustrated by considering 900 wine samples, obtained with 30 measurements for each of the five bottles of the six wines, which could be recognised with 100% accuracy using the algorithms Standard Backpropagation and Backpropagation momentum in the ANNs. (C) 2003 Elsevier B.V. All rights reserved.

Harmonic identification using parallel neural networks in single-phase systems

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Speed estimation for induction motor using neural networks method

This work presents an alternative approach based on neural network method in order to estimate speed of induction motors, using the measurement of primary variables such as voltage and current. Induction motors are very common in many sectors of the industry and assume an important role in the national energy policy. The nowadays methodologies, which are used in diagnosis, condition monitoring and dimensioning of these motors, are based on measure of the speed variable. However, the direct measure of this variable compromises the system control and starting circuit of an electric machinery, reducing its robustness and increasing the implementation costs. Simulation results and experimental data are presented to validate the proposed approach. © 2003-2012 IEEE.

Estimativa dos perfis de permeabilidade e de porosidade utilizando rede neural artificial

A permeabilidade e a porosidade são duas das mais importantes propriedades petrofísicas para a qualificação dos reservatórios de óleo e gás. A porosidade está relacionada à capacidade de armazenamento de fluidos e a permeabilidade, com a capacidade de produção destes fluidos. Suas medidas são, normalmente, realizadas em laboratório, através de testemunhos da rocha. Esses processos têm custos elevados e nem todos os poços são testemunhados. As estimativas da permeabilidade e da porosidade são de fundamental importância para os engenheiros de reservatório e geofísicos, uma vez que seus valores podem definir a completação ou não de um poço petrolífero. O perfil de porosidade e sua relação com o perfil de densidade, é bem conhecida na geofísica de poço. No entanto, existem poucas relações quantitativas e/ou qualitativas entre a porosidade e a permeabilidade, como por exemplo as relações de Kozeny. Sendo assim, este trabalho busca o estabelecimento do perfil de permeabilidade e do perfil de porosidade, a partir de informações do perfil de densidade. Para tanto, buscamos a relação entre a propriedade física da rocha (densidade) e as propriedades petrofísicas: permeabilidade e porosidade, utilizando como metodologia à técnica de redes neurais artificiais, como a rede neural artificial com função de base radial. A obtenção da permeabilidade e da porosidade a partir da rede neural artificial, que possui como entrada a informação da densidade possibilita um menor custo para a aquisição dessas importantes informações petrofísicas, permite ao intérprete de perfis de poço optar ou não pela exploração de uma unidade estudada, além de uma visão mais completa do reservatório. Os procedimentos para a estimativa da permeabilidade e da porosidade estão direcionados para uma única formação, mas os intérpretes de perfis poderão aplicar a diretriz apresentada no programa de rede neural artificial com função de base radial, utilizando a estimativa dessas propriedades petrofísicas para outras formações, inclusive de outros campos petrolíferos. Portanto, recomenda-se a utilização de um conjunto de dados completo, com quantidade de dados suficientes de um mesmo poço, a fim de viabilizar corretamente a melhor interpretação.

Artificial neural network associated to UV/Vis spectroscopy for monitoring bioreactions in biopharmaceutical processes

Currently, mammalian cells are the most utilized hosts for biopharmaceutical production. The culture media for these cell lines include commonly in their composition a pH indicator. Spectroscopic techniques are used for biopharmaceutical process monitoring, among them, UV–Vis spectroscopy has found scarce applications. This work aimed to define artificial neural networks architecture and fit its parameters to predict some nutrients and metabolites, as well as viable cell concentration based on UV–Vis spectral data of mammalian cell bioprocess using phenol red in culture medium. The BHK-21 cell line was used as a mammalian cell model. Off-line spectra of supernatant samples taken from batches performed at different dissolved oxygen concentrations in two bioreactor configurations and with two pH control strategies were used to define two artificial neural networks. According to absolute errors, glutamine (0.13 ± 0.14 mM), glutamate (0.02 ± 0.02 mM), glucose (1.11 ± 1.70 mM), lactate (0.84 ± 0.68 mM) and viable cell concentrations (1.89 105 ± 1.90 105 cell/mL) were suitably predicted. The prediction error averages for monitored variables were lower than those previously reported using different spectroscopic techniques in combination with partial least squares or artificial neural network. The present work allows for UV–VIS sensor development, and decreases cost related to nutrients and metabolite quantifications.

Hybrid Water Demand Forecasting Model Associating Artificial Neural Network with Fourier Series

This paper addressed the problem of water-demand forecasting for real-time operation of water supply systems. The present study was conducted to identify the best fit model using hourly consumption data from the water supply system of Araraquara, Sa approximate to o Paulo, Brazil. Artificial neural networks (ANNs) were used in view of their enhanced capability to match or even improve on the regression model forecasts. The ANNs used were the multilayer perceptron with the back-propagation algorithm (MLP-BP), the dynamic neural network (DAN2), and two hybrid ANNs. The hybrid models used the error produced by the Fourier series forecasting as input to the MLP-BP and DAN2, called ANN-H and DAN2-H, respectively. The tested inputs for the neural network were selected literature and correlation analysis. The results from the hybrid models were promising, DAN2 performing better than the tested MLP-BP models. DAN2-H, identified as the best model, produced a mean absolute error (MAE) of 3.3 L/s and 2.8 L/s for training and test set, respectively, for the prediction of the next hour, which represented about 12% of the average consumption. The best forecasting model for the next 24 hours was again DAN2-H, which outperformed other compared models, and produced a MAE of 3.1 L/s and 3.0 L/s for training and test set respectively, which represented about 12% of average consumption. DOI: 10.1061/(ASCE)WR.1943-5452.0000177. (C) 2012 American Society of Civil Engineers.

Neural Networks as Cybernetic Systems

This book on biological cybernetics combines system theory and artificial neural networks. Following a 'holistic' approach, the book examines the role of simulation in biology. Mainly addressed to students of Biology, the book tries to avoid the use of mathematical formula as far as possible. Exercises can be performed with a related software tool (tkCybernetics) for part 1 as well as with educational simulation on neural networks for part two (in prepration.)

Neural Networks as Cybernetic Systems - 3rd and revised edition

This third edition essentially compares with the 2nd one, but has been improved by correction of errors and by a rearrangement and minor expansion of the sections referring to recurrent networks. These changes hopefully allow for an easier comprehension of the essential aspects of this important domain that has received growing attention during the last years.

On the Biological Plausibility of Artificial Metaplasticity

The training algorithm studied in this paper is inspired by the biological metaplasticity property of neurons. Tested on different multidisciplinary applications, it achieves a more efficient training and improves Artificial Neural Network Performance. The algorithm has been recently proposed for Artificial Neural Networks in general, although for the purpose of discussing its biological plausibility, a Multilayer Perceptron has been used. During the training phase, the artificial metaplasticity multilayer perceptron could be considered a new probabilistic version of the presynaptic rule, as during the training phase the algorithm assigns higher values for updating the weights in the less probable activations than in the ones with higher probability

Glucose-Insulin regulator for type 1 diabetes using high order neural networks

In this paper a Glucose-Insulin regulator for Type 1 Diabetes using artificial neural networks (ANN) is proposed. This is done using a discrete recurrent high order neural network in order to identify and control a nonlinear dynamical system which represents the pancreas? beta-cells behavior of a virtual patient. The ANN which reproduces and identifies the dynamical behavior system, is configured as series parallel and trained on line using the extended Kalman filter algorithm to achieve a quickly convergence identification in silico. The control objective is to regulate the glucose-insulin level under different glucose inputs and is based on a nonlinear neural block control law. A safety block is included between the control output signal and the virtual patient with type 1 diabetes mellitus. Simulations include a period of three days. Simulation results are compared during the overnight fasting period in Open-Loop (OL) versus Closed- Loop (CL). Tests in Semi-Closed-Loop (SCL) are made feedforward in order to give information to the control algorithm. We conclude the controller is able to drive the glucose to target in overnight periods and the feedforward is necessary to control the postprandial period.

Aplicação de uma rede neural artificial para a avaliação da rugosidade e soprosidade vocal

A avaliação perceptivo-auditiva tem papel fundamental no estudo e na avaliação da voz, no entanto, por ser subjetiva está sujeita a imprecisões e variações. Por outro lado, a análise acústica permite a reprodutibilidade de resultados, porém precisa ser aprimorada, pois não analisa com precisão vozes com disfonias mais intensas e com ondas caóticas. Assim, elaborar medidas que proporcionem conhecimentos confiáveis em relação à função vocal resulta de uma necessidade antiga dentro desta linha de pesquisa e atuação clínica. Neste contexto, o uso da inteligência artificial, como as redes neurais artificiais, indica ser uma abordagem promissora. Objetivo: Validar um sistema automático utilizando redes neurais artificiais para a avaliação de vozes rugosas e soprosas. Materiais e métodos: Foram selecionadas 150 vozes, desde neutras até com presença em grau intenso de rugosidade e/ou soprosidade, do banco de dados da Clínica de Fonoaudiologia da Faculdade de Odontologia de Bauru (FOB/USP). Dessas vozes, 23 foram excluídas por não responderem aos critérios de inclusão na amostra, assim utilizaram-se 123 vozes. Procedimentos: avaliação perceptivo-auditiva pela escala visual analógica de 100 mm e pela escala numérica de quatro pontos; extração de características do sinal de voz por meio da Transformada Wavelet Packet e dos parâmetros acústicos: jitter, shimmer, amplitude da derivada e amplitude do pitch; e validação do classificador por meio da parametrização, treino, teste e avaliação das redes neurais artificiais. Resultados: Na avaliação perceptivo-auditiva encontrou-se, por meio do teste Coeficiente de Correlação Intraclasse (CCI), concordâncias inter e intrajuiz excelentes, com p = 0,85 na concordância interjuízes e p variando de 0,87 a 0,93 nas concordâncias intrajuiz. Em relação ao desempenho da rede neural artificial, na discriminação da soprosidade e da rugosidade e dos seus respectivos graus, encontrou-se o melhor desempenho para a soprosidade no subconjunto composto pelo jitter, amplitude do pitch e frequência fundamental, no qual obteve-se taxa de acerto de 74%, concordância excelente com a avaliação perceptivo-auditiva da escala visual analógica (0,80 no CCI) e erro médio de 9 mm. Para a rugosidade, o melhor subconjunto foi composto pela Transformada Wavelet Packet com 1 nível de decomposição, jitter, shimmer, amplitude do pitch e frequência fundamental, no qual obteve-se 73% de acerto, concordância excelente (0,84 no CCI), e erro médio de 10 mm. Conclusão: O uso da inteligência artificial baseado em redes neurais artificiais na identificação, e graduação da rugosidade e da soprosidade, apresentou confiabilidade excelente (CCI > 0,80), com resultados semelhantes a concordância interjuízes. Dessa forma, a rede neural artificial revela-se como uma metodologia promissora de avaliação vocal, tendo sua maior vantagem a objetividade na avaliação.