Análise de desempenho da rede neural artificial do tipo multilayer perceptron na era multicore

Artificial neural networks are usually applied to solve complex problems. In problems with more complexity, by increasing the number of layers and neurons, it is possible to achieve greater functional efficiency. Nevertheless, this leads to a greater computational effort. The response time is an important factor in the decision to use neural networks in some systems. Many argue that the computational cost is higher in the training period. However, this phase is held only once. Once the network trained, it is necessary to use the existing computational resources efficiently. In the multicore era, the problem boils down to efficient use of all available processing cores. However, it is necessary to consider the overhead of parallel computing. In this sense, this paper proposes a modular structure that proved to be more suitable for parallel implementations. It is proposed to parallelize the feedforward process of an RNA-type MLP, implemented with OpenMP on a shared memory computer architecture. The research consistes on testing and analizing execution times. Speedup, efficiency and parallel scalability are analyzed. In the proposed approach, by reducing the number of connections between remote neurons, the response time of the network decreases and, consequently, so does the total execution time. The time required for communication and synchronization is directly linked to the number of remote neurons in the network, and so it is necessary to investigate which one is the best distribution of remote connections

Implementação de uma matriz de neurônios dinamicamente reconfigurável para descrição de topologias de redes neurais artificiais multilayer perceptrons

The Artificial Neural Networks (ANN), which is one of the branches of Artificial Intelligence (AI), are being employed as a solution to many complex problems existing in several areas. To solve these problems, it is essential that its implementation is done in hardware. Among the strategies to be adopted and met during the design phase and implementation of RNAs in hardware, connections between neurons are the ones that need more attention. Recently, are RNAs implemented both in application specific integrated circuits's (Application Specific Integrated Circuits - ASIC) and in integrated circuits configured by the user, like the Field Programmable Gate Array (FPGA), which have the ability to be partially rewritten, at runtime, forming thus a system Partially Reconfigurable (SPR), the use of which provides several advantages, such as flexibility in implementation and cost reduction. It has been noted a considerable increase in the use of FPGAs for implementing ANNs. Given the above, it is proposed to implement an array of reconfigurable neurons for topologies Description of artificial neural network multilayer perceptrons (MLPs) in FPGA, in order to encourage feedback and reuse of neural processors (perceptrons) used in the same area of the circuit. It is further proposed, a communication network capable of performing the reuse of artificial neurons. The architecture of the proposed system will configure various topologies MLPs networks through partial reconfiguration of the FPGA. To allow this flexibility RNAs settings, a set of digital components (datapath), and a controller were developed to execute instructions that define each topology for MLP neural network.

Implementação de uma matriz de neurônios dinamicamente reconfigurável para descrição de topologias de redes neurais artificiais multilayer perceptrons

The Artificial Neural Networks (ANN), which is one of the branches of Artificial Intelligence (AI), are being employed as a solution to many complex problems existing in several areas. To solve these problems, it is essential that its implementation is done in hardware. Among the strategies to be adopted and met during the design phase and implementation of RNAs in hardware, connections between neurons are the ones that need more attention. Recently, are RNAs implemented both in application specific integrated circuits's (Application Specific Integrated Circuits - ASIC) and in integrated circuits configured by the user, like the Field Programmable Gate Array (FPGA), which have the ability to be partially rewritten, at runtime, forming thus a system Partially Reconfigurable (SPR), the use of which provides several advantages, such as flexibility in implementation and cost reduction. It has been noted a considerable increase in the use of FPGAs for implementing ANNs. Given the above, it is proposed to implement an array of reconfigurable neurons for topologies Description of artificial neural network multilayer perceptrons (MLPs) in FPGA, in order to encourage feedback and reuse of neural processors (perceptrons) used in the same area of the circuit. It is further proposed, a communication network capable of performing the reuse of artificial neurons. The architecture of the proposed system will configure various topologies MLPs networks through partial reconfiguration of the FPGA. To allow this flexibility RNAs settings, a set of digital components (datapath), and a controller were developed to execute instructions that define each topology for MLP neural network.

Sistema inteligente para estimar a porosidade em sedimentos a partir da análise de sinais GPR

This Thesis presents the elaboration of a methodological propose for the development of an intelligent system, able to automatically achieve the effective porosity, in sedimentary layers, from a data bank built with information from the Ground Penetrating Radar GPR. The intelligent system was built to model the relation between the porosity (response variable) and the electromagnetic attribute from the GPR (explicative variables). Using it, the porosity was estimated using the artificial neural network (Multilayer Perceptron MLP) and the multiple linear regression. The data from the response variable and from the explicative variables were achieved in laboratory and in GPR surveys outlined in controlled sites, on site and in laboratory. The proposed intelligent system has the capacity of estimating the porosity from any available data bank, which has the same variables used in this Thesis. The architecture of the neural network used can be modified according to the existing necessity, adapting to the available data bank. The use of the multiple linear regression model allowed the identification and quantification of the influence (level of effect) from each explicative variable in the estimation of the porosity. The proposed methodology can revolutionize the use of the GPR, not only for the imaging of the sedimentary geometry and faces, but mainly for the automatically achievement of the porosity one of the most important parameters for the characterization of reservoir rocks (from petroleum or water)

Emprego de redes neurais artificiais supervisionadas e não supervisionadas no estudo de parâmetros reológicos de excipientes farmacêuticos sólidos

In this paper artificial neural network (ANN) based on supervised and unsupervised algorithms were investigated for use in the study of rheological parameters of solid pharmaceutical excipients, in order to develop computational tools for manufacturing solid dosage forms. Among four supervised neural networks investigated, the best learning performance was achieved by a feedfoward multilayer perceptron whose architectures was composed by eight neurons in the input layer, sixteen neurons in the hidden layer and one neuron in the output layer. Learning and predictive performance relative to repose angle was poor while to Carr index and Hausner ratio (CI and HR, respectively) showed very good fitting capacity and learning, therefore HR and CI were considered suitable descriptors for the next stage of development of supervised ANNs. Clustering capacity was evaluated for five unsupervised strategies. Network based on purely unsupervised competitive strategies, classic "Winner-Take-All", "Frequency-Sensitive Competitive Learning" and "Rival-Penalize Competitive Learning" (WTA, FSCL and RPCL, respectively) were able to perform clustering from database, however this classification was very poor, showing severe classification errors by grouping data with conflicting properties into the same cluster or even the same neuron. On the other hand it could not be established what was the criteria adopted by the neural network for those clustering. Self-Organizing Maps (SOM) and Neural Gas (NG) networks showed better clustering capacity. Both have recognized the two major groupings of data corresponding to lactose (LAC) and cellulose (CEL). However, SOM showed some errors in classify data from minority excipients, magnesium stearate (EMG) , talc (TLC) and attapulgite (ATP). NG network in turn performed a very consistent classification of data and solve the misclassification of SOM, being the most appropriate network for classifying data of the study. The use of NG network in pharmaceutical technology was still unpublished. NG therefore has great potential for use in the development of software for use in automated classification systems of pharmaceutical powders and as a new tool for mining and clustering data in drug development

Técnicas de inteligência artificial para a geração dinâmica de set points para uma coluna de destilação

Artificial Intelligence techniques are applied to improve performance of a simulated oil distillation system. The chosen system was a debutanizer column. At this process, the feed, which comes to the column, is segmented by heating. The lightest components become steams, by forming the LPG (Liquefied Petroleum Gas). The others components, C5+, continue liquid. In the composition of the LPG, ideally, we have only propane and butanes, but, in practice, there are contaminants, for example, pentanes. The objective of this work is to control pentane amount in LPG, by means of intelligent set points (SP s) determination for PID controllers that are present in original instrumentation (regulatory control) of the column. A fuzzy system will be responsible for adjusting the SP's, driven by the comparison between the molar fraction of the pentane present in the output of the plant (LPG) and the desired amount. However, the molar fraction of pentane is difficult to measure on-line, due to constraints such as: long intervals of measurement, high reliability and low cost. Therefore, an inference system was used, based on a multilayer neural network, to infer the pentane molar fraction through secondary variables of the column. Finally, the results shown that the proposed control system were able to control the value of pentane molar fraction under different operational situations

Análise neurocomputacional de Antenas de microfita multibanda para sistemas de comunicação sem fio

This work presents a study of implementation procedures for multiband microstrip patch antennas characterization, using on wireless communication systems. An artificial neural network multilayer perceptron is used to locate the bands of operational frequencies of the antenna for different geometrics configurations. The antenna is projected, simulated and tested in laboratory. The results obtained are compared in order to validate the performance of archetypes that resulted in a good one agreement in metric terms. The neurocomputationals procedures developed can be extended to other electromagnetic structures of wireless communications systems

Contribuições à análise de robustez de sistemas de controle usando redes neurais

This work develops a robustness analysis with respect to the modeling errors, being applied to the strategies of indirect control using Artificial Neural Networks - ANN s, belong to the multilayer feedforward perceptron class with on-line training based on gradient method (backpropagation). The presented schemes are called Indirect Hybrid Control and Indirect Neural Control. They are presented two Robustness Theorems, being one for each proposed indirect control scheme, which allow the computation of the maximum steady-state control error that will occur due to the modeling error what is caused by the neural identifier, either for the closed loop configuration having a conventional controller - Indirect Hybrid Control, or for the closed loop configuration having a neural controller - Indirect Neural Control. Considering that the robustness analysis is restrict only to the steady-state plant behavior, this work also includes a stability analysis transcription that is suitable for multilayer perceptron class of ANN s trained with backpropagation algorithm, to assure the convergence and stability of the used neural systems. By other side, the boundness of the initial transient behavior is assured by the assumption that the plant is BIBO (Bounded Input, Bounded Output) stable. The Robustness Theorems were tested on the proposed indirect control strategies, while applied to regulation control of simulated examples using nonlinear plants, and its results are presented

Detecção e isolamento de falhas em sistemas dinâmicos baseados em redes neurais

This master dissertation presents the development of a fault detection and isolation system based in neural network. The system is composed of two parts: an identification subsystem and a classification subsystem. Both of the subsystems use neural network techniques with multilayer perceptron training algorithm. Two approaches for identifica-tion stage were analyzed. The fault classifier uses only residue signals from the identification subsystem. To validate the proposal we have done simulation and real experiments in a level system with two water reservoirs. Several faults were generated above this plant and the proposed fault detection system presented very acceptable behavior. In the end of this work we highlight the main difficulties found in real tests that do not exist when it works only with simulation environments

Algoritmos inteligentes para auto-correção, auto-verificação e auto-validação de medidas em sensores

This work presents a set of intelligent algorithms with the purpose of correcting calibration errors in sensors and reducting the periodicity of their calibrations. Such algorithms were designed using Artificial Neural Networks due to its great capacity of learning, adaptation and function approximation. Two approaches willbe shown, the firstone uses Multilayer Perceptron Networks to approximate the many shapes of the calibration curve of a sensor which discalibrates in different time points. This approach requires the knowledge of the sensor s functioning time, but this information is not always available. To overcome this need, another approach using Recurrent Neural Networks was proposed. The Recurrent Neural Networks have a great capacity of learning the dynamics of a system to which it was trained, so they can learn the dynamics of a sensor s discalibration. Knowingthe sensor s functioning time or its discalibration dynamics, it is possible to determine how much a sensor is discalibrated and correct its measured value, providing then, a more exact measurement. The algorithms proposed in this work can be implemented in a Foundation Fieldbus industrial network environment, which has a good capacity of device programming through its function blocks, making it possible to have them applied to the measurement process

Estudo do acoplamento entre superfícies seletivas de frequência assimétricas em estruturas de multicamadas

This work presents the development of new microwaves structures, filters and high gain antenna, through the cascading of frequency selective surfaces, which uses fractals Dürer and Minkowski patches as elements, addition of an element obtained from the combination of the other two simple the cross dipole and the square spiral. Frequency selective surfaces (FSS) includes a large area of Telecommunications and have been widely used due to its low cost, low weight and ability to integrate with others microwaves circuits. They re especially important in several applications, such as airplane, antennas systems, radomes, rockets, missiles, etc. FSS applications in high frequency ranges have been investigated, as well as applications of cascading structures or multi-layer, and active FSS. In this work, we present results for simulated and measured transmission characteristics of cascaded structures (multilayer), aiming to investigate the behavior of the operation in terms of bandwidth, one of the major problems presented by frequency selective surfaces. Comparisons are made with simulated results, obtained using commercial software such as Ansoft DesignerTM v3 and measured results in the laboratory. Finally, some suggestions are presented for future works on this subject

Desenvolvimento de um ressoador retangular de fenda com múltiplas camadas de substrato e com utilização de material PBG para sistema de comunicação sem fio

In the globalized world modern telecommunications have assumed key role within the company, causing a large increase in demand for the wireless technology of communication, which has been happening in recent years have greatly increased the number of applications using this technology. Due to this demand, new materials are developed to enable new control mechanisms and propagation of electromagnetic waves. The research to develop new technologies for wireless communication presents a multidisciplinary study that covers from the new geometries for passive antennas, active up to the development of materials for devices that improve the performance at the frequency range of operation. Recently, planar antennas have attracted interest due to their characteristics and advantages when compared with other types of antennas. In the area of mobile communications the need for antennas of this type has become increasingly used, due to intensive development, which needs to operate in multifrequency antennas and broadband. The microstrip antennas have narrow bandwidth due to the dielectric losses generated by irradiation. Another limitation is the degradation of the radiation pattern due to the generation of surface waves in the substrate. Some techniques have been developed to minimize this limitation of bandwidth, such as the study of type materials PBG - Photonic Band Gap, to form the dielectric material. This work has as main objective the development project of a slot resonator with multiple layers and use the type PBG substrate, which carried out the optimization from the numerical analysis and then designed the device initially proposed for the band electromagnetic spectrum between 3-9 GHz, which basically includes the band S to X. Was used as the dielectric material RT/Duroid 5870 and RT/Duroid 6010.LM where both are laminated ceramic-filled PTFE dielectric constants 2.33 and 10.2, respectively. Through an experimental investigation was conducted an analysis of the simulated versus measured by observing the behavior of the radiation characteristics from the height variation of the dielectric multilayer substrates. We also used the LTT method resonators structures rectangular slot with multiple layers of material photonic PBG in order to obtain the resonance frequency and the entire theory involving the electromagnetic parameters of the structure under consideration. xviii The analysis developed in this work was performed using the method LTT - Transverse Transmission Line, in the field of Fourier transform that uses a component propagating in the y direction (transverse to the real direction of propagation z), thus treating the general equations of the fields electric and magnetic and function. The PBG theory is applied to obtain the relative permittivity of the polarizations for the sep photonic composite substrates material. The results are obtained with the commercial software Ansoft HFSS, used for accurate analysis of the electromagnetic behavior of the planar device under study through the Finite Element Method (FEM). Numerical computational results are presented in graphical form in two and three dimensions, playing in the parameters of return loss, frequency of radiation and radiation diagram, radiation efficiency and surface current for the device under study, and have as substrates, photonic materials and had been simulated in an appropriate computational tool. With respect to the planar device design study are presented in the simulated and measured results that show good agreement with measurements made. These results are mainly in the identification of resonance modes and determining the characteristics of the designed device, such as resonant frequency, return loss and radiation pattern

Bianisotropia uniaxial em estruturas irradiantes com multicamadas e supercondutores

This work presents a theoretical and numerical analysis of parameters of a rectangular microstrip antenna with bianisotropic substrate, and including simultaneously the superconducting patch. The full-wave Transverse Transmission Line - TTL method, is used to characterize these antennas. The bianisotropic substrate is characterized by the permittivity and permeability tensors, and the TTL gives the general equations of the electromagnetic fields of the antennas. The BCS theory and the two fluids model are applied to superconductors in these antennas with bianisotropic for first time. The inclusion of superconducting patch is made using the complex resistive boundary condition. The resonance complex frequency is then obtained. Are simulated some parameters of antennas in order to reduce the physical size, and increase the its bandwidth. The numerical results are presented through of graphs. The theoretical and computational analysis these works are precise and concise. Conclusions and suggestions for future works are presented

Otimização de superfícies seletivas de frequência com elementos pré-fractais utilizando rede neural MLP e algoritmos de busca populacional

This thesis describes design methodologies for frequency selective surfaces (FSSs) composed of periodic arrays of pre-fractals metallic patches on single-layer dielectrics (FR4, RT/duroid). Shapes presented by Sierpinski island and T fractal geometries are exploited to the simple design of efficient band-stop spatial filters with applications in the range of microwaves. Initial results are discussed in terms of the electromagnetic effect resulting from the variation of parameters such as, fractal iteration number (or fractal level), fractal iteration factor, and periodicity of FSS, depending on the used pre-fractal element (Sierpinski island or T fractal). The transmission properties of these proposed periodic arrays are investigated through simulations performed by Ansoft DesignerTM and Ansoft HFSSTM commercial softwares that run full-wave methods. To validate the employed methodology, FSS prototypes are selected for fabrication and measurement. The obtained results point to interesting features for FSS spatial filters: compactness, with high values of frequency compression factor; as well as stable frequency responses at oblique incidence of plane waves. This thesis also approaches, as it main focus, the application of an alternative electromagnetic (EM) optimization technique for analysis and synthesis of FSSs with fractal motifs. In application examples of this technique, Vicsek and Sierpinski pre-fractal elements are used in the optimal design of FSS structures. Based on computational intelligence tools, the proposed technique overcomes the high computational cost associated to the full-wave parametric analyzes. To this end, fast and accurate multilayer perceptron (MLP) neural network models are developed using different parameters as design input variables. These neural network models aim to calculate the cost function in the iterations of population-based search algorithms. Continuous genetic algorithm (GA), particle swarm optimization (PSO), and bees algorithm (BA) are used for FSSs optimization with specific resonant frequency and bandwidth. The performance of these algorithms is compared in terms of computational cost and numerical convergence. Consistent results can be verified by the excellent agreement obtained between simulations and measurements related to FSS prototypes built with a given fractal iteration

Antenas planares multicamadas com materiais supercondutores e fotônico para comunicações móveis

Recently, planar antennas have been studied due to their characteristics as well as the advantages that they offers when compared with another types of antennas. In the mobile communications area, the need for this kind of antennas have became each time bigger due to the intense increase of the mobile communications this sector. That needs of antennas which operate in multifrequency and wide bandwidth. The microstrip antennas presents narrow bandwidth due the loss in the dielectric generated by radiation. Another limitation is the radiation pattern degradation due the generation of surface waves in the substrate. In this work some used techniques to minimize the disadvantages (previously mentioned) of the use of microstrip antennas are presented, those are: substrates with PBG material - Photonic Bandgap, multilayer antennas and with stacked patches. The developed analysis in this work used the TTL - Transverse Transmission Line method in the domain of Fourier transform, that uses a component of propagation in the y direction (transverse to the direction real of propagation z), treating the general equations of electric and magnetic field as functions of Ey and Hy. One of the advantages of this method is the simplification of the field equations. therefore the amount of equations lesser must the fields in directions x and z be in function of components Ey and Hy. It will be presented an brief study of the main theories that explain the superconductivity phenomenon. The BCS theory. London Equations and Two Fluids model will be the theories that will give support the application of the superconductors in the microfita antennas. The inclusion of the superconductor patch is made using the resistive complex contour condition. This work has as objective the application of the TTL method to microstrip structures with single and multilayers of rectangular patches, to obtaining the resonance frequency and radiation pattern of each structure