Uma implementação paralela híbrida para o problema do caixeiro viajante usando algoritmos genéticos, GRASP e aprendizagem por reforço

The metaheuristics techiniques are known to solve optimization problems classified as NP-complete and are successful in obtaining good quality solutions. They use non-deterministic approaches to generate solutions that are close to the optimal, without the guarantee of finding the global optimum. Motivated by the difficulties in the resolution of these problems, this work proposes the development of parallel hybrid methods using the reinforcement learning, the metaheuristics GRASP and Genetic Algorithms. With the use of these techniques, we aim to contribute to improved efficiency in obtaining efficient solutions. In this case, instead of using the Q-learning algorithm by reinforcement learning, just as a technique for generating the initial solutions of metaheuristics, we use it in a cooperative and competitive approach with the Genetic Algorithm and GRASP, in an parallel implementation. In this context, was possible to verify that the implementations in this study showed satisfactory results, in both strategies, that is, in cooperation and competition between them and the cooperation and competition between groups. In some instances were found the global optimum, in others theses implementations reach close to it. In this sense was an analyze of the performance for this proposed approach was done and it shows a good performance on the requeriments that prove the efficiency and speedup (gain in speed with the parallel processing) of the implementations performed

Bianisotropia uniaxial em estruturas irradiantes com multicamadas e supercondutores

This work presents a theoretical and numerical analysis of parameters of a rectangular microstrip antenna with bianisotropic substrate, and including simultaneously the superconducting patch. The full-wave Transverse Transmission Line - TTL method, is used to characterize these antennas. The bianisotropic substrate is characterized by the permittivity and permeability tensors, and the TTL gives the general equations of the electromagnetic fields of the antennas. The BCS theory and the two fluids model are applied to superconductors in these antennas with bianisotropic for first time. The inclusion of superconducting patch is made using the complex resistive boundary condition. The resonance complex frequency is then obtained. Are simulated some parameters of antennas in order to reduce the physical size, and increase the its bandwidth. The numerical results are presented through of graphs. The theoretical and computational analysis these works are precise and concise. Conclusions and suggestions for future works are presented

Um estudo de estruturas com PBG e fotônica

One of the objectives of this work is the ana1ysis of planar structures using the PBG (photonic Bandgap), a new method of controlling propagation of electromagnetic waves in devices with dielectrics. Here the basic theory of these structures will be presented, as well as applications and determination of certain parameters. In this work the analysis will be performed concerning PBG structures, including the basic theory and applications in planar structures. Considerations are made related to the implementation of devices. Here the TTL (Transverse Transmission Line) method is employed, characterized by the simplicity in the treatment of the equations that govern the propagation of electromagnetic waves in the structure. In this method, the fields in x and z are expressed in function of the fields in the traverse direction y in FTD (Fourier Transform Domain). This method is useful in the determination of the complex propagation constant with application in high frequency and photonics. In this work structures will be approached in micrometric scale operating in frequencies in the range of T erahertz, a first step for operation in the visible spectra. The mathematical basis are approached for the determination of the electromagnetic fields in the structure, based on the method L TT taking into account the dimensions approached in this work. Calculations for the determination of the constant of complex propagation are also carried out. The computational implementation is presented for high frequencies. at the first time the analysis is done with base in open microstrip lines with semiconductor substrate. Finally, considerations are made regarding applications ofthese devices in the area of telecommunications, and suggestions for future

Uma contribuição à solução do problema dos k-servos usando aprendizagem por reforço

Neste trabalho é proposto um novo algoritmo online para o resolver o Problema dos k-Servos (PKS). O desempenho desta solução é comparado com o de outros algoritmos existentes na literatura, a saber, os algoritmos Harmonic e Work Function, que mostraram ser competitivos, tornando-os parâmetros de comparação significativos. Um algoritmo que apresente desempenho eficiente em relação aos mesmos tende a ser competitivo também, devendo, obviamente, se provar o referido fato. Tal prova, entretanto, foge aos objetivos do presente trabalho. O algoritmo apresentado para a solução do PKS é baseado em técnicas de aprendizagem por reforço. Para tanto, o problema foi modelado como um processo de decisão em múltiplas etapas, ao qual é aplicado o algoritmo Q-Learning, um dos métodos de solução mais populares para o estabelecimento de políticas ótimas neste tipo de problema de decisão. Entretanto, deve-se observar que a dimensão da estrutura de armazenamento utilizada pela aprendizagem por reforço para se obter a política ótima cresce em função do número de estados e de ações, que por sua vez é proporcional ao número n de nós e k de servos. Ao se analisar esse crescimento (matematicamente, ) percebe-se que o mesmo ocorre de maneira exponencial, limitando a aplicação do método a problemas de menor porte, onde o número de nós e de servos é reduzido. Este problema, denominado maldição da dimensionalidade, foi introduzido por Belmann e implica na impossibilidade de execução de um algoritmo para certas instâncias de um problema pelo esgotamento de recursos computacionais para obtenção de sua saída. De modo a evitar que a solução proposta, baseada exclusivamente na aprendizagem por reforço, seja restrita a aplicações de menor porte, propõe-se uma solução alternativa para problemas mais realistas, que envolvam um número maior de nós e de servos. Esta solução alternativa é hierarquizada e utiliza dois métodos de solução do PKS: a aprendizagem por reforço, aplicada a um número reduzido de nós obtidos a partir de um processo de agregação, e um método guloso, aplicado aos subconjuntos de nós resultantes do processo de agregação, onde o critério de escolha do agendamento dos servos é baseado na menor distância ao local de demanda

Análise do espalhamento espectral em superfícies de estruturas complexas para comunicações móveis

In this work, the transmission line method is explored on the study of the propagation phenomenon in nonhomogeneous walls with finite thickness. It is evaluated the efficiency and applicability of the method, considering materials like gypsum, wood and brick, found in the composition of the structures of walls in question. The results obtained in this work are compared to those available in the literature, for several particular cases. A good agreement is observed, showing that the performed analysis is accurate and efficient in modeling, for instance, the wave propagation through building walls and integrated circuit layers in mobile communication and radar system applications. Later, simulations of resistive sheets devices such as Salisbury screens and Jaumann absorbers and of transmission lines made of metal-insulator-semiconductor (MIS) are made. Thereafter, it is described a study on frequency surface selective structures (FSS). It is proposed the development of devices and microwave integrated circuits (MIC) of such structures, for the accomplishment of experiments. Finally, future works are suggested, for instance, on the development of reflectarrays, frequency selective surfaces with dissimilar elements, and coupled frequency selective surfaces with elements located on different layers

Aplicação do método LTT às estruturas retangulares e triangulares em multicamadas e empilhadas em substratos PBG para comunicações móveis

Recently the planar antennas have been studied due to their characteristics as well as the advantages that they offers when compared with another types of antennas. In the mobile communications area, the need for this kind of antennas have became each time bigger due to the intense increase of the mobile communications that needs of antennas which operate in multifrequency and wide bandwidth. The microstrip antennas presents narrow bandwidth due the loss in the dielectric generated by radiation. Another limitation is the radiation pattern degradation due the generation of surface waves in the substrate. In this work some used techniques to minimize the disadvantages (previously mentioned) of the use of microstrip antennas are presented, those are: substrates with PBG material - Photonic Bandgap, multilayer antennas and with stacked patches. The developed analysis in this work used the TTL - Transverse Transmission Line method in the domain of Fourier transform, that uses a component of propagation in the y direction (transverse to the direction real of propagation z), treating the general equations of electric and magnetic field as functions of y and y . This work has as objective the application of the TTL method to microstrip structures with single and multilayers of rectangular and triangular patches, to obtaining the resonance frequency and radiation pattern of each structure. This method is applied for the treatment of the fields in stacked structures. The Homogenization theory will be applied to obtaining the effective permittivity for s and p polarizations of the substrate composed of PBG material. Numerical results for the triangular and rectangular antennas with single layer, multilayers resonators with triangular and rectangular patches are presented (in photonic and isotropic substrates). Conclusions and suggestions for continuity of this work are presented

Classificação de padrões através de um comitê de máquinas aprimorado por aprendizagem por reforço

Reinforcement learning is a machine learning technique that, although finding a large number of applications, maybe is yet to reach its full potential. One of the inadequately tested possibilities is the use of reinforcement learning in combination with other methods for the solution of pattern classification problems. It is well documented in the literature the problems that support vector machine ensembles face in terms of generalization capacity. Algorithms such as Adaboost do not deal appropriately with the imbalances that arise in those situations. Several alternatives have been proposed, with varying degrees of success. This dissertation presents a new approach to building committees of support vector machines. The presented algorithm combines Adaboost algorithm with a layer of reinforcement learning to adjust committee parameters in order to avoid that imbalances on the committee components affect the generalization performance of the final hypothesis. Comparisons were made with ensembles using and not using the reinforcement learning layer, testing benchmark data sets widely known in area of pattern classification

Roteamento em Redes de Sensores Sem Fios Com Base Em Aprendizagem Por Reforço

The use of wireless sensor and actuator networks in industry has been increasing past few years, bringing multiple benefits compared to wired systems, like network flexibility and manageability. Such networks consists of a possibly large number of small and autonomous sensor and actuator devices with wireless communication capabilities. The data collected by sensors are sent directly or through intermediary nodes along the network to a base station called sink node. The data routing in this environment is an essential matter since it is strictly bounded to the energy efficiency, thus the network lifetime. This work investigates the application of a routing technique based on Reinforcement Learning s Q-Learning algorithm to a wireless sensor network by using an NS-2 simulated environment. Several metrics like energy consumption, data packet delivery rates and delays are used to validate de proposal comparing it with another solutions existing in the literature

Obtenção dos parâmetros-x de estruturas planares

Due to major progress of communication system in the last decades, need for more precise characterization of used components. The S-parameters modeling has been used to characterization, simulation and test of communication system. However, limitation of S-parameters to model nonlinear system has created new modeling systems that include the nonlinear characteristics. The polyharmonic distortion modeling is a characterizationg technique for nonlinear systems that has been growing up due to praticity and similarity with S-parameters. This work presents analysis the polyharmonic distortion modeling, the test bench development for simulation of planar structure and planar structure characterization with X-parameters

Capacidade de absorção de energia de tubos de compósitos submetidos à compressão

Structures capable of absorbing large amounts of energy are of great interest, particularly for the automotive and aviation industries, to reduce tbe impact on passengers in the case of a collision. The energy absorption properties of composite materials structures can be tailored, thus making these structures an appealing option a substitute of more traditional structures in applications where energy absorption is crucial. ln this research, the influence of some parameters, which affect the energy absorption capacity of composite material tubes, was investigated. The tubes were fabricated by hand lay-up, using orthophthalic polyester resin and a plain weave E-glass fabric Test specimens were prepared and tested under compression load. The ínfluence of the following parameters on the specific energy absorption capacity of the tubes was studied: fiber configuration (0/90º or ± 45°), tube cross-section (circular or square), and processing conditions (with or without vacuum). The results indicated that circular cross-section tubes with fibers oriented at 0/90º presented the highest level of specific energy absorbed. Further, specimens from tubes fabricated under vacuum displayed higher energy absorption capacity, when compared with specimens from tubes fabricated without vacuum. Thus, it can be concluded that the fabrication process with vacuum produce composite structures with better energy absorption capacity

Fibras de licuri: um reforço vegetal alternativo de compósitos poliméricos

This research is based, at first, on the seeking of alternatives naturals reinforced in place of polymeric composites, also named reinforced plastics. Therein, this work starts with a whole licuri fiber micro structural characterization, as alternative proposal to polymeric composites. Licuri fiber is abundant on the Bahia state flora, native from a palm tree called Syagrus Coronata (Martius) Beccari. After, it was done only licuri fiber laminar composite developing studies, in order to know its behavior when impregnated with thermofix resin. The composite was developed in laminar structure shape (plate with a single layer of reinforcement) and produced industrially. The layer of reinforcement is a fabric-fiber unidirectional of licuri up in a manual loom. Their structure was made of polyester resin ortofitálica (unsaturated) only reinforced with licuri fibers. Fiber characterization studies were based on physical chemistry properties and their constitution. It was made by tension, scanning electron microscopy (SEM), x-ray diffraction (RDX) and thermal analyses (TG and DTA) tests, besides fiber chemistry analyses. Relating their mechanical properties of strength and hardness testing, they were determined through unit axial tension test and flexion in three points. A study in order to know fiber/matrix interface effects, in the final composites results, was required. To better understand the mechanical behavior of the composite, macroscopic and microscopic optical analysis of the fracture was performed

Efeitos da radiação uv, temperatura e vapor aquecido nos compósitos poliméricos: monitoramento, instabilidade estrutural e fratura

The application of composite materials and in particular the fiber-reinforced plastics (FRP) has gradually conquered space from the so called conventional materials. However, challenges have arisen when their application occurs in equipment and mechanical structures which will be exposed to harsh environmental conditions, especially when there is the influence of environmental degradation due to temperature, UV radiation and moisture in the mechanical performance of these structures, causing irreversible structural damage such as loss of dimensional stability, interfacial degradation, loss of mass, loss of structural properties and changes in the damage mechanism. In this context, the objective of this thesis is the development of a process for monitoring and modeling structural degradation, and the study of the physical and mechanical properties in FRP when in the presence of adverse environmental conditions (ageing). The mechanism of ageing is characterized by controlled environmental conditions of heated steam and ultraviolet radiation. For the research, it was necessary to develop three polymer composites. The first was a lamina of polyester resin reinforced with a short glass-E fiber mat (representing the layer exposed to ageing), and the other two were laminates, both of seven layers of reinforcement, one being made up only of short fibers of glass-E, and the other a hybrid type reinforced with fibers of glass-E/ fibers of curaua. It should be noted that the two laminates have the lamina of short glass-E fibers as a layer of the ageing process incidence. The specimens were removed from the composites mentioned and submitted to environmental ageing accelerated by an ageing chamber. To study the monitoring and modeling of degradation, the ageing cycles to which the lamina was exposed were: alternating cycles of UV radiation and heated steam, a cycle only of UV radiation and a cycle only of heated steam, for a period defined by norm. The laminates have already undergone only the alternating cycle of UV and heated steam. At the end of the exposure period the specimens were subjected to a structural stability assessment by means of the developed measurement of thickness variation technique (MTVT) and the measurement of mass variation technique (MMVT). Then they were subjected to the mechanical tests of uniaxial tension for the lamina and all the laminates, besides the bending test on three points for the laminates. This study was followed by characterization of the fracture and the surface degradation. Finally, a model was developed for the composites called Ageing Zone Diagram (AZD) for monitoring and predicting the tensile strength after the ageing processes. From the results it was observed that the process of degradation occurs Abstract Raimundo Nonato Barbosa Felipe xiv differently for each composite studied, although all were affected in certain way and that the most aggressive ageing process was that of UV radiation, and that the hybrid laminated fibers of glass-E/curaua composite was most affected in its mechanical properties

Otimização topológica de estruturas termoelásticas tridimensionais

This work presents an optimization technique based on structural topology optimization methods, TOM, designed to solve problems of thermoelasticity 3D. The presented approach is based on the adjoint method of sensitivity analysis unified design and is intended to loosely coupled thermomechanical problems. The technique makes use of analytical expressions of sensitivities, enabling a reduction in the computational cost through the use of a coupled field adjoint equation, defined in terms the of temperature and displacement fields. The TOM used is based on the material aproach. Thus, to make the domain is composed of a continuous distribution of material, enabling the use of classical models in nonlinear programming optimization problem, the microstructure is considered as a porous medium and its constitutive equation is a function only of the homogenized relative density of the material. In this approach, the actual properties of materials with intermediate densities are penalized based on an artificial microstructure model based on the SIMP (Solid Isotropic Material with Penalty). To circumvent problems chessboard and reduce dependence on layout in relation to the final optimal initial mesh, caused by problems of numerical instability, restrictions on components of the gradient of relative densities were applied. The optimization problem is solved by applying the augmented Lagrangian method, the solution being obtained by applying the finite element method of Galerkin, the process of approximation using the finite element Tetra4. This element has the ability to interpolate both the relative density and the displacement components and temperature. As for the definition of the problem, the heat load is assumed in steady state, i.e., the effects of conduction and convection of heat does not vary with time. The mechanical load is assumed static and distributed

Método de Otimização Topológica em Estruturas Tridimensionais

The topology optimization problem characterize and determine the optimum distribution of material into the domain. In other words, after the definition of the boundary conditions in a pre-established domain, the problem is how to distribute the material to solve the minimization problem. The objective of this work is to propose a competitive formulation for optimum structural topologies determination in 3D problems and able to provide high-resolution layouts. The procedure combines the Galerkin Finite Elements Method with the optimization method, looking for the best material distribution along the fixed domain of project. The layout topology optimization method is based on the material approach, proposed by Bendsoe & Kikuchi (1988), and considers a homogenized constitutive equation that depends only on the relative density of the material. The finite element used for the approach is a four nodes tetrahedron with a selective integration scheme, which interpolate not only the components of the displacement field but also the relative density field. The proposed procedure consists in the solution of a sequence of layout optimization problems applied to compliance minimization problems and mass minimization problems under local stress constraint. The microstructure used in this procedure was the SIMP (Solid Isotropic Material with Penalty). The approach reduces considerably the computational cost, showing to be efficient and robust. The results provided a well defined structural layout, with a sharpness distribution of the material and a boundary condition definition. The layout quality was proporcional to the medium size of the element and a considerable reduction of the project variables was observed due to the tetrahedrycal element

Estudo da fibra de coco como reforço em tijolo de solocimento

To take care of to the demand of the new constructions in the low income communities and to develop the production of a strengthened alternative brick with staple fibers of coconut, capable to contribute mainly with the recycling of the green and mature coconut in the urban and agricultural lexes, this research was developed, to confection bricks of soil-cement with coconut fiber. Ecologically correct material and of low cost, since the greenhouse use of or oven for burning will be manufactured without. The study it presents a set of tables and graphs that prove good indices found in the values of the density, water absorption, axial compressive strength and isolation term acoustics, with evidential results that make possible the production in industrial character with press mechanics or the place of the workmanship with manual form. The preparation of coconut staple fibers was made of natural form without use of chemical products not to deprive of characteristics the properties mechanical physicist-chemistries and of the same ones. The sixty bricks produced in simple and manual press had been carried through in four lots of fifteen units. The mixture of aggregates was made in four different traces composites for: ground erinaceous, cement, fiber of dry coconut and water; the bricks had been compact in the press and cured in natural way under an area covered during the minimum time of seven days