Uma implementação paralela híbrida para o problema do caixeiro viajante usando algoritmos genéticos, GRASP e aprendizagem por reforço

The metaheuristics techiniques are known to solve optimization problems classified as NP-complete and are successful in obtaining good quality solutions. They use non-deterministic approaches to generate solutions that are close to the optimal, without the guarantee of finding the global optimum. Motivated by the difficulties in the resolution of these problems, this work proposes the development of parallel hybrid methods using the reinforcement learning, the metaheuristics GRASP and Genetic Algorithms. With the use of these techniques, we aim to contribute to improved efficiency in obtaining efficient solutions. In this case, instead of using the Q-learning algorithm by reinforcement learning, just as a technique for generating the initial solutions of metaheuristics, we use it in a cooperative and competitive approach with the Genetic Algorithm and GRASP, in an parallel implementation. In this context, was possible to verify that the implementations in this study showed satisfactory results, in both strategies, that is, in cooperation and competition between them and the cooperation and competition between groups. In some instances were found the global optimum, in others theses implementations reach close to it. In this sense was an analyze of the performance for this proposed approach was done and it shows a good performance on the requeriments that prove the efficiency and speedup (gain in speed with the parallel processing) of the implementations performed

Uma contribuição à solução do problema dos k-servos usando aprendizagem por reforço

Neste trabalho é proposto um novo algoritmo online para o resolver o Problema dos k-Servos (PKS). O desempenho desta solução é comparado com o de outros algoritmos existentes na literatura, a saber, os algoritmos Harmonic e Work Function, que mostraram ser competitivos, tornando-os parâmetros de comparação significativos. Um algoritmo que apresente desempenho eficiente em relação aos mesmos tende a ser competitivo também, devendo, obviamente, se provar o referido fato. Tal prova, entretanto, foge aos objetivos do presente trabalho. O algoritmo apresentado para a solução do PKS é baseado em técnicas de aprendizagem por reforço. Para tanto, o problema foi modelado como um processo de decisão em múltiplas etapas, ao qual é aplicado o algoritmo Q-Learning, um dos métodos de solução mais populares para o estabelecimento de políticas ótimas neste tipo de problema de decisão. Entretanto, deve-se observar que a dimensão da estrutura de armazenamento utilizada pela aprendizagem por reforço para se obter a política ótima cresce em função do número de estados e de ações, que por sua vez é proporcional ao número n de nós e k de servos. Ao se analisar esse crescimento (matematicamente, ) percebe-se que o mesmo ocorre de maneira exponencial, limitando a aplicação do método a problemas de menor porte, onde o número de nós e de servos é reduzido. Este problema, denominado maldição da dimensionalidade, foi introduzido por Belmann e implica na impossibilidade de execução de um algoritmo para certas instâncias de um problema pelo esgotamento de recursos computacionais para obtenção de sua saída. De modo a evitar que a solução proposta, baseada exclusivamente na aprendizagem por reforço, seja restrita a aplicações de menor porte, propõe-se uma solução alternativa para problemas mais realistas, que envolvam um número maior de nós e de servos. Esta solução alternativa é hierarquizada e utiliza dois métodos de solução do PKS: a aprendizagem por reforço, aplicada a um número reduzido de nós obtidos a partir de um processo de agregação, e um método guloso, aplicado aos subconjuntos de nós resultantes do processo de agregação, onde o critério de escolha do agendamento dos servos é baseado na menor distância ao local de demanda

Classificação de padrões através de um comitê de máquinas aprimorado por aprendizagem por reforço

Reinforcement learning is a machine learning technique that, although finding a large number of applications, maybe is yet to reach its full potential. One of the inadequately tested possibilities is the use of reinforcement learning in combination with other methods for the solution of pattern classification problems. It is well documented in the literature the problems that support vector machine ensembles face in terms of generalization capacity. Algorithms such as Adaboost do not deal appropriately with the imbalances that arise in those situations. Several alternatives have been proposed, with varying degrees of success. This dissertation presents a new approach to building committees of support vector machines. The presented algorithm combines Adaboost algorithm with a layer of reinforcement learning to adjust committee parameters in order to avoid that imbalances on the committee components affect the generalization performance of the final hypothesis. Comparisons were made with ensembles using and not using the reinforcement learning layer, testing benchmark data sets widely known in area of pattern classification

Roteamento em Redes de Sensores Sem Fios Com Base Em Aprendizagem Por Reforço

The use of wireless sensor and actuator networks in industry has been increasing past few years, bringing multiple benefits compared to wired systems, like network flexibility and manageability. Such networks consists of a possibly large number of small and autonomous sensor and actuator devices with wireless communication capabilities. The data collected by sensors are sent directly or through intermediary nodes along the network to a base station called sink node. The data routing in this environment is an essential matter since it is strictly bounded to the energy efficiency, thus the network lifetime. This work investigates the application of a routing technique based on Reinforcement Learning s Q-Learning algorithm to a wireless sensor network by using an NS-2 simulated environment. Several metrics like energy consumption, data packet delivery rates and delays are used to validate de proposal comparing it with another solutions existing in the literature

Compósitos híbridos: desenvolvimento de configuração e efeitos de umidificação

The advantage in using vegetable fibres in place of synthetic fibres such as glass fibre, for reinforcements in composites are: biodegradability, low cost, low density, good tenacity, good thermal properties, low energy content and reduced use of instruments for its treatment or processing. Even though, problems related to low mechanical performance of some of the natural fibres, has caused difficulty in their direct application in structural elements. The use of alternative materials like hybrid composites has been encouraged, thus trying to better the structural performance of the composites with natural fibres. This work presents a comparative study of the strength and stiffness of hybrid composites with orthopthalic polyester matrix reinforced with E-fibre glass, jute and curauá. The experimental part includes uniaxial tension and three point bending tests to determine the mechanical properties of the final product. The hybrid composite was manufactured in a local industry and was in the form of laminates. All the samples were projected to withstand the possible structural applications as reservoirs and pipes. CH (laminated hybrid composite with glass and curauá fibres). The results obtained show clearly the influence of the hybridization in all the types tested and indicate a good mechanical performance of the composite with glass/curauá fibres in relation to the composite with glass fibres. Aspects in relation to the interfaces glass/curauá composites besides the fracture characteristics for all loading types were also analysed

Efeitos do envelhecimento ambiental acelerado em compósitos poliméricos

The advantages of the use of vegetable fibers on the synthetic fibers, such as glass fibers, in the reinforcements in composites are: low cost, low density, good tenacity, good thermal properties and reduced use of instruments for their treatment or processing. However, problems related to poor performance of some mechanical natural fibers, have hindered its direct use in structural elements. In this sense, the emergence of alternative materials such as hybrids composites, involving natural and synthetic fibers, has been encouraged by seeking to improve the performance of structural composites based only on natural fibers. The differences between the physical, chemical and mechanical properties of these fibers, especially facing the adverse environmental conditions such as the presence of moisture and ultraviolet radiation, is also becoming a concern in the final response of these composites. This piece of research presents a comparative study of the strength and stiffness between two composite, both of ortoftalic polyester matrix, one reinforced with fibers of glass-E (CV) and other hybrid reinforced with natural fibers of curauá and fiberglass-E (CH). All the comparative study is based on the influence of exposure to UV rays and steam heated water in composites, simulating the aging environment. The conditions for the tests are accelerated through the use of the aging chamber. The composites will be evaluated through tests of uniaxial static mechanical traction and bending on three points. The composite of glass fiber and hybrid manufacturing industry are using the rolling manual (hand lay-up) and have been developed in the form of composites. All were designed to meet possible structural applications such as tanks and pipes. The reinforcements used in composites were in the forms of short fiber glass-E quilts (450g/m2 - 5cm) of continuous wires and fuses (whose title was of 0.9 dtex) for the curauá fibers. The results clearly show the influence of aging on the environmental mechanical performance of the composite CV and CH. The issues concerning the final characteristics of the fracture for all types of cargoes studied were also analyzed

Fabricação de malha de trama utilizada como pré-formas na indústria de compósitos e avaliação das propriedades mecânicas

In the manufacture of composite, textile materials are being used as reinforcement. Generally, the combination of the matrix with the textile material in the form of fibres or yarns is used depending on their distribution in the web. In the present work, in place of fibres or yarns, a knitted structure in the form of the final product which is defined as preform. The preform is weft knit manufactured with polyester filaments. In the manufacture of composite, polyester resin was used as matrix. The physical and mechanical properties as well as the formability of the weft knit were analysed. The physical and mechanical properties as well as the formability of the knitted structure were analysed. The results obtained on the analysis show that the courses and wales of the weft knit structure and the tensile properties help the formability of the structure and the impregnation of the resin. It could be clearly observed that composite structure in the direction of the courses support more tension than in the direction of the wales. In relation to the three points flexural tests it was possible to note that there was more flexion in the direction of wales, what was expected. It was also possible to note that there are other advantages such as reduction in the loss of materials used, homogeneity in the distribution of the knitted structure in the mould, reduction in the preparation time and also in the reduction in the cost of manufacture

Envelhecimento ambiental acelerado em PRF a base de tecidos híbridos kevlar/vidro: propriedades e instabilidade estrutural

There are a number of damaging mechanisms that various materials can suffer in service. However, when working with polymer composite materials, this is something that requires analysis, especially when exposed to adverse environmental conditions. Thus, the objective of the present thesis is the study of the direct influence of environmental aging and the form of hybridization of the reinforcement woven on the structural stability, surfacedegradation and fracture process of polymer composites laminates. For this, the development of two polymer composite laminates was necessary, where one of them was reinforced with a bi-directional woven with hybrid strandsofkevlar-49/glass-Efibers, and the other also with a bi-directionalwoven, however with weft and warpformed of alternating strandsof Kevlar-49 fibers and glass-E fiber The reinforcementwoven are industrially manufactured. Both laminates use a polyester resin as a matrixand are made up of four layers each. All laminates were industrially prepared by the hand lay-up method of manufacturing. To do this, test specimens were manufactured of the respective laminates and submitted to environmental aging accelerated through the aging chamber. They were exposed to alternating cycles of UV radiation and moisture (heated steam) for a standard defined period. At the end of the exposure period the specimens were subjected to mechanical tests of uniaxial tensile and bending in three points and to the characterizationsof the fracture and surface deterioration. In addition, they were submitted to a structural degradation assessment by the measurement of mass variation technique (MMVT) and the measurement of thickness variation technique (MTVT), this last technique being developed in this thesis. At the end of the analysis it was observed that the form of hybridization of the reinforcement woven and the aging process directly influence with losses or gain in mechanical properties, with losses in the structural degradation and in the formation and propagation of damage mechanism of the developedcomposite laminates

Efeitos da radiação uv, temperatura e vapor aquecido nos compósitos poliméricos: monitoramento, instabilidade estrutural e fratura

The application of composite materials and in particular the fiber-reinforced plastics (FRP) has gradually conquered space from the so called conventional materials. However, challenges have arisen when their application occurs in equipment and mechanical structures which will be exposed to harsh environmental conditions, especially when there is the influence of environmental degradation due to temperature, UV radiation and moisture in the mechanical performance of these structures, causing irreversible structural damage such as loss of dimensional stability, interfacial degradation, loss of mass, loss of structural properties and changes in the damage mechanism. In this context, the objective of this thesis is the development of a process for monitoring and modeling structural degradation, and the study of the physical and mechanical properties in FRP when in the presence of adverse environmental conditions (ageing). The mechanism of ageing is characterized by controlled environmental conditions of heated steam and ultraviolet radiation. For the research, it was necessary to develop three polymer composites. The first was a lamina of polyester resin reinforced with a short glass-E fiber mat (representing the layer exposed to ageing), and the other two were laminates, both of seven layers of reinforcement, one being made up only of short fibers of glass-E, and the other a hybrid type reinforced with fibers of glass-E/ fibers of curaua. It should be noted that the two laminates have the lamina of short glass-E fibers as a layer of the ageing process incidence. The specimens were removed from the composites mentioned and submitted to environmental ageing accelerated by an ageing chamber. To study the monitoring and modeling of degradation, the ageing cycles to which the lamina was exposed were: alternating cycles of UV radiation and heated steam, a cycle only of UV radiation and a cycle only of heated steam, for a period defined by norm. The laminates have already undergone only the alternating cycle of UV and heated steam. At the end of the exposure period the specimens were subjected to a structural stability assessment by means of the developed measurement of thickness variation technique (MTVT) and the measurement of mass variation technique (MMVT). Then they were subjected to the mechanical tests of uniaxial tension for the lamina and all the laminates, besides the bending test on three points for the laminates. This study was followed by characterization of the fracture and the surface degradation. Finally, a model was developed for the composites called Ageing Zone Diagram (AZD) for monitoring and predicting the tensile strength after the ageing processes. From the results it was observed that the process of degradation occurs Abstract Raimundo Nonato Barbosa Felipe xiv differently for each composite studied, although all were affected in certain way and that the most aggressive ageing process was that of UV radiation, and that the hybrid laminated fibers of glass-E/curaua composite was most affected in its mechanical properties

Estudo das propriedades mecânicas de biocompósitos de polipropileno reforçados com fibras naturais

This research presents an approach to the addition of curauá fibers and licuri fibers in a polypropylene resin matrix, such as an alternative proposal to reinforce the polymeric composites. Fiber content of 0 %, 5 %, 10 %, and 20% were analyzed for verification of their mechanical properties comparing them, inclusive with the properties of polypropylene. The grainulated biocomposites had been prepared in an extrusora. The test bodies had been molded by injection and submitted to the mechanical essays uniaxial traction, flexion on three points, impact, in addition to thermal tests (HDT). These biocomposites had been also subjected the essay physicist-chemistry index of fluidity (IF). It was observed that the biocomposites of PP with 20% curauá, obtained bigger increase in the modulus of elasticity and a bigger reduction in the resistance to the impact. In the mechanical behavior, for all the biocomposites, these were increases in values of the limit of drainage and tension of rupture, when tested by uniaxial traction, as they added the fibers. Another important point was the increase of the resistance the flexion. It was also noted that the addition of fibers reduced the thermal degradation of the mixture natural fibers / polypropylene.

Desenvolvimento de um laminado compósito híbrido a base de fibras de vidro/licurí

This research work is based, in search of reinforcement s vegetable alternative to polymer composites. The idealization of making a hybrid composite reinforced with vegetable fibers licuri with synthetic fibers is a pioneer in this area. Thus was conceived a hybrid composite laminate consisting of 05 (five) layers being 03 (three) webs of synthetic fibers of glass and E-02 (two) unidirectional fabrics of vegetable fibers licuri. In the configuration of the laminate layers have alternating distribution. The composite laminate was manufactured in Tecniplas Commerce & Industry LTD, in the form of a card through the manufacturing process of hand lay up. Licuri fibers used in making the foil were the City of Mare Island in the state of Bahia. After cooking and the idealization of the hybrid composite laminate, the objective of this research work has focused on evaluating the performance of the mechanical properties (ultimate strength, stiffness and elongation at break) through uniaxial tensile tests and three point bending. Comparative studies of the mechanical properties and as well as among other types of laminated hybrid composites studied previously, were performed. Promising results were found with respect to the mechanical properties of strength and stiffness to the hybridization process idealized here. To complement the entire study were analyzed in terms of macroscopic and microscopic characteristics of the fracture for all tests.

Desenvolvimento e análise de material compósito a base de penas de frango (fibras de queratina-KF) e matriz de poliéster insaturado

Use of natural fibres as a reinforcement material in the manufacture of composites show a series of advantages: availability, biodegradability, low weight and regeneration in relation to synthetic fibres, thus justifying its utilization. In the present research work, composites were developed with chicken feathers (KF), using unsaturated polyester resin as matrix, for diversified applications, mainly in the furniture/timber industry.At present, in Brazil the chicken feathers are used as part of the animal feed, even though this material possesses low aggregated value. The chicken feathers are hollow, light and resistant. After washing with water at room temperature, a part of the chicken feathers were treated with 2% NaOH. Composites were manufactured using treated and untreated chicken feathers with unsaturated orthothalic polyester resin and 1% peroxide as catalyser, obtained in the commerce. Samples with size 150x25x3 mm for mechanical tests were cut by laser in the composite plate. Mechanical analyses were carried out in the Laboratório de Metais e Ensaios Mecânicos UFRN. All the analyses were in accordance with ASTM standards. SEM analyses were also carried out on the samples.In the analyses of the results obtained, it was observed that the composites made with untreated chicken feathers showed better results (Traction 11.406 MPa and 9.107 MPa Bending 34.947 and 20.918 MPa for samples with and without treatment respectively) compared to the composite with treated feathers. Very low values of the water absorption results, evidenced the impermeability characteristic of the feathers. From the SEM images, the structure, fracture and the fibre/matrix adsorption can be evidenced. In the flammability test, it was observed that despite the feathers having sulfur as a constituent, natural inhibitor of flame, no burning support of the composites, because the manufacturing process of the composite

Estudo da fibra de coco como reforço em tijolo de solocimento

To take care of to the demand of the new constructions in the low income communities and to develop the production of a strengthened alternative brick with staple fibers of coconut, capable to contribute mainly with the recycling of the green and mature coconut in the urban and agricultural lexes, this research was developed, to confection bricks of soil-cement with coconut fiber. Ecologically correct material and of low cost, since the greenhouse use of or oven for burning will be manufactured without. The study it presents a set of tables and graphs that prove good indices found in the values of the density, water absorption, axial compressive strength and isolation term acoustics, with evidential results that make possible the production in industrial character with press mechanics or the place of the workmanship with manual form. The preparation of coconut staple fibers was made of natural form without use of chemical products not to deprive of characteristics the properties mechanical physicist-chemistries and of the same ones. The sixty bricks produced in simple and manual press had been carried through in four lots of fifteen units. The mixture of aggregates was made in four different traces composites for: ground erinaceous, cement, fiber of dry coconut and water; the bricks had been compact in the press and cured in natural way under an area covered during the minimum time of seven days

Desenvolvimento de têxteis técnicos para reforço de compósitos poliméricos

Materials denominated technical textiles can be defined as structures designed and developed with function to fulfill specific functional requirements of various industrial sectors as are the cases of the automotive and aerospace industries. In this aspect the technical textiles are distinguished from conventional textile materials, in which the aesthetic and of comfort needs are of primordial importance. Based on these considerations, the subject of this dissertation was established having as its main focus the study of development of textile structures from aramid and glass fibers and acting in order to develop the manufacture of composite materials that combine properties of two different structures, manufactured in an identical operation, where each structure contributes to improving the properties of the resulting composite material. Therefore were created in laboratory scale, textile structures with low weight and different composition: aramid (100%), glass (100%) and aramid /glass (65/35%), in order to use them as a reinforcing element in composite materials with polyester matrix. These composites were tested in tension and its fracture surface, evaluated by MEV. Based on the analysis of mechanical properties of the developed composites, the efficiency of the structures prepared as reinforcing element were testified by reason of that the resistance values of the composites are far superior to the polyester matrix. It was also observed that hybridization in tissue structure was efficient, since the best results obtained were for hybrid composites, where strength to the rupture was similar to the steel 1020, reaching values on the order of 340 MPa

Fabricação de eco-composito com a fibra de lã canina

The Sustainability has been evidence in the world today; organizations have sought to be more and more into this philosophy in their processes, whether products or attendance. In the present work were manufactured eco-composites with animal fiber (dog wool) that is currently discarded into the environment without any use. The fibers were characterized and made matting (non-woven). The phases of the project were consisted to develop methods and to convert these fibers (booster) blended with polyester resin (matrix) in different proportions (10%, 20% and 30%) at the composite. Were studied fiber characteristics, mechanical properties of the composites, water absorption and scanning electron microscopy. Initially, the fibers were treated with solution of sodium hydroxide of 0.05 mols, and then taken to matting preparing at the textile engineering laboratory - UFRN. The composites were made by compression molding, using an orthophthalic polyester resin as matrix and 1% MEK (methyl ethyl ketone peroxide) as initiator (catalyst). To evaluate the mechanical tests (tensile and flexural) and water absorption were made twelve specimens with dimensions 150x25x3 mm were cut randomly. According to the standard method, tensile tests (ASTM 3039) bending tests (ASTM D790) were performed at the mechanical testing of metals at laboratory UFRN. The results of these tests showed that the composite reinforced with 30% had a better behavior when exposed to tension charge; while on the three points bending test showed that the composite reinforced with 10% had a better behavior. In the water absorption test it was possible to see that the highest absorption happened on the composite reinforced with 30%. In the micrographs, it was possible to see the regions of rupture and behavior of the composite (booster / matrix)