Algoritmo Q-learning como estratégia de exploração e/ou explotação para metaheurísticas GRASP e algoritmo genético

Techniques of optimization known as metaheuristics have achieved success in the resolution of many problems classified as NP-Hard. These methods use non deterministic approaches that reach very good solutions which, however, don t guarantee the determination of the global optimum. Beyond the inherent difficulties related to the complexity that characterizes the optimization problems, the metaheuristics still face the dilemma of xploration/exploitation, which consists of choosing between a greedy search and a wider exploration of the solution space. A way to guide such algorithms during the searching of better solutions is supplying them with more knowledge of the problem through the use of a intelligent agent, able to recognize promising regions and also identify when they should diversify the direction of the search. This way, this work proposes the use of Reinforcement Learning technique - Q-learning Algorithm - as exploration/exploitation strategy for the metaheuristics GRASP (Greedy Randomized Adaptive Search Procedure) and Genetic Algorithm. The GRASP metaheuristic uses Q-learning instead of the traditional greedy-random algorithm in the construction phase. This replacement has the purpose of improving the quality of the initial solutions that are used in the local search phase of the GRASP, and also provides for the metaheuristic an adaptive memory mechanism that allows the reuse of good previous decisions and also avoids the repetition of bad decisions. In the Genetic Algorithm, the Q-learning algorithm was used to generate an initial population of high fitness, and after a determined number of generations, where the rate of diversity of the population is less than a certain limit L, it also was applied to supply one of the parents to be used in the genetic crossover operator. Another significant change in the hybrid genetic algorithm is the proposal of a mutually interactive cooperation process between the genetic operators and the Q-learning algorithm. In this interactive/cooperative process, the Q-learning algorithm receives an additional update in the matrix of Q-values based on the current best solution of the Genetic Algorithm. The computational experiments presented in this thesis compares the results obtained with the implementation of traditional versions of GRASP metaheuristic and Genetic Algorithm, with those obtained using the proposed hybrid methods. Both algorithms had been applied successfully to the symmetrical Traveling Salesman Problem, which was modeled as a Markov decision process

Determinação dos parâmetros do controlador preditivo generalizado com função de pesos variante no tempo através de algoritmos genéticos

The predictive control technique has gotten, on the last years, greater number of adepts in reason of the easiness of adjustment of its parameters, of the exceeding of its concepts for multi-input/multi-output (MIMO) systems, of nonlinear models of processes could be linearised around a operating point, so can clearly be used in the controller, and mainly, as being the only methodology that can take into consideration, during the project of the controller, the limitations of the control signals and output of the process. The time varying weighting generalized predictive control (TGPC), studied in this work, is one more an alternative to the several existing predictive controls, characterizing itself as an modification of the generalized predictive control (GPC), where it is used a reference model, calculated in accordance with parameters of project previously established by the designer, and the application of a new function criterion, that when minimized offers the best parameters to the controller. It is used technique of the genetic algorithms to minimize of the function criterion proposed and searches to demonstrate the robustness of the TGPC through the application of performance, stability and robustness criterions. To compare achieves results of the TGPC controller, the GCP and proportional, integral and derivative (PID) controllers are used, where whole the techniques applied to stable, unstable and of non-minimum phase plants. The simulated examples become fulfilled with the use of MATLAB tool. It is verified that, the alterations implemented in TGPC, allow the evidence of the efficiency of this algorithm

Determinação de Chaveamento para Recomposição do Serviço em Redes de Distribuição de Energia Elétrica em Média Tensão Através de Métodos Baseado em Parâmetros de Sensibilidade

The reconfiguration of a distribution network is a change in its topology, aiming to provide specific operation conditions of the network, by changing the status of its switches. It can be performed regardless of any system anomaly. The service restoration is a particular case of reconfiguration and should be performed whenever there is a network failure or whenever one or more sections of a feeder have been taken out of service for maintenance. In such cases, loads that are supplied through lines sections that are downstream of portions removed for maintenance may be supplied by the closing of switches to the others feeders. By classical methods of reconfiguration, several switches may be required beyond those used to perform the restoration service. This includes switching feeders in the same substation or for substations that do not have any direct connection to the faulted feeder. These operations can cause discomfort, losses and dissatisfaction among consumers, as well as a negative reputation for the energy company. The purpose of this thesis is to develop a heuristic for reconfiguration of a distribution network, upon the occurrence of a failure in this network, making the switching only for feeders directly involved in this specific failed segment, considering that the switching applied is related exclusively to the isolation of failed sections and bars, as well as to supply electricity to the islands generated by the condition, with significant reduction in the number of applications of load flows, due to the use of sensitivity parameters for determining voltages and currents estimated on bars and lines of the feeders directly involved with that failed segment. A comparison between this process and classical methods is performed for different test networks from the literature about networks reconfiguration

Estrutura ANFIS modificada para identificação e controle de plantas com ampla faixa de operação e não linearidade acentuada

In this work a modification on ANFIS (Adaptive Network Based Fuzzy Inference System) structure is proposed to find a systematic method for nonlinear plants, with large operational range, identification and control, using linear local systems: models and controllers. This method is based on multiple model approach. This way, linear local models are obtained and then those models are combined by the proposed neurofuzzy structure. A metric that allows a satisfactory combination of those models is obtained after the structure training. It results on plant s global identification. A controller is projected for each local model. The global control is obtained by mixing local controllers signals. This is done by the modified ANFIS. The modification on ANFIS architecture allows the two neurofuzzy structures knowledge sharing. So the same metric obtained to combine models can be used to combine controllers. Two cases study are used to validate the new ANFIS structure. The knowledge sharing is evaluated in the second case study. It shows that just one modified ANFIS structure is necessary to combine linear models to identify, a nonlinear plant, and combine linear controllers to control this plant. The proposed method allows the usage of any identification and control techniques for local models and local controllers obtaining. It also reduces the complexity of ANFIS usage for identification and control. This work has prioritized simpler techniques for the identification and control systems to simplify the use of the method

Metodologia para adaptação de microarquiteturas microprogramadas soft-core à uma ISA padrão: estudo do impacto sobre a complexidade de hardware para o padrão MIPS

In academia, it is common to create didactic processors, facing practical disciplines in the area of Hardware Computer and can be used as subjects in software platforms, operating systems and compilers. Often, these processors are described without ISA standard, which requires the creation of compilers and other basic software to provide the hardware / software interface and hinder their integration with other processors and devices. Using reconfigurable devices described in a HDL language allows the creation or modification of any microarchitecture component, leading to alteration of the functional units of data path processor as well as the state machine that implements the control unit even as new needs arise. In particular, processors RISP enable modification of machine instructions, allowing entering or modifying instructions, and may even adapt to a new architecture. This work, as the object of study addressing educational soft-core processors described in VHDL, from a proposed methodology and its application on two processors with different complexity levels, shows that it s possible to tailor processors for a standard ISA without causing an increase in the level hardware complexity, ie without significant increase in chip area, while its level of performance in the application execution remains unchanged or is enhanced. The implementations also allow us to say that besides being possible to replace the architecture of a processor without changing its organization, RISP processor can switch between different instruction sets, which can be expanded to toggle between different ISAs, allowing a single processor become adaptive hybrid architecture, which can be used in embedded systems and heterogeneous multiprocessor environments

Identificação não linear usando uma rede fuzzy wavelet neural network modificada

In last decades, neural networks have been established as a major tool for the identification of nonlinear systems. Among the various types of networks used in identification, one that can be highlighted is the wavelet neural network (WNN). This network combines the characteristics of wavelet multiresolution theory with learning ability and generalization of neural networks usually, providing more accurate models than those ones obtained by traditional networks. An extension of WNN networks is to combine the neuro-fuzzy ANFIS (Adaptive Network Based Fuzzy Inference System) structure with wavelets, leading to generate the Fuzzy Wavelet Neural Network - FWNN structure. This network is very similar to ANFIS networks, with the difference that traditional polynomials present in consequent of this network are replaced by WNN networks. This paper proposes the identification of nonlinear dynamical systems from a network FWNN modified. In the proposed structure, functions only wavelets are used in the consequent. Thus, it is possible to obtain a simplification of the structure, reducing the number of adjustable parameters of the network. To evaluate the performance of network FWNN with this modification, an analysis of network performance is made, verifying advantages, disadvantages and cost effectiveness when compared to other existing FWNN structures in literature. The evaluations are carried out via the identification of two simulated systems traditionally found in the literature and a real nonlinear system, consisting of a nonlinear multi section tank. Finally, the network is used to infer values of temperature and humidity inside of a neonatal incubator. The execution of such analyzes is based on various criteria, like: mean squared error, number of training epochs, number of adjustable parameters, the variation of the mean square error, among others. The results found show the generalization ability of the modified structure, despite the simplification performed

Aplicação de superfícies seletivas em frequência para melhoria de resposta de arranjos de antenas planares

This work aims to show how the application of frequency selective surfaces (FSS) in planar antenna arrays become an alternative to obtain desired radiation characteristics from changes in radiation parameters of the arrays, such as bandwidth, gain and directivity. In addition to analyzing these parameters is also made a study of the mutual coupling between the elements of the array. To accomplish this study, were designed a microstrip antenna array with two patch elements, fed by a network feed. Another change made in the array was the use of the truncated ground plane, with the objective of increasing the bandwidth and miniaturize the elements of the array. In order to study the behavior of frequency selective surfaces applied in antenna arrays, three different layouts were proposed. The first layout uses the FSS as a superstrate (above the array). The second layout uses the FSS as reflector element (below the array). The third layout is placed between two FSS. Numerical and experimental results for each of the proposed configurations are presented in order to validate the research

Uma proposta de um controlador adaptativo por posicionamento de pólos e estrutura variável

There are two main approaches for using in adaptive controllers. One is the so-called model reference adaptive control (MRAC), and the other is the so-called adaptive pole placement control (APPC). In MRAC, a reference model is chosen to generate the desired trajectory that the plant output has to follow, and it can require cancellation of the plant zeros. Due to its flexibility in choosing the controller design methodology (state feedback, compensator design, linear quadratic, etc.) and the adaptive law (least squares, gradient, etc.), the APPC is the most general type of adaptive control. Traditionally, it has been developed in an indirect approach and, as an advantage, it may be applied to non-minimum phase plants, because do not involve plant zero-pole cancellations. The integration to variable structure systems allows to aggregate fast transient and robustness to parametric uncertainties and disturbances, as well. In this work, a variable structure adaptive pole placement control (VS-APPC) is proposed. Therefore, new switching laws are proposed, instead of using the traditional integral adaptive laws. Additionally, simulation results for an unstable first order system and simulation and practical results for a three-phase induction motor are shown

Biomecânica e otimização topológica com H-adaptatividade em implantes dentários nitretados a plasma em cátodo oco

In recent years there has been a significant growth in technologies that modify implant surfaces, reducing healing time and allowing their successful use in areas with low bone density. One of the most widely used techniques is plasma nitration, applied with excellent results in titanium and its alloys, with greater frequency in the manufacture of hip, ankle and shoulder implants. However, its use in dental implants is very limited due to high process temperatures (between 700 C o and 800 C o ), resulting in distortions in these geometrically complex and highly precise components. The aim of the present study is to assess osseointegration and mechanical strength of grade II nitrided titanium samples, through configuration of hollow cathode discharge. Moreover, new formulations are proposed to determine the optimum structural topology of the dental implant under study, in order to perfect its shape, make it efficient, competitive and with high definition. In the nitriding process, the samples were treated at a temperature of 450 C o and pressure of 150 Pa , during 1 hour of treatment. This condition was selected because it obtains the best wettability results in previous studies, where different pressure, temperature and time conditions were systematized. The samples were characterized by X-ray diffraction, scanning electron microscope, roughness, microhardness and wettability. Biomechanical fatigue tests were then conducted. Finally, a formulation using the three dimensional structural topology optimization method was proposed, in conjunction with an hadaptive refinement process. The results showed that plasma nitriding, using the hollow cathode discharge technique, caused changes in the surface texture of test specimens, increases surface roughness, wettability and microhardness when compared to the untreated sample. In the biomechanical fatigue test, the treated implant showed no flaws, after five million cycles, at a maximum fatigue load of 84.46 N. The results of the topological optimization process showed well-defined optimized layouts of the dental implant, with a clear distribution of material and a defined edge

Avaliação do processo industrial da cerâmica vermelha na região do Seridó - RN

Particularly in Braziland in Rio Grande do Norte, companies manufacturing red ceramic, play an important role as agents of development to study the region Seridó- RN, specific place for carrying out the research. It is observed in this region a concentration of red ceramic industries of small size, which, despite its importance in the ceramic, they are unable to enjoy or use the new forms of administrative management and technological advances designed and offered by universities, centers of research and projects of governments, remained almost entirely outside the progress and modernization, technological and administrative. These companies still have outdated technology, and management processes, providing quality problems and standardization of end products. Upon these conditions are the companies going through crisis and struggling to survive alone and without assistance. The region of Seridó-RN, lets make a detailed case study of red ceramic companies in the region proposed from the existing theoretical and actual lifting of the condition of the product manufacturing red ceramic, allowing through this overview of the implementation of collect samples of raw materials, allowing the study of each ceramic industry that contributed to the participation of the research, which was determined parameters such as: analysis of the physical, chemical and technological properties of raw materials, characterization of the processes used, raising the technological resources considering equipment, machinery, supplies, raw materials and facilities available and its organization by type of products from companies involved in this study. The methodology consists of the following steps: collection of raw material, crushing and screening, characterization of raw materials (liquid limit, chemical analysis, mineralogical analysis, differential thermal analysis, sieve analysis), mixing, forming, cutting, drying and burning of ceramic bodies and bodies of evidence. The results showed that it was clay with distinct characteristics with respect to plasticity. With respect to the different compositions of mixtures of ceramic masses, we conclude that the ceramic properties showed a direct proportionality with increasing fraction of the clay not plastic. However, the compositions of the masses studied proved to be the most appropriate for the types of simulated clay for use in ceramics. Adopted in the ceramic processing made it possible to obtain products the resulted in consistent properties, and in some cases even exceeding the requirements of technical studies and standard-Brazilian clays to obtain ceramic products such as tiles, bricks and tiles to floor. Based on the discussions from the results obtained in the various processing steps of this work, one can draw conclusions according to the physico-chemical and mineralogical properties of raw materials, the properties of ceramic products burned and analysis. This work may be used by other researchers, private companies and governmental organizations, undergraduate students and graduate, can develop studies and future research to: develop projects to modify the furnaces; mapping projects develop and rationalize the exploitation of raw materials ;promoting reforestation and forest management; develop reduction projects and recovery of waste; develop training projects in manpower sector, and develop security projects, improving the conditions of work in the area pottery

Análise de desempenho de um refrigerador de pequeno porte com drop in de refrigerantes hidrocarbonetos

From what was stated in the Montreal Protocol, the researchers and refrigeration industry seek substitutes for synthetic refrigerants -chlorofluorocarbons (CFCs) and HCFCs (HCFC) - that contribute to the depletion of the ozone layer. The phase-out of these substances was started using as one of the replacement alternatives the synthetic fluids based on hydro fluorocarbons (HFCs) that have zero potential depletion of the ozone layer. However, contribute to the process of global warming. HFC refrigerants are greenhouse gases and are part of the group of gases whose emissions must be reduced as the Kyoto Protocol says. The hydrocarbons (HC's), for not contribute to the depletion of the ozone layer, because they have very low global warming potential, and are found abundantly in nature, has been presented as an alternative, and therefore, are being used in new home refrigeration equipment in several countries. In Brazil, due to incipient production of domestic refrigerators using HC's, the transition refrigerants remain on the scene for some years. This dissertation deals with an experimental evaluation of the conduct of a drinking fountain designed to work with HFC (R-134a), operating with a mixture of HC's or isobutane (R-600a) without any modification to the system or the lubricating oil. In the refrigeration laboratory of Federal University of Rio Grande do Norte were installed, in a drinking fountain, temperature and pressure sensors at strategic points in the refrigeration cycle, connected to an acquisition system of computerized data, to enable the mapping and thermodynamics analysis of the device operating with R-134a or with a mixture of HC's or with R-600a. The refrigerator-test operating with the natural fluids (mixture of HC's or R-600a) had a coefficient of performance (COP) lower than the R-134a

Competitividade de diferentes atmosferas de plasma sobre as propriedades hidrofílicas em tecidos de polilático

Os polímeros biodegradáveis, como o poliácido láctico (PLA) apesar de consolidado nos campos farmacêuticos, médico e biomédico como biomateriais úteis para aplicações variadas, porém, depende da necessidade de funcionalizar a sua superfície estudando suas propriedades tais como hidrofilidade e hidrofobicidade favorecendo a interação do polímero com os materiais de aplicação farmacêutica, médica e biomédica. Este trabalho tem como objetivo produzir um material com características diferentes em cada um de seus lados, sendo um lado hidrofílico e o outro hidrofóbico. O substrato têxtil utilizado neste estudo foi um tecido de malha de composição 100% PLA que é biodegradável e biocompatível, o que possibilita sua aplicação na área biomédica. Para modificação superficial foi utilizado o tratamento a plasma de baixa pressão. A técnica de modificação de superfície por plasma foi escolhida por ser uma tecnologia limpa, anticorrosiva e não tóxica ao contrario de muitos processos químicos convencionais utilizados na indústria têxtil, além disso, não afeta as propriedades de massa do substrato. Neste estudo, um lado da superfície do substrato foi tratado com plasma oxigênio, argônio e nitrogênio, para o trabalho de melhoria da hidrofilidade da superfície e metano para a hidrofobicidade da amostra. A espectroscopia de emissão ótica (OEE) foi utilizada para fazer o diagnóstico das espécies do plasma durante o tratamento. Após o tratamento a plasma as amostras foram caracterizadas por medidas de ângulo de contato, microscopia eletrônica de varredura (MEV), Espectroscopia de fotoelétrons de raios-X (XPS), Infravermelho com Transformada de Fourier (FTIR) de reflexão total atenuada (ATR), medidas da área de espalhamento do líquido e arraste vertical. Onde foi caracterizado o aumento e diminuição da molhabilidade das amostras tratadas por plasma bem como as variáveis que contribuíram para tal efeito. O tratamento das amostras de PLA com O2 + CH4 apresenta comportamento hidrofílico no lado tratado com O2, apresentando aumento de rugosidade e grupos funcionais e no lado tratado com CH4, apresentando a formação de um filme polimérico formado sobre a superfície da amostra. O tratamento com N2 + CH4 apresenta comportamento hidrofóbico, porém com variações no fluxo do CH4 tem-se um controle da molhabilidade na superfície das amostras, podendo ir de hidrofóbico a hidrofílico, neste tratamento as amostras apresentaram pequenas diferenças de molhabilidade entre os lados tratados com plasma de N2 e com plasma de CH4

Desenho e Construção de um protótipo gerador de jato de plasma frio a pressão atmosférica para aplicações biomédicas

Research for better performance materials in biomedical applications are constants. Thus recent studies aimed at the development of new techniques for modification of surfaces. The low pressure plasma has been highlighted for its versatility and for being environmentally friendly, achieving good results in the modification of physic chemical properties of materials. However, it is requires an expensive vacuum system and cannot able to generate superficial changes in specific regions. Furthermore, it is limits their use in polymeric materials and sensitive terms due to high process temperatures. Therefore, new techniques capable of generating cold plasma at atmospheric pressure (APPJ) were created. In order to perform surface treatments on biomaterials in specific regions was built a prototype capable of generating a cold plasma jet. The prototype plasma generator consists of a high voltage source, a support arm, sample port and a nozzle through which the ionized argon. The device was formed to a dielectric tube and two electrodes. This work was varied some parameters such as position between electrodes, voltage and electrical frequency to verify the behavior of glow discharges. The disc of titanium was polished and there was a surface modification. The power consumed, length, intensity and surface modifications of titanium were analyzed. The energy consumed during the discharges was observed by the Lissajous figure method. To check the length of the jets was realized with Image Pro Plus software. The modifications of the titanium surfaces were observed by optical microscopy (OM ) and atomic force microscopy (AFM ). The study showed that variations of the parameters such as voltage, frequency and geometric position between the electrodes influence the formation of the plasma jet. It was concluded that the plasma jet near room temperature and atmospheric pressure was able to cause modifications in titanium surface

Avaliação da temperatura de cristalização da parafina em sistemas: parafina, solvente e tensoativo

The formation of paraffin deposits is common in the petroleum industry during production, transport and treatment stages. It happens due to modifications in the thermodynamic variables that alter the solubility of alkanes fractions present in petroleum. The deposition of paraffin can provoke significant and growing petroleum losses, arriving to block the flow, hindering to the production. This process is associated with the phases equilibrium L-S and the stages and nucleation, growth and agglomeration the crystals. That process is function of petroleum intrinsic characteristics and temperature and pressure variations, during production. Several preventive and corrective methods are used to control the paraffin crystallization, such as: use of chemical inhibitors, hot solvents injection, use of termochemistry reactions, and mechanical removal. But for offshore exploration this expensive problem needs more investigation. Many studies have been carried through Wax Appearance Temperature (WAT) of paraffin; therefore the formed crystals are responsible for the modification of the reologics properties of the oil, causing a lot off operational problems. From the determination of the WAT of a system it is possible to affirm if oil presents or not trend to the formation of organic deposits, making possible to foresee and to prevent problems of wax crystallization. The solvent n-paraffin has been widely used as fluid of perforation, raising the production costs when it is used in the removal paraffin deposits, needing an operational substitute. This study aims to determine the WAT of paraffin and the interference off additives in its reduction, being developed system paraffin/solvent/surfactant that propitiates the wax solubilization. Crystallization temperatures in varied paraffin concentrations and different solvents were established in the first stage of the experiments. In the second stage, using the methodology of variation of the photoelectric signal had been determined the temperature of crystallization of the systems and evaluated the interferences of additives to reduction of the WAT. The experimental results are expressed in function of the variations of the photoelectric signals during controlled cooling, innovating and validating this new methodology to determine WAT, relatively simple with relation the other applied that involve specific equipments and of high cost. Through the curves you differentiate of the results had been also identified to the critical stages of growth and agglomeration of the crystals that represent to the saturation of the system, indicating difficulties of flow due to the increase of the density

Preparação e caracterização de um material híbrido, à base de vermiculita modificada com quitosana, para a remoção de íons de chumbo presentes em efluentes sintéticos

Actually, surveys have been developed for obtaining new materials and methodologies that aim to minimize environmental problems due to discharges of industrial effluents contaminated with heavy metals. The adsorption has been used as an alternative technology effectively, economically viable and potentially important for the reduction of metals, especially when using natural adsorbents such as certain types of clay. Chitosan, a polymer of natural origin, present in the shells of crustaceans and insects, has also been used for this purpose. Among the clays, vermiculite is distinguished by its good ion exchange capacity and in its expanded form enhances its properties by greatly increasing its specific surface. This study aimed to evaluate the functionality of the hybrid material obtained through the modification of expanded vermiculite with chitosan in the removal of lead ions (II) in aqueous solution. The material was characterized by infrared spectroscopy (IR) in order to evaluate the efficiency of modification of matrix, the vermiculite, the organic material, chitosan. The thermal stability of the material and the ratio clay / polymer was evaluated by thermogravimetry. To evaluate the surface of the material was used in scanning electron microscopy (SEM) and (BET). The BET analysis revealed a significant increase in surface area of vermiculite that after interaction with chitosan, was obtained a value of 21, 6156 m2 / g. Adsorption tests were performed according to the particle size, concentration and time. The results show that the capacity of removal of ions through the vermiculite was on average 88.4% for lead in concentrations ranging from 20-200 mg / L and 64.2% in the concentration range of 1000 mg / L. Regarding the particle size, there was an increase in adsorption with decreasing particle size. In fuction to the time of contact, was observed adsorption equilibrium in 60 minutes with adsorption capacity. The data of the isotherms were fitted to equation Freundlich. The kinetic study of adsorption showed that the pseudo second- order model best describes the adsorption adsorption, having been found following values K2=0,024 g. mg-1 min-1and Qmax=25,75 mg/g, value very close to the calculated Qe = 26.31 mg / g. From the results we can conclude that the material can be used in wastewater treatment systems as a source of metal ions adsorbent due to its high adsorption capacity