Uma contribuição à solução do problema dos k-servos usando aprendizagem por reforço

Neste trabalho é proposto um novo algoritmo online para o resolver o Problema dos k-Servos (PKS). O desempenho desta solução é comparado com o de outros algoritmos existentes na literatura, a saber, os algoritmos Harmonic e Work Function, que mostraram ser competitivos, tornando-os parâmetros de comparação significativos. Um algoritmo que apresente desempenho eficiente em relação aos mesmos tende a ser competitivo também, devendo, obviamente, se provar o referido fato. Tal prova, entretanto, foge aos objetivos do presente trabalho. O algoritmo apresentado para a solução do PKS é baseado em técnicas de aprendizagem por reforço. Para tanto, o problema foi modelado como um processo de decisão em múltiplas etapas, ao qual é aplicado o algoritmo Q-Learning, um dos métodos de solução mais populares para o estabelecimento de políticas ótimas neste tipo de problema de decisão. Entretanto, deve-se observar que a dimensão da estrutura de armazenamento utilizada pela aprendizagem por reforço para se obter a política ótima cresce em função do número de estados e de ações, que por sua vez é proporcional ao número n de nós e k de servos. Ao se analisar esse crescimento (matematicamente, ) percebe-se que o mesmo ocorre de maneira exponencial, limitando a aplicação do método a problemas de menor porte, onde o número de nós e de servos é reduzido. Este problema, denominado maldição da dimensionalidade, foi introduzido por Belmann e implica na impossibilidade de execução de um algoritmo para certas instâncias de um problema pelo esgotamento de recursos computacionais para obtenção de sua saída. De modo a evitar que a solução proposta, baseada exclusivamente na aprendizagem por reforço, seja restrita a aplicações de menor porte, propõe-se uma solução alternativa para problemas mais realistas, que envolvam um número maior de nós e de servos. Esta solução alternativa é hierarquizada e utiliza dois métodos de solução do PKS: a aprendizagem por reforço, aplicada a um número reduzido de nós obtidos a partir de um processo de agregação, e um método guloso, aplicado aos subconjuntos de nós resultantes do processo de agregação, onde o critério de escolha do agendamento dos servos é baseado na menor distância ao local de demanda

Determinação da composição química do molusco Anadara notabilis encontrado em Galinhos no Rio Grande do Norte

Given the large existing biodiversity in the Brazilian coast, where many species are still little known, even under the nutritional aspect, and considering that bivalve molluscs are constituted by a natural resource of well accepted by the population, chose the bivalve Anadara notabilis, it was not found in the literature any nutritional or toxicological information about it and because its size is much larger than other species of mollusks commonly found in this region. Were studied moisture, ash, protein, macro and micro minerals, and metal ions of toxicological significance. All analytical determinations followed the standards of the Institute Adolfo Lutz. The protein determination was performed by the Kjeldahl method. All metal ions were determined by optical emission spectroscopy with inductively coupled plasma (ICP-OES) method described by USEPA 6010C. The results showed that Anadara notabilis can be introduced into food for human beings, in view of its mineral wealth. Noteworthy among the macronutrients phosphorus and magnesium showed that their values in mg / kg 918.7 and 586.7. With regard to micronutrients stand out with this iron 586.7 mg / kg and zinc with 12.31 mg / kg. Was not found high content of metal contaminants to this mollusc, which would prevent their use, only this chromium 0.7 mg / kg above the value established by Brazilian legislation. The results will certainly be very useful in future studies of nutrition and to build a table of chemical composition of Brazilian foods

Eficiência de extração de cobre e níquel utilizando sistemas microemulsionados bifásicos e trifásicos

The environmental impact due to the improper disposal of metal-bearing industrial effluents imposes the need of wastewater treatment, since heavy metals are nonbiodegradable and hazardous substances that may cause undesirable effects to humans and the environment. The use of microemulsion systems for the extraction of metal ions from wastewaters is effective when it occurs in a Winsor II (WII) domain, where a microemulsion phase is in equilibrium with an aqueous phase in excess. However, the microemulsion phase formed in this system has a higher amount of active matter when compared to a WIII system (microemulsion in equilibrium with aqueous and oil phases both in excess). This was the reason to develop a comparative study to evaluate the efficiency of two-phases and three-phases microemulsion systems (WII and WIII) in the extraction of Cu+2 and Ni+2 from aqueous solutions. The systems were composed by: saponified coconut oil (SCO) as surfactant, n-Butanol as cosurfactant, kerosene as oil phase, and synthetic solutions of CuSO4.5H2O and NiSO4.6H2O, with 2 wt.% NaCl, as aqueous phase. Pseudoternary phase diagrams were obtained and the systems were characterized by using surface tension measurements, particle size determination and scanning electron microscopy (SEM). The concentrations of metal ions before and after extraction were determined by atomic absorption spectrometry. The extraction study of Cu+2 and Ni+2 in the WIII domain contributed to a better understanding of microemulsion extraction, elucidating the various behaviors presented in the literature for these systems. Furthermore, since WIII systems presented high extraction efficiencies, similar to the ones presented by Winsor II systems, they represented an economic and technological advantage in heavy metal extraction due to a small amount of surfactant and cosurfactant used in the process and also due to the formation of a reduced volume of aqueous phase, with high concentration of metal. Considering the reextraction process, it was observed that WIII system is more effective because it is performed in the oil phase, unlike reextraction in WII, which is performed in the aqueous phase. The presence of the metalsurfactant complex in the oil phase makes possible to regenerate only the surfactant present in the organic phase, and not all the surfactant in the process, as in WII system. This fact allows the reuse of the microemulsion phase in a new extraction process, reducing the costs with surfactant regeneration

Caracterização de compósitos Nb-20%cu obtidos por moagem de alta energia e sinterizados por fase líquida

In this work, was studied the formation of a composite of the refractory metal niobium with copper, through the process of high-energy milling and liquid phase sintering. The HEM can be used to synthesize composite powders with high homogeneity and fine size particle distribution. It may also produce the solid solubility in immiscible systems such as Nb-Cu, or extend the solubility of systems with limited solubility. Therefore, in the immiscible system Cu-Nb, the high-energy milling was successfully used to obtain the composite powder particles. Initially, the formation of composite particles during the HEM and the effect of preparation technique on the microstructure of the material was evaluated. Four loads of Nb and Cu powders containing 20%wt Cu were synthesized by MAE in a planetary type ball mill under different periods of grinding. The influence of grinding time on the metal particles is evaluated during the process by the withdrawal of samples at intermediate times of milling. After compaction under different forces, the samples were sintered in a vacuum furnace. The liquid phase sintering of these samples prepared by HEM produced a homogeneous and fine grained. The composite particles forming the sintered samples are the addition of a hard phase (Nb) with a high melting point, and a ductile phase (Cu) with low melting point and high thermal and electrical conductivities. Based on these properties, the Nb-Cu system is a potential material for many applications, such as electrical contacts, welding electrodes, coils for generating high magnetic fields, heat sinks and microwave absorbers, which are coupled to electronic devices. The characterization techniques used in this study, were laser granulometry, used to evaluate the homogeneity and particle size, and the X-ray diffraction, in the phase identification and to analyze the crystalline structure of the powders during milling. The morphology and dispersion of the phases in the composite powder particles, as well the microstructures of the sintered samples, were observed by scanning electron microscopy (SEM). Subsequently, the sintered samples are evaluated for density and densification. And finally, they were characterized by techniques of measuring the electrical conductivity and microhardness, whose properties are analyzed as a function of the parameters for obtaining the composite

Síntese, estudo cinético e análise microestrutural do sistema cério-níquel obtido pelo método pechini

The cerium oxide has a high potential for use in removing pollutants after combustion, removal of organic matter in waste water and the fuel-cell technology. The nickel oxide is an attractive material due to its excellent chemical stability and their optical properties, electrical and magnetic. In this work, CeO2-NiO- systems on molars reasons 1:1(I), 1:2(II) e 1:3(III) metal-citric acid were synthesized using the Pechini method. We used techniques of TG / DTG and ATD to monitor the degradation process of organic matter to the formation of the oxide. By thermogravimetric analysis and applying the dynamic method proposed by Coats-Redfern, it was possible to study the reactions of thermal decomposition in order to propose the possible mechanism by which the reaction takes place, as well as the determination of kinetic parameters as activation energy, Ea, pre-exponential factor and parameters of activation. It was observed that both variables exert a significant influence on the formation of complex polymeric precursor. The model that best fitted the experimental data in the dynamic mode was R3, which consists of nuclear growth, which formed the nuclei grow to a continuous reaction interface, it proposes a spherical symmetry (order 2 / 3). The values of enthalpy of activation of the system showed that the reaction in the state of transition is exothermic. The variables of composition, together with the variable temperature of calcination were studied by different techniques such as XRD, IV and SEM. Also a study was conducted microstructure by the Rietveld method, the calculation routine was developed to run the package program FullProf Suite, and analyzed by pseudo-Voigt function. It was found that the molar ratio of variable metal-citric acid in the system CeO2-NiO (I), (II), (III) has strong influence on the microstructural properties, size of crystallites and microstrain network, and can be used to control these properties

Metalização mecânica de ZrO2 com Ti para brasagem ZrO2/Aço com ligas de adição sem metal ativo

Metal/ceramic interfaces using zirconia have dominated the industrial applications in the last decade, due to the high mechanical strength and fracture toughness of zirconia, especially at temperatures below 300 ºC. Also noteworthy is the good ionic conductivity in high temperatures of this component. In this work joining between ZrO2 Y-TZP and ZrO2 Mg-PSZ with austenitic stainless steel was studied. These joints were brazed at high-vacuum after mechanical metallization with Ti using filler alloys composed by Ag-Cu and Ag-Cu-Ni. The influence of the metallization, and the affinity between the different groups (ceramic / filler alloys) was evaluated, in order to achieve strong metal/ceramic joints. Evaluation of joints and interfaces, also the characterization of base materials was implemented using various techniques, such as: x-ray diffraction, leak test, three-point flexural test and scanning electron microscopy with chemical analysis. The microstructural analysis revealed physical and chemical bonds in the metal/ceramic interfaces, providing superior leak proof joints and stress cracking, in order to a good joint in all brazed samples. Precipitation zones and reaction layers with eutetic characteristics were observed between the steel and the filler metal

Caracterização de compósitos Nb-20%cu obtidos por moagem de alta energia e sinterizados por fase líquida

In this work, was studied the formation of a composite of the refractory metal niobium with copper, through the process of high-energy milling and liquid phase sintering. The HEM can be used to synthesize composite powders with high homogeneity and fine size particle distribution. It may also produce the solid solubility in immiscible systems such as Nb-Cu, or extend the solubility of systems with limited solubility. Therefore, in the immiscible system Cu-Nb, the high-energy milling was successfully used to obtain the composite powder particles. Initially, the formation of composite particles during the HEM and the effect of preparation technique on the microstructure of the material was evaluated. Four loads of Nb and Cu powders containing 20%wt Cu were synthesized by MAE in a planetary type ball mill under different periods of grinding. The influence of grinding time on the metal particles is evaluated during the process by the withdrawal of samples at intermediate times of milling. After compaction under different forces, the samples were sintered in a vacuum furnace. The liquid phase sintering of these samples prepared by HEM produced a homogeneous and fine grained. The composite particles forming the sintered samples are the addition of a hard phase (Nb) with a high melting point, and a ductile phase (Cu) with low melting point and high thermal and electrical conductivities. Based on these properties, the Nb-Cu system is a potential material for many applications, such as electrical contacts, welding electrodes, coils for generating high magnetic fields, heat sinks and microwave absorbers, which are coupled to electronic devices. The characterization techniques used in this study, were laser granulometry, used to evaluate the homogeneity and particle size, and the X-ray diffraction, in the phase identification and to analyze the crystalline structure of the powders during milling. The morphology and dispersion of the phases in the composite powder particles, as well the microstructures of the sintered samples, were observed by scanning electron microscopy (SEM). Subsequently, the sintered samples are evaluated for density and densification. And finally, they were characterized by techniques of measuring the electrical conductivity and microhardness, whose properties are analyzed as a function of the parameters for obtaining the composite

Síntese, estudo cinético e análise microestrutural do sistema cério-níquel obtido pelo método pechini

The cerium oxide has a high potential for use in removing pollutants after combustion, removal of organic matter in waste water and the fuel-cell technology. The nickel oxide is an attractive material due to its excellent chemical stability and their optical properties, electrical and magnetic. In this work, CeO2-NiO- systems on molars reasons 1:1(I), 1:2(II) e 1:3(III) metal-citric acid were synthesized using the Pechini method. We used techniques of TG / DTG and ATD to monitor the degradation process of organic matter to the formation of the oxide. By thermogravimetric analysis and applying the dynamic method proposed by Coats-Redfern, it was possible to study the reactions of thermal decomposition in order to propose the possible mechanism by which the reaction takes place, as well as the determination of kinetic parameters as activation energy, Ea, pre-exponential factor and parameters of activation. It was observed that both variables exert a significant influence on the formation of complex polymeric precursor. The model that best fitted the experimental data in the dynamic mode was R3, which consists of nuclear growth, which formed the nuclei grow to a continuous reaction interface, it proposes a spherical symmetry (order 2 / 3). The values of enthalpy of activation of the system showed that the reaction in the state of transition is exothermic. The variables of composition, together with the variable temperature of calcination were studied by different techniques such as XRD, IV and SEM. Also a study was conducted microstructure by the Rietveld method, the calculation routine was developed to run the package program FullProf Suite, and analyzed by pseudo-Voigt function. It was found that the molar ratio of variable metal-citric acid in the system CeO2-NiO (I), (II), (III) has strong influence on the microstructural properties, size of crystallites and microstrain network, and can be used to control these properties