Uma contribuição à solução do problema dos k-servos usando aprendizagem por reforço

Neste trabalho é proposto um novo algoritmo online para o resolver o Problema dos k-Servos (PKS). O desempenho desta solução é comparado com o de outros algoritmos existentes na literatura, a saber, os algoritmos Harmonic e Work Function, que mostraram ser competitivos, tornando-os parâmetros de comparação significativos. Um algoritmo que apresente desempenho eficiente em relação aos mesmos tende a ser competitivo também, devendo, obviamente, se provar o referido fato. Tal prova, entretanto, foge aos objetivos do presente trabalho. O algoritmo apresentado para a solução do PKS é baseado em técnicas de aprendizagem por reforço. Para tanto, o problema foi modelado como um processo de decisão em múltiplas etapas, ao qual é aplicado o algoritmo Q-Learning, um dos métodos de solução mais populares para o estabelecimento de políticas ótimas neste tipo de problema de decisão. Entretanto, deve-se observar que a dimensão da estrutura de armazenamento utilizada pela aprendizagem por reforço para se obter a política ótima cresce em função do número de estados e de ações, que por sua vez é proporcional ao número n de nós e k de servos. Ao se analisar esse crescimento (matematicamente, ) percebe-se que o mesmo ocorre de maneira exponencial, limitando a aplicação do método a problemas de menor porte, onde o número de nós e de servos é reduzido. Este problema, denominado maldição da dimensionalidade, foi introduzido por Belmann e implica na impossibilidade de execução de um algoritmo para certas instâncias de um problema pelo esgotamento de recursos computacionais para obtenção de sua saída. De modo a evitar que a solução proposta, baseada exclusivamente na aprendizagem por reforço, seja restrita a aplicações de menor porte, propõe-se uma solução alternativa para problemas mais realistas, que envolvam um número maior de nós e de servos. Esta solução alternativa é hierarquizada e utiliza dois métodos de solução do PKS: a aprendizagem por reforço, aplicada a um número reduzido de nós obtidos a partir de um processo de agregação, e um método guloso, aplicado aos subconjuntos de nós resultantes do processo de agregação, onde o critério de escolha do agendamento dos servos é baseado na menor distância ao local de demanda

Obtenção de Propriedades Físico-Químicas de Misturas de Hidrocarbonetos em Baixa e Alta Pressão Visando a Caracterização e a Modelagem

The composition of petroleum may change from well to well and its resulting characteristics influence significantly the refine products. Therefore, it is important to characterize the oil in order to know its properties and send it adequately for processing. Since petroleum is a multicomponent mixture, the use of synthetic mixtures that are representative of oil fractions provides a better understand of the real mixture behavior. One way for characterization is usually obtained through correlation of physico-chemical properties of easy measurement, such as density, specific gravity, viscosity, and refractive index. In this work new measurements were obtained for density, specific gravity, viscosity, and refractive index of the following binary mixtures: n-heptane + hexadecane, cyclohexane + hexadecane, and benzene + hexadecane. These measurements were accomplished at low pressure and temperatures in the range 288.15 K to 310.95 K. These data were applied in the development of a new method of oil characterization. Furthermore, a series of measurements of density at high pressure and temperature of the binary mixture cyclohexane + n-hexadecane were performed. The ranges of pressure and temperature were 6.895 to 62.053 MPa and 318.15 to 413.15 K, respectively. Based on these experimental data of compressed liquid mixtures, a thermodynamic modeling was proposed using the Peng-Robinson equation of state (EOS). The EOS was modified with scaling of volume and a relatively reduced number of parameters were employed. The results were satisfactory demonstrating accuracy not only for density data, but also for isobaric thermal expansion and isothermal compressibility coefficients. This thesis aims to contribute in a scientific manner to the technological problem of refining heavy fractions of oil. This problem was treated in two steps, i.e., characterization and search of the processes that can produce streams with economical interest, such as solvent extraction at high pressure and temperature. In order to determine phase equilibrium data in these conditions, conceptual projects of two new experimental apparatus were developed. These devices consist of cells of variable volume together with a analytical static device. Therefore, this thesis contributed with the subject of characterization of hydrocarbons mixtures and with development of equilibrium cells operating at high pressure and temperature. These contributions are focused on the technological problem of refining heavy oil fractions

Nitriding in cathodic cage of stainless steel AISI 316: influence of sample position

R.R.M. de Sousa et al. Nitriding in cathodic cage of stainless steel AISI 316: Influence of sample position. Vacuum, [s.l.], n.83, 2009. Disponivel em: . Acesso em: 04 out.2010.

Quantificação de Fases Cristalinas de Incrustações em Colunas de Produção de Petróleo pelo Método Rietveld

The scale is defined as chemical compounds from inorganic nature, initially soluble in salt solutions, which may precipitate accumulate in columns of production and surface equipment. This work aimd to quantify the crystalline phases of scale through the Rietveld method. The study was conducted in scale derived from columns production wells in development and recipients of pigs. After collecting samples of scale were performed the procedure for separations of inorganic and organic phase and preparation to be analyzed at the X-ray Laboratory. The XRD and XRF techniques were used to monitor whether identifying and quantifying crystalline phases present in the deposits. The SEM technique was used to visualize the morphology of the scales and assess their homogeneity after the milling process. XRD measurements were performed with and without milling and with or without the accessory spinner. For quantify crystalline phases the program DBWStools was used. The procedure for conducting the first refinement was instrumental in setting parameters, then the structural parameters of the phases in the sample and finally the parameters of the function profile used. In the diffraction patterns of samples of scale observed that the best measures were those that passed through the mill and used the accessory spinner. Through the results, it was noted that the quantitative analysis for samples of scale is feasible when need to monitor a particular crystalline phase in a well, pipeline or oil field. Routinely, the quantification of phases by the Rietveld method is hardwork because in many scale was very difficult to identify the crystalline phases present

Desenvolvimento de um ressoador retangular de fenda com múltiplas camadas de substrato e com utilização de material PBG para sistema de comunicação sem fio

In the globalized world modern telecommunications have assumed key role within the company, causing a large increase in demand for the wireless technology of communication, which has been happening in recent years have greatly increased the number of applications using this technology. Due to this demand, new materials are developed to enable new control mechanisms and propagation of electromagnetic waves. The research to develop new technologies for wireless communication presents a multidisciplinary study that covers from the new geometries for passive antennas, active up to the development of materials for devices that improve the performance at the frequency range of operation. Recently, planar antennas have attracted interest due to their characteristics and advantages when compared with other types of antennas. In the area of mobile communications the need for antennas of this type has become increasingly used, due to intensive development, which needs to operate in multifrequency antennas and broadband. The microstrip antennas have narrow bandwidth due to the dielectric losses generated by irradiation. Another limitation is the degradation of the radiation pattern due to the generation of surface waves in the substrate. Some techniques have been developed to minimize this limitation of bandwidth, such as the study of type materials PBG - Photonic Band Gap, to form the dielectric material. This work has as main objective the development project of a slot resonator with multiple layers and use the type PBG substrate, which carried out the optimization from the numerical analysis and then designed the device initially proposed for the band electromagnetic spectrum between 3-9 GHz, which basically includes the band S to X. Was used as the dielectric material RT/Duroid 5870 and RT/Duroid 6010.LM where both are laminated ceramic-filled PTFE dielectric constants 2.33 and 10.2, respectively. Through an experimental investigation was conducted an analysis of the simulated versus measured by observing the behavior of the radiation characteristics from the height variation of the dielectric multilayer substrates. We also used the LTT method resonators structures rectangular slot with multiple layers of material photonic PBG in order to obtain the resonance frequency and the entire theory involving the electromagnetic parameters of the structure under consideration. xviii The analysis developed in this work was performed using the method LTT - Transverse Transmission Line, in the field of Fourier transform that uses a component propagating in the y direction (transverse to the real direction of propagation z), thus treating the general equations of the fields electric and magnetic and function. The PBG theory is applied to obtain the relative permittivity of the polarizations for the sep photonic composite substrates material. The results are obtained with the commercial software Ansoft HFSS, used for accurate analysis of the electromagnetic behavior of the planar device under study through the Finite Element Method (FEM). Numerical computational results are presented in graphical form in two and three dimensions, playing in the parameters of return loss, frequency of radiation and radiation diagram, radiation efficiency and surface current for the device under study, and have as substrates, photonic materials and had been simulated in an appropriate computational tool. With respect to the planar device design study are presented in the simulated and measured results that show good agreement with measurements made. These results are mainly in the identification of resonance modes and determining the characteristics of the designed device, such as resonant frequency, return loss and radiation pattern

Redes neurais artificiais no ambiente de redes industriais foundation fieldbus usando blocos funcionais padrões

Industrial automation networks is in focus and is gradually replacing older architectures of systems used in automation world. Among existing automation networks, most prominent standard is the Foundation Fieldbus (FF). This particular standard was chosen for the development of this work thanks to its complete application layer specification and its user interface, organized as function blocks and that allows interoperability among different vendors' devices. Nowadays, one of most seeked solutions on industrial automation are the indirect measurements, that consist in infering a value from measures of other sensors. This can be made through implementation of the so-called software sensors. One of the most used tools in this project and in sensor implementation are artificial neural networks. The absence of a standard solution to implement neural networks in FF environment makes impossible the development of a field-indirect-measurement project, besides other projects involving neural networks, unless a closed proprietary solution is used, which dos not guarantee interoperability among network devices, specially if those are from different vendors. In order to keep the interoperability, this work's goal is develop a solution that implements artificial neural networks in Foundation Fieldbus industrial network environment, based on standard function blocks. Along the work, some results of the solution's implementation are also presented

Sobre a natureza dos processos físicos de aquecimento da atmosfera de estrelas do tipo solar

In the present work, we have studied the nature of the physical processes of the coronal heating, considering as basis significant samples of single and binary evolved stars, that have been achieved with the ROSAT satellite. In a total of 191 simple stars were studied, classified in the literature as giants with spectral type F, G and K. The results were compared with those obtained from 106 evolved stars of spectral type F, G and K, which belong to the spectroscopic binary systems. Accurate measurements on rotation and information about binarity were obtained from De Medeiros s catalog. We have analysed the behavior of the coronal activity in function of diverse stellar parameters. With the purpose to better clarify the profile of the stars evolution, the HR diagram was built for the two samples of stars, the single and the binary ones. The evolved traces added in the diagram were obtained from the Toulouse-Geneve code, Nascimento et al. (2000). The stars were segregated in this diagram not only in range of rotational speed but also in range of X-ray flux. Our analysis shows clearly that the single stars and the binary ones have coronal activity controlled by physical process independent on the rotation. Non magnetic processes seem to be strongly influencing the coronal heating. For the binary stars, we have also studied the behavior of the coronal emission as a function of orbital parameters, such as period and eccentricity, in which it was revealed the existence of a discontinuity in the emission of X-rays around an orbital period of 100 days. The study helped to conclude that circular orbits of the binary stars are presented as a necessary property for the existence of a higher level ofX-rays emission, suggesting that the effect of the gravitational tide has an important role in the coronal activity level. When applied the Kolmogorov-Smirnov test (KS test ) for the Vsini and FX parameters to the samples of single and binary stars, we could evidence very relevant aspects for the understanding of the mechanisms inherent to the coronal activity. For the Vsini parameter, the differences between the single stars and the binary ones for rotation over 6.3 km/s were really remarkable. We believe, therefore, that the existence of gravitational tide is, at least, one of the factors that most contribute for this behavior. About the X-rays flux, the KS test showed that the behavior of the single and the binary stars, regarding the coronal activity, comes from the same origin

Processos de aquecimento na alta atmosfera estelar: emissão coronal em raio-x e emissão cromosférica em CaII

In the present work we study the processes of heating in the high stellar atmosphere, with base in an analysis of behavior of the cromospheric and coronal emission for a sample of single stars classified as giant in the literature. The evolutionary status of the stars of the sample was determined from HIPPARCOS satellite trigonometric parallax measurements and from the Toulouse Genéve code. In this study we show the form of behavior of the CaII emission flux in spectral lines H and K F(CaII) and the X-ray emission flux in function of the rotation, number of Rossby Ro and depth in mass of the convective envelope. In this analysis we show that while the cromospheric activity is dominated clearly by a physical process of heating associated with the rotation, like a magnetic field produced by dynamo effect, the coronal activity seems to be influenced for a mechanism independent of the rotation. We show also that the effective role of the depth in massa of the convective envelope on the stellar activity has an important effect in the responsible physical process for the behavior of the activity in the atmosphere of the stars.

Propriedades magnéticas quase-estáticas de filmes ferromagnéticos amorfos de FeCuNbSiB

Today, one of the topics that attracts interest of the scientific community is the understanding of magnetic properties of magnetic systems with reduced dimensions, in particular, ferromagnetic thin films. In this case, the comprehension and control of these properties, as well as the development of routes to obtain them, are crucial issues in many aspects of current and future technologies for storage and transmission of information in the electro-electronic industry. There are several materials that exhibit soft magnetic properties, and we highlight the amorphous alloys and that ones obtained by partial crystallization, so-called nanocrystalline materials. The production of these alloys as magnetic ribbons is very common in scientific and technological area, but there are just a few works related to the production of these alloys as thin films. In this work, we studied the quasi-static magnetic properties of ferromagnetic thin films based on FeCuNbSiB in a wide range of thicknesses, from 20 to 500 nm, produced by sputtering. In particular, after the structural characterization performed via X-ray diffraction, the magnetic properties of the sets of samples were investigated using experimental magnetization curve, obtained using a vibrating sample magnetometer, as well as through theoretical curves obtained by theoretical modeling and numerical computation. The modeling process is based on the Stoner Wohlfarth model applied to three dimensions, and adds some energy terms, using as reference experimental results of magnetization. In this case, from the comparison between theoretical and experimental results and the analysis of the constant anisotropy behavior as a function of film thickness, we aim to obtain further information on the magnetization process of the samples, to identify routes for the production of thin films and develop a theoretical to films to use it, in the future, in the obtainment of the theoretical curves of some magnetic measurements, such as magnetoimpedance and magnetoresistance

Aplicação de sabões de ácidos graxos epoxidados como inibidores de corrosão em oleoduto

Corrosion usually occurs in pipelines, so that it is necessary to develop new surface treatments to control it. Surfactants have played an outstanding role in this field due to its capacity of adsorbing on metal surfaces, resulting in interfaces with structures that protect the metal at low surfactant concentrations. The appearance of new surfactants is a contribution to the area, as they increase the possibility of corrosion control at specific conditions that a particular oil field presents. The aim of this work is to synthesize the surfactants sodium 12 hydroxyocadecenoate (SAR), sodium 9,10-epoxy-12 hydroxyocadecanoate (SEAR), and sodium 9,10:12,13-diepoxy-octadecanoate (SEAL) and apply them as corrosion inhibitors, studying their action in environments with different salinities and at different temperatures. The conditions used in this work were chosen in order to reproduce oil field reality. The study of the micellization of these surfactants in the liquid-gas interface was carried out using surface tensiometry. It was observed that cmc increased as salt concentration was increased, and temperature and pH were decreased, while cmc decreased with the addition of two epoxy groups in the molecule. Using the values of cmc and the Gibbs equation, the values of Gibbs free energy of adsorption, area per adsorbed molecule, and surface excess were calculated. The surface excess increases as salt concentration and temperature decreases, increasing as pH is increased. The area per adsorbed molecule and the free energy of adsorption decrease with salt concentration, temperature, and pH increase. SAXS results showed that the addition of epoxy group in surfactant structure results in a decrease in the repulsion between the micelles, favoring the formation of more oblong micellar structures, ensuring a better efficiency of metal coverage. The increase in salt and surfactant concentrations provides an increase in micellar diameter. It was shown that the increase in temperature does not influence micellar structure, indicating thermal stability that is advantageous for use as corrosion inhibitor. The results of inhibition efficiency for the surfactants SEAR and SEAL were considered the best ones. Above cmc, adsorption occurred by the migration of micelles from the bulk of the solution to the metal surface, while at concentrations below cmc film formation must be due to the adsorption of semi-micellar and monomeric structures, certainly due to the presence of the epoxy group, which allows side interactions of the molecule with the metal surface. The metal resistance to corrosion presented values of 90% of efficiency. The application of Langmuir and Frumkin isotherms showed that the later gives a better description of adsorption because the model takes into account side interactions from the adsorbing molecules. Wettability results showed that micelle formation on the solid surface occurs at concentrations in the magnitude of 10-3 M, which isthe value found in the cmc study. This value also justifies the maximum efficiencies obtained for the measurements of corrosion resistance at this concentration. The values of contact angle as a function of time suggest that adsorption increases with time, due to the formation of micellar structures on metal surface