Análise funcional comparativa de algoritmos de aprendizagem por reforço

De entre todos os paradigmas de aprendizagem actualmente identificados, a Aprendizagem por Reforço revela-se de especial interesse e aplicabilidade nos inúmeros processos que nos rodeiam: desde a solitária sonda que explora o planeta mais remoto, passando pelo programa especialista que aprende a apoiar a decisão médica pela experiencia adquirida, até ao cão de brincar que faz as delícias da criança interagindo com ela e adaptando-se aos seus gostos, e todo um novo mundo que nos rodeia e apela crescentemente a que façamos mais e melhor nesta área. Desde o aparecimento do conceito de aprendizagem por reforço, diferentes métodos tem sido propostos para a sua concretização, cada um deles abordando aspectos específicos. Duas vertentes distintas, mas complementares entre si, apresentam-se como características chave do processo de aprendizagem por reforço: a obtenção de experiência através da exploração do espaço de estados e o aproveitamento do conhecimento obtido através dessa mesma experiência. Esta dissertação propõe-se seleccionar alguns dos métodos propostos mais promissores de ambas as vertentes de exploração e aproveitamento, efectuar uma implementação de cada um destes sobre uma plataforma modular que permita a simulação do uso de agentes inteligentes e, através da sua aplicação na resolução de diferentes configurações de ambientes padrão, gerar estatísticas funcionais que permitam inferir conclusões que retractem entre outros aspectos a sua eficiência e eficácia comparativas em condições específicas.

Toplological Entropy in the Syncronization of Piecewise Linear and Monotone Maps. Coupled Duffing Oscillators

In this paper is presented a relationship between the synchronization and the topological entropy. We obtain the values for the coupling parameter, in terms of the topological entropy, to achieve synchronization of two unidirectional and bidirectional coupled piecewise linear maps. In addition, we prove a result that relates the synchronizability of two m-modal maps with the synchronizability of two conjugated piecewise linear maps. An application to the unidirectional and bidirectional coupled identical chaotic Duffing equations is given. We discuss the complete synchronization of two identical double-well Duffing oscillators, from the point of view of symbolic dynamics. Working with Poincare cross-sections and the return maps associated, the synchronization of the two oscillators, in terms of the coupling strength, is characterized.

Magma flow, exsolution processes and rock metasomatism in the Great Messejana-Plasencia dyke (Iberian Peninsula)

Magma flow in dykes is still not well understood; some reported magnetic fabrics are contradictory and the potential effects of exsolution and metasomatism processes on the magnetic properties are issues open to debate. Therefore, a long dyke made of segments with different thickness, which record distinct degrees of metasomatism, the Messejana-Plasencia dyke (MPD), was studied. Oriented dolerite samples were collected along several cross-sections and characterized by means of microscopy and magnetic analyses. The results obtained show that the effects of metasomatism on rock mineralogy are important, and that the metasomatic processes can greatly influence anisotropy degree and mean susceptibility only when rocks are strongly affected by metasomatism. Petrography, scanning electron microscopy (SEM) and bulk magnetic analyses show a high-temperature oxidation-exsolution event, experienced by the very early Ti-spinels, during the early stages of magma cooling, which was mostly observed in central domains of the thick dyke segments. Exsolution reduced the grain size of the magnetic carrier (multidomain to single domain transformation), thus producing composite fabrics involving inverse fabrics. These are likely responsible for a significant number of the 'abnormal' fabrics, which make the interpretation of magma flow much more complex. By choosing to use only the 'normal' fabric for magma flow determination, we have reduced by 50 per cent the number of relevant sites. In these sites, the imbrication angle of the magnetic foliation relative to dyke wall strongly suggests flow with end-members indicating vertical-dominated flow (seven sites) and horizontal-dominated flow (three sites).

Paleomagnetic study of the Great Foum Zguid dyke (southern Morocco): A positive contact test related to metasomatic processes

When a paleomagnetic pole is sought for in an igneous body, the host rocks should be subjected to a contact test to assure that the determined paleopole has the age of the intrusion. If the contact test is positive, it precludes the possibility that the measured magnetization is a later effect. Therefore, we investigated the variations of the remanent magnetization along cross-sections of rocks hosting the Foum Zguid dyke (southern Morocco) and the dyke itself. A positive contact test was obtained, but it is mainly related with Chemical/Crystalline Remanent Magnetization due to metasomatic processes in the host-rocks during magma intrusion and cooling, and not only with Thermo-Remanent Magnetization as ordinarily assumed in standard studies. Paleomagnetic data obtained within the dyke then reflect the Earth magnetic field during emplacement of this well-dated (196.9 +/- 1.8 Ma) intrusion.

Comparison of deposited surface area of airborne ultrafine particles generated from two welding processes

This article describes work performed on the assessment of the levels of airborne ultrafine particles emitted in two welding processes metal-active gas (MAG) of carbon steel and friction-stir welding (FSW) of aluminium in terms of deposited area in alveolar tract of the lung using a nanoparticle surface area monitor analyser. The obtained results showed the dependence from process parameters on emitted ultrafine particles and clearly demonstrated the presence of ultrafine particles, when compared with background levels. The obtained results showed that the process that results on the lower levels of alveolar-deposited surface area is FSW, unlike MAG. Nevertheless, all the tested processes resulted in important doses of ultrafine particles that are to be deposited in the human lung of exposed workers.

Synchronization and Basins of Synchronized in Two-Dimensional Piecewise Maps Via Coupling Three Pieces of One-Dimensional Maps

This paper is devoted to the synchronization of a dynamical system defined by two different coupling versions of two identical piecewise linear bimodal maps. We consider both local and global studies, using different tools as natural transversal Lyapunov exponent, Lyapunov functions, eigenvalues and eigenvectors and numerical simulations. We obtain theoretical results for the existence of synchronization on coupling parameter range. We characterize the synchronization manifold as an attractor and measure the synchronization speed. In one coupling version, we give a necessary and sufficient condition for the synchronization. We study the basins of synchronization and show that, depending upon the type of coupling, they can have very different shapes and are not necessarily constituted by the whole phase space; in some cases, they can be riddled.

Workplace aggression in organizational changing processes: The mediation role of leader political (soft and hard) behavior

One of the main trends in workplace aggression research is studying its antecedents. But the literature also reveals that some predictors remain understudied, like organizational change [1]. Additionally, possible mediators of this relationship were not investigated. The main objective of this research is studding the mediating effect of the leader political behavior (soft and hard version) on the relationship between organizational change and workplace aggression. Participants representing a wide variety of jobs across many organizations were surveyed. The measures used in this research are an Organizational Change Questionnaire climate of change, processes, and readiness [2], a Workplace Aggression Scale [e.g. 3, 4] and a Political Behavior Questionnaire [5]. The results of the study and its theoretical and practical implications will be presented and discussed.

Machine learning Vasicek model calibration with Gaussian processes

In this article, we calibrate the Vasicek interest rate model under the risk neutral measure by learning the model parameters using Gaussian processes for machine learning regression. The calibration is done by maximizing the likelihood of zero coupon bond log prices, using mean and covariance functions computed analytically, as well as likelihood derivatives with respect to the parameters. The maximization method used is the conjugate gradients. The only prices needed for calibration are zero coupon bond prices and the parameters are directly obtained in the arbitrage free risk neutral measure.

Comparison of deposited surface area of airbone ultrafine particles generated from two welding processes

This article describes work performed on the assessment of the levels of airborne ultrafine particles emitted in two welding processes metal-active gas (MAG) of carbon steel and friction-stir welding (FSW) of aluminium in terms of deposited area in alveolar tract of the lung using a nanoparticle surface area monitor analyser. The obtained results showed the dependence from process parameters on emitted ultrafine particles and clearly demonstrated the presence of ultrafine particles, when compared with background levels. The obtained results showed that the process that results on the lower levels of alveolar-deposited surface area is FSW, unlike MAG. Nevertheless, all the tested processes resulted in important doses of ultrafine particles that are to be deposited in the human lung of exposed workers.

Controling delayed transitions with applications to prevent single species extinctions

A new method is proposed to control delayed transitions towards extinction in single population theoretical models with discrete time undergoing saddle-node bifurcations. The control method takes advantage of the delaying properties of the saddle remnant arising after the bifurcation, and allows to sustain populations indefinitely. Our method, which is shown to work for deterministic and stochastic systems, could generally be applied to avoid transitions tied to one-dimensional maps after saddle-node bifurcations.

Brownian bridge and other path-dependent Gaussian processes vectorial simulation

The iterative simulation of the Brownian bridge is well known. In this article, we present a vectorial simulation alternative based on Gaussian processes for machine learning regression that is suitable for interpreted programming languages implementations. We extend the vectorial simulation of path-dependent trajectories to other Gaussian processes, namely, sequences of Brownian bridges, geometric Brownian motion, fractional Brownian motion, and Ornstein-Ulenbeck mean reversion process.

Deterministic approach for multiple-source tsunami hazard assessment for Sines, Portugal

In this paper, we present a deterministic approach to tsunami hazard assessment for the city and harbour of Sines, Portugal, one of the test sites of project ASTARTE (Assessment, STrategy And Risk Reduction for Tsunamis in Europe). Sines has one of the most important deep-water ports, which has oil-bearing, petrochemical, liquid-bulk, coal, and container terminals. The port and its industrial infrastructures face the ocean southwest towards the main seismogenic sources. This work considers two different seismic zones: the Southwest Iberian Margin and the Gloria Fault. Within these two regions, we selected a total of six scenarios to assess the tsunami impact at the test site. The tsunami simulations are computed using NSWING, a Non-linear Shallow Water model wIth Nested Grids. In this study, the static effect of tides is analysed for three different tidal stages: MLLW (mean lower low water), MSL (mean sea level), and MHHW (mean higher high water). For each scenario, the tsunami hazard is described by maximum values of wave height, flow depth, drawback, maximum inundation area and run-up. Synthetic waveforms are computed at virtual tide gauges at specific locations outside and inside the harbour. The final results describe the impact at the Sines test site considering the single scenarios at mean sea level, the aggregate scenario, and the influence of the tide on the aggregate scenario. The results confirm the composite source of Horseshoe and Marques de Pombal faults as the worst-case scenario, with wave heights of over 10 m, which reach the coast approximately 22 min after the rupture. It dominates the aggregate scenario by about 60 % of the impact area at the test site, considering maximum wave height and maximum flow depth. The HSMPF scenario inundates a total area of 3.5 km2. © Author(s) 2015.

In situ NIR spectroscopy monitoring of plasmid production processes effect of producing strain, medium composition and the cultivation strategy

BACKGROUNDWhile the pharmaceutical industry keeps an eye on plasmid DNA production for new generation gene therapies, real-time monitoring techniques for plasmid bioproduction are as yet unavailable. This work shows the possibility of in situ monitoring of plasmid production in Escherichia coli cultures using a near infrared (NIR) fiber optic probe. RESULTSPartial least squares (PLS) regression models based on the NIR spectra were developed for predicting bioprocess critical variables such as the concentrations of biomass, plasmid, carbon sources (glucose and glycerol) and acetate. In order to achieve robust models able to predict the performance of plasmid production processes, independently of the composition of the cultivation medium, cultivation strategy (batch versus fed-batch) and E. coli strain used, three strategies were adopted, using: (i) E. coliDH5 cultures conducted under different media compositions and culture strategies (batch and fed-batch); (ii) engineered E. coli strains, MG1655endArecApgi and MG1655endArecA, grown on the same medium and culture strategy; (iii) diverse E. coli strains, over batch and fed-batch cultivations and using different media compositions. PLS models showed high accuracy for predicting all variables in the three groups of cultures. CONCLUSIONNIR spectroscopy combined with PLS modeling provides a fast, inexpensive and contamination-free technique to accurately monitoring plasmid bioprocesses in real time, independently of the medium composition, cultivation strategy and the E. coli strain used.