Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

How short and light can a simple pendulum be for classroom use?

We compare the period of oscillation of an ideal simple pendulum with the period of a more 'real' pendulum constituted of a rigid sphere and a rigid slender rod. We determine the relative error in the calculation of the local acceleration of gravity if the period of the ideal pendulum is use?d instead of the period of this real pendulum. © 2014 IOP Publishing Ltd..

Dimensionamento de estruturas de suporte rígidas

A Norma Portuguesa EN 1997-1:2007 - Eurocódigo 7 (EC 7) quando comparada, quer com a versão anterior ENV 1997-1:1994, cujo estatuto foi de pré-norma, quer com a prática tradicional corrente, introduz alterações significativas na abordagem ao dimensionamento geotécnico de estruturas de suporte. Assim, neste trabalho pretende-se aplicar a abordagem por meio de cálculos preconizada na Norma ao caso do dimensionamento de estruturas de suporte rígidas, comparando-a com os critérios tradicionais de dimensionamento utilizados em Portugal. Para tal realizou-se o plano de estudos seguinte: i) recensão bibliográfica síntese sobre o tema; ii) formulação geral do problema da verificação da segurança de estruturas de suporte rígidas de acordo com o preconizado no EC 7 e: iii) desenvolvimento de uma aplicação em Excel para a verificação da segurança daquelas estruturas nos moldes preconizados no EC 7. A folha de cálculo foi utilizada para comparar, através de dois exemplos - um relativo a um muro gravidade, e o outro relativo a um muro em T invertido - as diferenças entre a via tradicional e o EC 7 no respectivo dimensionamento.

Seismic imaging of the western Iberian crust using ambient noise: Boundaries and internal structure of the Iberian Massif

We present new Rayleigh-wave dispersion maps of the western Iberian Peninsula for periods between 8 and 30 s, obtained from correlations of seismic ambient noise, following the recent increase in seismic broadband network density in Portugal and Spain. Group velocities have been computed for each station pair using the empirical Green's functions generated by cross-correlating one-day-length seismic ambient-noise records. The resulting high-path density allows us to obtain lateral variations of the group velocities as a function of period in cells of 0.5 degrees x 0.5 degrees with an unprecedented resolution. As a result we were able to address some of the unknowns regarding the lithospheric structure beneath SW Iberia. The dispersion maps allow the imaging of the major structural units, namely the Iberian Massif, and the Lusitanian and Algarve Meso-Cenozoic basins. The Cadiz Gulf/Gibraltar Strait area corresponds to a strong low-velocity anomaly, which can be followed to the largest period inverted, although slightly shifted to the east at longer periods. Within the Iberian Massif, second-order perturbations in the group velocities are consistent with the transitions between tectonic units composing the massif. (C) 2013 Elsevier B.V. All rights reserved.

Low Profile Multi-Band Antenna for Mobile Communications

In this paper, the design of low profile antennas by using Electromagnetic Band Gap (EBG) structures is introduced. Taking advantage of the fact that they can behave as Perfect Magnetic Conductor (PMC), it is shown that these structures exhibit dual band in-phase reflection at WLAN (Wireless Local Area Network) bands, the 2.4 GHz and 5.2 GHz bands. These structures are applied to PIFA (Planar Inverted-F Antenna) and the results show that it is possible to obtain low profile PIFA's.

A new bridge between leptonic CP violation and leptogenesis

Flavour effects due to lepton interactions in the early Universe may have played an important role in the generation of the cosmological baryon asymmetry through leptogenesis. If the only source of high-energy CP violation comes from the left-handed leptonic sector, then it is possible to establish a bridge between flavoured leptogenesis and low-energy leptonic CP violation. We explore this connection taking into account our present knowledge about low-energy neutrino parameters and the matter-antimatter asymmetry observed in the Universe. In this framework, we find that leptogenesis favours a hierarchical light neutrino mass spectrum, while for quasi-degenerate and inverted hierarchical neutrino masses there is a very narrow allowed window. The absolute neutrino mass scale turns out to be m less than or similar to 0.1 eV. (c) 2007 Elsevier B.V. All rights reserved.

Projeto e construção de subestações

Relatório de Estágio para obtenção do grau de Mestre em Engenharia Civil

Constrains on the structure of Maio Island (Cape Verde) by a three-dimensional gravity model: Imaging partially exhumed magma chambers

We propose a 3-D gravity model for the volcanic structure of the island of Maio (Cape Verde archipelago) with the objective of solving some open questions concerning the geometry and depth of the intrusive Central Igneous Complex. A gravity survey was made covering almost the entire surface of the island. The gravity data was inverted through a non-linear 3-D approach which provided a model constructed in a random growth process. The residual Bouguer gravity field shows a single positive anomaly presenting an elliptic shape with a NWSE trending long axis. This Bouguer gravity anomaly is slightly off-centred with the island but its outline is concordant with the surface exposure of the Central Igneous Complex. The gravimetric modelling shows a high-density volume whose centre of mass is about 4500 m deep. With increasing depth, and despite the restricted gravimetric resolution, the horizontal sections of the model suggest the presence of two distinct bodies, whose relative position accounts for the elongated shape of the high positive Bouguer gravity anomaly. These bodies are interpreted as magma chambers whose coeval volcanic counterparts are no longer preserved. The orientation defined by the two bodies is similar to that of other structures known in the southern group of the Cape Verde islands, thus suggesting a possible structural control constraining the location of the plutonic intrusions.

New textures for the lepton mass matrices

We study predictive textures for the lepton mass matrices in which the charged-lepton mass matrix has either four or five zero matrix elements while the neutrino Majorana mass matrix has, respectively, either four or three zero matrix elements. We find that all the viable textures of these two kinds share many predictions: the neutrino mass spectrum is inverted, the sum of the light-neutrino masses is close to 0.1 eV, the Dirac phase delta in the lepton mixing matrix is close to either 0 or pi, and the mass term responsible for neutrinoless double-beta decay lies in between 12 and 22 meV. (C) 2014 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license.

Upper crustal structure of Madeira Island revealed from ambient noise tomography

We present the first image of the Madeira upper crustal structure, using ambient seismic noise tomography. 16 months of ambient noise, recorded in a dense network of 26 seismometers deployed across Madeira, allowed reconstructing Rayleigh wave Green's functions between receivers. Dispersion analysis was performed in the short period band from 1.0 to 4.0 s. Group velocity measurements were regionalized to obtain 20 tomographic images, with a lateral resolution of 2.0 km in central Madeira. Afterwards, the dispersion curves, extracted from each cell of the 2D group velocity maps, were inverted as a function of depth to obtain a 3D shear wave velocity model of the upper crust, from the surface to a depth of 2.0 km. The obtained 3D velocity model reveals features throughout the island that correlates well with surface geology and island evolution. (C) 2015 Elsevier B.V. All rights reserved.

Upper crustal structure of Madeira Island revealed from ambient noise tomography

We present the first image of the Madeira upper crustal structure, using ambient seismic noise tomography. 16 months of ambient noise, recorded in a dense network of 26 seismometers deployed across Madeira, allowed reconstructing Rayleigh wave Green's functions between receivers. Dispersion analysis was performed in the short period band from 1.0 to 4.0 s. Group velocity measurements were regionalized to obtain 20 tomographic images, with a lateral resolution of 2.0 km in central Madeira. Afterwards, the dispersion curves, extracted from each cell of the 2D group velocity maps, were inverted as a function of depth to obtain a 3D shear wave velocity model of the upper crust, from the surface to a depth of 2.0 km. The obtained 3D velocity model reveals features throughout the island that correlates well with surface geology and island evolution. (C) 2015 Elsevier B.V. All rights reserved.

Ambient noise tomography of the East African Rift in Mozambique

Seismic ambient noise tomography is applied to central and southern Mozambique, located in the tip of the East African Rift (EAR). The deployment of MOZART seismic network, with a total of 30 broad-band stations continuously recording for 26 months, allowed us to carry out the first tomographic study of the crust under this region, which until now remained largely unexplored at this scale. From cross-correlations extracted from coherent noise we obtained Rayleigh wave group velocity dispersion curves for the period range 5–40 s. These dispersion relations were inverted to produce group velocity maps, and 1-D shear wave velocity profiles at selected points. High group velocities are observed at all periods on the eastern edge of the Kaapvaal and Zimbabwe cratons, in agreement with the findings of previous studies. Further east, a pronounced slow anomaly is observed in central and southern Mozambique, where the rifting between southern Africa and Antarctica created a passive margin in the Mesozoic, and further rifting is currently happening as a result of the southward propagation of the EAR. In this study, we also addressed the question concerning the nature of the crust (continental versus oceanic) in the Mozambique Coastal Plains (MCP), still in debate. Our data do not support previous suggestions that the MCP are floored by oceanic crust since a shallow Moho could not be detected, and we discuss an alternative explanation for its ocean-like magnetic signature. Our velocity maps suggest that the crystalline basement of the Zimbabwe craton may extend further east well into Mozambique underneath the sediment cover, contrary to what is usually assumed, while further south the Kaapval craton passes into slow rifted crust at the Lebombo monocline as expected. The sharp passage from fast crust to slow crust on the northern part of the study area coincides with the seismically active NNE-SSW Urema rift, while further south the Mazenga graben adopts an N-S direction parallel to the eastern limit of the Kaapvaal craton. We conclude that these two extensional structures herald the southward continuation of the EAR, and infer a structural control of the transition between the two types of crust on the ongoing deformation.