Dynamic equilibrium through reinforcement learning

Reinforcement Learning is an area of Machine Learning that deals with how an agent should take actions in an environment such as to maximize the notion of accumulated reward. This type of learning is inspired by the way humans learn and has led to the creation of various algorithms for reinforcement learning. These algorithms focus on the way in which an agent’s behaviour can be improved, assuming independence as to their surroundings. The current work studies the application of reinforcement learning methods to solve the inverted pendulum problem. The importance of the variability of the environment (factors that are external to the agent) on the execution of reinforcement learning agents is studied by using a model that seeks to obtain equilibrium (stability) through dynamism – a Cart-Pole system or inverted pendulum. We sought to improve the behaviour of the autonomous agents by changing the information passed to them, while maintaining the agent’s internal parameters constant (learning rate, discount factors, decay rate, etc.), instead of the classical approach of tuning the agent’s internal parameters. The influence of changes on the state set and the action set on an agent’s capability to solve the Cart-pole problem was studied. We have studied typical behaviour of reinforcement learning agents applied to the classic BOXES model and a new form of characterizing the environment was proposed using the notion of convergence towards a reference value. We demonstrate the gain in performance of this new method applied to a Q-Learning agent.

In vivo and in vitro effects of RAD001 on bladder cancer

Objective: To evaluate the influence of Everolimus (RAD001) on chemically induced urothelial lesions in mice and its influence on in vitro human bladder cancer cell lines. Methods: ICR male mice were given N-butyl-N-(4-hydroxybutyl) nitrosamine in drinking water for a period of 12 weeks. Subsequently, RAD001 was administered via oral gavage, for 6 weeks. At the end of the experiment, all the animals were sacrificed and tumor development was determined by means of histopathologic evaluation; mammalian target of rapamycin (mTOR) expressivity was evaluated by immunohistochemistry. Three human bladder cancer cell lines (T24, HT1376, and 5637) were treated using a range of RAD001 concentrations. MTT assay, terminal deoxynucleotidyl transferase dUTP nick end labeling (TUNEL), and flow cytometry were used to assess cell proliferation, apoptosis index, and cell cycle analysis, respectively. Immunoblotting analysis of 3 cell line extracts using mTOR and Akt antibodies was performed in order to study the expression of Akt and mTOR proteins and their phosphorylated forms. Results: The incidence of urothelial lesions in animals treated with RAD001 was similar to those animals not treated. RAD001 did not block T24 and HT1376 cell proliferation or induce apoptosis. A reduction in cell proliferation rate and therefore G0/G1 phase arrest, as well as a statistically significant induction of apoptosis (P 0.001), was only observed in the 5637 cell line. Conclusion: RAD001 seems not to have a significant effect on chemically induced murine bladder tumors. The effect of RAD001 on tumor proliferation and apoptosis was achieved only in superficial derived bladder cancer cell line, no effect was observed in invasive cell lines.

Interest rate exposure of Spanish banks: A nonparametric analysis

Interest rate risk is one of the major financial risks faced by banks due to the very nature of the banking business. The most common approach in the literature has been to estimate the impact of interest rate risk on banks using a simple linear regression model. However, the relationship between interest rate changes and bank stock returns does not need to be exclusively linear. This article provides a comprehensive analysis of the interest rate exposure of the Spanish banking industry employing both parametric and non parametric estimation methods. Its main contribution is to use, for the first time in the context of banks’ interest rate risk, a nonparametric regression technique that avoids the assumption of a specific functional form. One the one hand, it is found that the Spanish banking sector exhibits a remarkable degree of interest rate exposure, although the impact of interest rate changes on bank stock returns has significantly declined following the introduction of the euro. Further, a pattern of positive exposure emerges during the post-euro period. On the other hand, the results corresponding to the nonparametric model support the expansion of the conventional linear model in an attempt to gain a greater insight into the actual degree of exposure.

A multifactor approach to the social discount rate

This work focuses on the appraisal of public and environmental projects and, more specifically, on the calculation of the social discount rate (SDR) for this kind of very long-term investment projects. As a rule, we can state that the instantaneous discount rate must be equal to the hazard rate of the public good or to the mortality rate of the population that the project is intended to. The hazard can be due to technical failures of the system, but, in this paper, we are going to consider different independent variables that can cause the hazard. That is, we are going to consider a multivariate hazard rate. In our empirical application, the Spanish forest surface will be the system and the forest fire will be the fail that can be caused by several factors. The aim of this work is to integrate the different variables that produce the fail in the calculation of the SDR from a multivariate hazard rate approach.

The problem of estimating the volatility of zero coupon bond interest rate

Financial literature and financial industry use often zero coupon yield curves as input for testing hypotheses, pricing assets or managing risk. They assume this provided data as accurate. We analyse implications of the methodology and of the sample selection criteria used to estimate the zero coupon bond yield term structure on the resulting volatility of spot rates with different maturities. We obtain the volatility term structure using historical volatilities and Egarch volatilities. As input for these volatilities we consider our own spot rates estimation from GovPX bond data and three popular interest rates data sets: from the Federal Reserve Board, from the US Department of the Treasury (H15), and from Bloomberg. We find strong evidence that the resulting zero coupon bond yield volatility estimates as well as the correlation coefficients among spot and forward rates depend significantly on the data set. We observe relevant differences in economic terms when volatilities are used to price derivatives.

Evaluation of the respiratory motion effect in small animal PET images with GATE Monte Carlo simulations

The rapid growth in genetics and molecular biology combined with the development of techniques for genetically engineering small animals has led to increased interest in in vivo small animal imaging. Small animal imaging has been applied frequently to the imaging of small animals (mice and rats), which are ubiquitous in modeling human diseases and testing treatments. The use of PET in small animals allows the use of subjects as their own control, reducing the interanimal variability. This allows performing longitudinal studies on the same animal and improves the accuracy of biological models. However, small animal PET still suffers from several limitations. The amounts of radiotracers needed, limited scanner sensitivity, image resolution and image quantification issues, all could clearly benefit from additional research. Because nuclear medicine imaging deals with radioactive decay, the emission of radiation energy through photons and particles alongside with the detection of these quanta and particles in different materials make Monte Carlo method an important simulation tool in both nuclear medicine research and clinical practice. In order to optimize the quantitative use of PET in clinical practice, data- and image-processing methods are also a field of intense interest and development. The evaluation of such methods often relies on the use of simulated data and images since these offer control of the ground truth. Monte Carlo simulations are widely used for PET simulation since they take into account all the random processes involved in PET imaging, from the emission of the positron to the detection of the photons by the detectors. Simulation techniques have become an importance and indispensable complement to a wide range of problems that could not be addressed by experimental or analytical approaches.

Biodegradation rate constants in different NF/UF fractions of cork processing wastewaters

Cork processing wastewater is an aqueous complex mixture of organic compounds that have been extracted from cork planks during the boiling process. These compounds, such as polysaccharides and polyphenols, have different biodegradability rates, which depend not only on the natureof the compound but also on the size of the compound. The aim of this study is to determine the biochemical oxygen demands (BOD) and biodegradationrate constants (k) for different cork wastewater fractions with different organic matter characteristics. These wastewater fractions were obtained using membrane separation processes, namely nanofiltration (NF) and ultrafiltration (UF). The nanofiltration and ultrafiltration membranes molecular weight cut-offs (MWCO) ranged from 0.125 to 91 kDa. The results obtained showed that the biodegradation rate constant for the cork processing wastewater was around 0.3 d(-1) and the k values for the permeates varied between 0.27-0.72 d(-1), being the lower values observed for permeates generated by the membranes with higher MWCO and the higher values observed for the permeates generated by the membranes with lower MWCO. These higher k values indicate that the biodegradable organic matter that is permeated by the membranes with tighter MWCO is more readily biodegradated.

Cellular uptake of BCG-loaded chitosan microparticles and in vivo evaluation of immune response following intranasal immunisation

Attenuated Mycobacterium bovis bacillus Calmette-Guérin (BCG) is the only currently available vaccine against tuberculosis. It is highly effective in pre-exposure immunisation against TB in children when administered by subcutaneous route to newborns. However, it does not provide permanent protection in adults. In this work, polymeric chitosan-alginate microparticles have been evaluated as potential nasal delivery systems and mucosal adjuvants for live attenuated BCG. Chitosan (CS) has been employed as adjuvant and mucosal permeation-enhancer, and, together with alginate (ALG), as additive to enhance BCG-loaded microparticles (MPs) cellular uptake in a human monocyte cell line, by particle surface modification. The most suitable particles were used for vaccine formulation and evaluation of immune response following intranasal immunisation of BALB/c mice.

Improved matching criterion for frame rate upconversion with trilateral filtering

Frame rate upconversion (FRUC) is an important post-processing technique to enhance the visual quality of low frame rate video. A major, recent advance in this area is FRUC based on trilateral filtering which novelty mainly derives from the combination of an edge-based motion estimation block matching criterion with the trilateral filter. However, there is still room for improvement, notably towards reducing the size of the uncovered regions in the initial estimated frame, this means the estimated frame before trilateral filtering. In this context, proposed is an improved motion estimation block matching criterion where a combined luminance and edge error metric is weighted according to the motion vector components, notably to regularise the motion field. Experimental results confirm that significant improvements are achieved for the final interpolated frames, reaching PSNR gains up to 2.73 dB, on average, regarding recent alternative solutions, for video content with varied motion characteristics.

CCTα

In the cell, the correct folding of many proteins depends on the function of preexisting ones known as Molecular Chaperones (for a review see Hartl and Hayer-Hartl 2009). These, were defined as proteins that bind to and stabilize an otherwise unstable conformation of another protein, and by controlling binding and release, facilitate its correct fate in vivo, be it folding, oligomeric assembly, transport to a particular subcellular compartment, or disposal by degradation. Molecular chaperones do not convey steric information specifying correct folding: instead, they prevent incorrect interactions within and between nonnative peptides, thus typically increasing the yield but not the rate of folding reactions. Molecular chaperones are ubiquitous and comprise several protein families that are structurally unrelated (Hartl and Hayer-Hartl 2009). The Hsp70s and the Chaperonin families have been extensively studied.

Design of a Multiband Full-Rate Ultra-Wideband Receiver in FPGA

MultiBand OFDM (MB-OFDM) UWB [1] is a short-range promising wireless technology for high data rate communications up to 480 Mbps. In this paper, we have designed and implemented in an Virtex-6 FPGA an MB-OFDM UWB receiver for the highest data rate of 480 Mbps. To test the system, we have also implemented an MB-OFDM transmitter and an AWGN generator in VHDL and determined the bit error rates at the receiver running in an FPGA.

Adaptive mutations in bacteria: high rate and small effects

Evolution by natural selection is driven by the continuous generation of adaptive mutations. We measured the genomic mutation rate that generates beneficial mutations and their effects on fitness in Escherichia coli under conditions in which the effect of competition between lineages carrying different beneficial mutations is minimized. We found a rate on the order of 10–5 per genome per generation, which is 1000 times as high as previous estimates, and a mean selective advantage of 1%. Such a high rate of adaptive evolution has implications for the evolution of antibiotic resistance and pathogenicity.

The impact of financial disclosures in the measurement of notional interest rate swaps in the period of 2007-2012

Mestrado em Contabilidade

Rate regulated activities: a problemática do relato financeiro e da sua auditoria: o caso da navegação aérea no contexto europeu

A navegação aérea, enquanto atividade regulada, está sujeita a legislação específica, dependendo o seu exercício de autorização própria atribuída por uma entidade supervisora, que também verifica as tarifas a aplicar. O regulamento (CE) N.º 550/2004 identifica os requisitos comuns para a prestação de serviços de navegação aérea na Europa, dando particular importância à transparência do relato financeiro ao exigir a sua elaboração segundo as normas internacionais de contabilidade e a verificação por uma auditoria independente. Adicionalmente, o Regulamento (EU) N.º 1191/2010, que alterou o Regulamento (CE) N.º 1794/2006, estabelece o regime comum de tarifação de tais serviços, nomeadamente a recuperabilidade de desvios relativos ao volume de tráfego e aos gastos controláveis e não controláveis. Ao nível do enquadramento contabilístico, as atividades reguladas não têm uma norma específica. Existem dois projetos do IASB – um de 2009, que foi suspenso, e um de 2013, relativo à implementação de uma norma transitória que incentive a adoção das normas internacionais por entidades que exerçam atividades reguladas. Existe, ainda, uma norma do FASB não aplicável no espaço europeu. Os R&C de várias entidades evidenciam a existência de diferentes referenciais contabilísticos e que a generalidade dos relatórios de auditoria não tem reservas ou ênfases. Enquanto algumas entidades apenas divulgam os montantes dos desvios, outras entidades consideram que tais montantes se qualificam, reconhecendo-os. Tal facto decorre da inexistência de uma norma internacional que põe em causa a comparabilidade da informação financeira e dificulta o julgamento do auditor quanto à adequação ou não dos procedimentos adotados pela entidade.

H → Zr in the complex two Higgs doublet model

The latest LHC data confirmed the existence of a Higgs-like particle and made interesting measurements on its decays into gamma gamma, ZZ*, WW*, tau(+)tau(-), and b (b) over bar. It is expected that a decay into Z gamma might be measured at the next LHC round, for which there already exists an upper bound. The Higgs-like particle could be a mixture of scalar with a relatively large component of pseudoscalar. We compute the decay of such a mixed state into Z gamma, and we study its properties in the context of the complex two Higgs doublet model, analysing the effect of the current measurements on the four versions of this model. We show that a measurement of the h -> Z gamma rate at a level consistent with the SM can be used to place interesting constraints on the pseudoscalar component. We also comment on the issue of a wrong sign Yukawa coupling for the bottom in Type II models.