Co-evolutionary and Reinforcement Learning Techniques Applied to Computer Go players

The objective of this thesis is model some processes from the nature as evolution and co-evolution, and proposing some techniques that can ensure that these learning process really happens and useful to solve some complex problems as Go game. The Go game is ancient and very complex game with simple rules which still is a challenge for the Artificial Intelligence. This dissertation cover some approaches that were applied to solve this problem, proposing solve this problem using competitive and cooperative co-evolutionary learning methods and other techniques proposed by the author. To study, implement and prove these methods were used some neural networks structures, a framework free available and coded many programs. The techniques proposed were coded by the author, performed many experiments to find the best configuration to ensure that co-evolution is progressing and discussed the results. Using co-evolutionary learning processes can be observed some pathologies which could impact co-evolution progress. In this dissertation is introduced some techniques to solve pathologies as loss of gradients, cycling dynamics and forgetting. According to some authors, one solution to solve these co-evolution pathologies is introduce more diversity in populations that are evolving. In this thesis is proposed some techniques to introduce more diversity and some diversity measurements for neural networks structures to monitor diversity during co-evolution. The genotype diversity evolved were analyzed in terms of its impact to global fitness of the strategies evolved and their generalization. Additionally, it was introduced a memory mechanism in the network neural structures to reinforce some strategies in the genes of the neurons evolved with the intention that some good strategies learned are not forgotten. In this dissertation is presented some works from other authors in which cooperative and competitive co-evolution has been applied. The Go board size used in this thesis was 9x9, but can be easily escalated to more bigger boards.The author believe that programs coded and techniques introduced in this dissertation can be used for other domains.

Fracture propagation and stress corrosion in the case of dissimilar laser hybrid welded joints

The paper addresses the fracture propagation and stress corrosion behaviour of laser hybrid welds achieved between low carbon steel and stainless steel thin sheets. The crack propagation within these overmatched in strength welds was investigated by crack tip opening displacement (CTOD) on CT specimens notched transverse to the weld. A Digital Image Correlation System was used to qualify and estimate the initial crack length obtained by fatigue. The results are associated with the fractographic examinations of various regions of laser hybrid joints. Stress corrosion behaviour of the joint is also discussed.

Diffusion Gradient Temporal Difference for Cooperative Reinforcement Learning with Linear Function Approximation

We introduce a diffusion-based algorithm in which multiple agents cooperate to predict a common and global statevalue function by sharing local estimates and local gradient information among neighbors. Our algorithm is a fully distributed implementation of the gradient temporal difference with linear function approximation, to make it applicable to multiagent settings. Simulations illustrate the benefit of cooperation in learning, as made possible by the proposed algorithm.

Design equations for reinforced concrete members strengthened in shear with external FRP reinforcement formulated in an evolutionary multi-objective framework

Methods for predicting the shear capacity of FRP shear strengthened RC beams assume the traditional approach of superimposing the contribution of the FRP reinforcing to the contributions from the reinforcing steel and the concrete. These methods become the basis for most guides for the design of externally bonded FRP systems for strengthening concrete structures. The variations among them come from the way they account for the effect of basic shear design parameters on shear capacity. This paper presents a simple method for defining improved equations to calculate the shear capacity of reinforced concrete beams externally shear strengthened with FRP. For the first time, the equations are obtained in a multiobjective optimization framework solved by using genetic algorithms, resulting from considering simultaneously the experimental results of beams with and without FRP external reinforcement. The performance of the new proposed equations is compared to the predictions with some of the current shear design guidelines for strengthening concrete structures using FRPs. The proposed procedure is also reformulated as a constrained optimization problem to provide more conservative shear predictions.

The online case study development for the teaching of building structures reinforcement

The Reinforcement of Building Structures is one of the topics of the Master in Building Innovation Technology (MBIT) of Universidad Politécnica de Madrid (UPM). Since the beginning of the delivery of this master, case studies have been chosen as the teaching methodology. For the 2011-2012 course the online education of this subject was implemented, instead of the classical learning based on attendance. Through ICT’s (Information and Communication Technologies) students are provided with much more and more selective information than through the classical learning. ICT’s can be used for search, enquiries and reporting. Using the online tools has been proved, through the results obtained and based on the surveys made amongst students, to be a successful experience.

Study of concrete cracking during accelerated corrosion tests in reinforced concrete

Cracking of reinforced concrete can occur in certain environments due to rebar corrosion. The oxide layer growing around the bars introduces a pressure which may be enough to lead to the fracture of concrete. To study such an effect, the results of accelerated corrosion tests and finite ele- ment simulations are combined in this work. In previous works, a numerical model for the expansive layer, called expansive joint element , was programmed by the authors to reproduce the effect of the oxide over the concrete. In that model, the expansion of the oxide layer in stress free conditions is simulated as an uniform expansion perpendicular to the steel surface. The cracking of concrete is simulated by means of finite elements with an embedded adaptable cohesive crack that follow the standard cohesive model. In the present work, further accelerated tests with imposed constant cur- rent have been carried out on the same type of specimens tested in previous works (with an embedded steel tube), while measuring, among other things, the main-crack mouth opening. Then, the tests have been numerically simulated using the expansive joint element and the tube as the corroding electrode (rather than a bar). As a result of the comparison of numerical and experimental results, both for the crack mouth opening and the crack pattern, new insight is gained into the behavior of the oxide layer. In particular, quantitative assessment of the oxide expansion relation is deduced from the ex- periments, and a narrower interval for the shear stiffness of the oxide layer is obtained, which could not be achieved using bars as the corroding element, because in that case the numerical results were insensitive to the shear stiffness of the oxide layer within many orders of magnitude

Evaluating the reinforcement of inorganic fullerene-like nanoparticles in thermoplastic matrices by depth-sensing indentation

The reinforcing effect of inorganic fullerene-like tungsten disulfide (IF-WS2) nanoparticles in two different polymer matrices, isotactic polypropylene (iPP) and polyphenylene sulfide (PPS), has been investigated by means of dynamic depth-sensing indentation. The hardness and elastic modulus enhancement upon filler addition is analyzed in terms of two main contributions: changes in the polymer matrix nanostructure and intrinsic properties of the filler including matrix-particle load transfer. It is found that the latter mainly determines the overall mechanical improvement, whereas the nanostructural changes induced in the polymer matrix only contribute to a minor extent. Important differences are suggested between the mechanisms of deformation in the two nanocomposites, resulting in a moderate mechanical enhancement in case of iPP (20% for a filler loading of 1%), and a remarkable hardness increase in case of PPS (60% for the same filler content). The nature of the polymer amorphous phase, whether in the glassy or rubbery state, seems to play here an important role. Finally, nanoindentation and dynamic mechanical analysis measurements are compared and discussed in terms of the different directionality of the stresses applied.

Cover cracking of the reinforced concrete due to rebar corrosion induced by chloride penetration

This paper is focused on the problem of the chloride-induced corrosion of the rebar in reinforced concrete, with special application to the slabs and decks of the bridges. High superficial concentrations may be usual in these structures (marine environments or de-icing salts in roadway bridges, e.g.). Like any aggressive agent such as water, gases or other dissolved ions, chloride induced deterioration is very conditioned by possibilities of transport through concrete mass.

Cover cracking of reinforced concrete due to rebar corrosión induced by chloride penetration

Este artículo estudia el proceso de fisuración del hormigón por corrosión de la armadura. Se presenta un modelo de transporte de cloruros en el hormigón, que contempla la no-linealidad de los coeficientes de difusión, las isotermas de absorción y el fenómeno de convección. A partir de los resultados de penetración de cloruros, se establece la corrosión de la armadura con la consiguiente expansión radial. La fisuración del hormigón se estudia con un modelo de fisura embebida. Los dos modelos (iniciación y propagación) se incorporan en un programa de elementos finitos. El modelo se contrasta con resultados experimentales, obteniéndose un buen ajuste. Una de las dificultades es establecer el umbral de concentración de cloruros que da lugar al inicio de la corrosión de la armadura.This paper is focused on the chloride-induced corrosion of the rebar in RC. A comprehensive model for the chloride ingress into concrete is presented, with special attention to non-linear diffusion coefficients, chloride binding isotherms and convection phenomena. Based on the results of chloride diffusion, subsequent active corrosion is assumed and the radial expansion of the corroded reinforcement reproduced. For cracking simulation, the Strong Discontinuity Approach is applied. Both models (initiation and propagation corrosion stages) are incorporated in the same finite element program and chained. Comparisons with experimental results are carried out, with reasonably good agreements being obtained, especially for cracking patterns. Major limitations refer to difficulties to establish precise levels of basic data such as the chloride ion content at concrete surface, the chloride threshold concentration that triggers active corrosion, the rate of oxide production or the rust mechanical properties.

Plaster reinforcement with fibers obtained from the recycle of construction and demolition waste

The main objective of this research is to study the feasibility of recycling fibres from construction and demolition waste (C&DW) as an alternative material to chopped glass fibres which are used today as reinforcing elements in the prefabricated plaster. To do this, sets of samples are made with rockwool and different percentages of combinations between water / plaster. These series are repeated by changing the additive E glass fibre length of 25mm to make a comparative analysis with respect to the series infused with rockwool.

Plaster reinforcement with fibers by mineral wool obtained from the recycle of construction and demolition waste

The use of mineral wool is becoming more widespread due to increased acoustic and thermal demands of Spanish Technical Building Code. This increase affects both in rehabilitation and new construction projects. Therefore, waste generation of this type of insulating material is having more importance. The main objective of this research is to study the possibility of recycling fiber obtained from mineral wool of the C&DW as an alternative material to chopped glass fibers that are currently used as reinforcing elements in the prefabricated plaster. To achieve this objective, series are made of plaster E-35 additived with rock wool residue and glass wool residue at different rates of addition. These series are repeated by changing the additive by E fiberglass (length of 25mm) to make a comparative analysis with respect to the series additived with mineral wool waste. All the series are subjected to the test to determine Shore C surface hardness and mechanical testing to determine the compressive and flexural strength. From the results it can be concluded that: with rock wool residue, increases Shore C hardness up to 15% with respect to the glass fiber and 9% with respect to the glass wool, with a percentage of addition 2%. With rock wool residue, weight is decreased by 5% with respect to the glass fiber and 4% with respect to the glass wool waste, with an addition percentage of 4%. For an addition rate of 4%, results in the flexural strength test with fiberglass are 85% higher than those obtained with glass wool residue. However, for a percentage of 1% addition, the results obtained with glass wool residue are 35% higher than those obtained with fiberglass. For an addition rate of 3% results in the compressive strength test with fiberglass are 54% lower than those obtained with rock wool waste and 70% lower than those obtained with glass wool waste. Comparing the two mineral wools, it can be concluded that up to 3% of the addition, the glass wool series results obtained are 10% higher than those additived with rock wool. However, higher percentages of addition show that the results obtained with rock wool are 35% higher than those obtained with glass wool. The general conclusion is that the series additived with mineral wool from C&DW show better results in tests than the ones used nowadays as plaster reinforcement.

Estudio de la adherencia de armaduras corroídas y su influencia en la capacidad resistente de elementos de hormigón armado

La verificación de la seguridad estructural, tanto de estructuras que permitan un cierto grado de deterioro en su dimensionado como de estructuras existentes deterioradas, necesita disponer de modelos de resistencia que tengan en cuenta los efectos del deterioro. En el caso de la corrosión de las armaduras en las estructuras de hormigón armado, la resistencia depende de múltiples factores tales como la sección del acero corroído, el diagrama tensión-deformación del acero corroído, la adherencia hormigón-acero corroído, la fisuración o desprendimiento del hormigón debido a la expansión de los productos de corrosión. En este sentido, la transferencia de las fuerzas a través de la superficie de contacto entre el hormigón y el acero, la adherencia, es uno de los aspectos más importantes a considerar y es la base del comportamiento del hormigón armado como elemento estructural. La adherencia debe asegurar el anclaje de las armaduras y transmitir la tensión tangencial que aparece en las mismas como consecuencia de la variación de las solicitaciones a lo largo de un elemento estructural. Como consecuencia de la corrosión de las armaduras, el desarrollo de la adherencia se altera y, por tanto, la transferencia de la tensión longitudinal. Esta Tesis Doctoral aborda el comportamiento en estado límite último de la adherencia en el hormigón estructural con armaduras corroídas. El objetivo principal es la obtención de un modelo suficientemente realista y fiable para la evaluación de la adherencia con armaduras corroídas en el marco de la verificación de la seguridad estructural de elementos de hormigón armado con armaduras corroídas. Para ello se ha llevado a cabo un programa experimental de ensayos tipo pull-out excéntricos, con diferentes probetas, unas sin corrosión y otras sometidas tanto a procesos de corrosión natural como a procesos de corrosión acelerada, con diferentes grados de deterioro. Este tipo de ensayo de adherencia representa de forma realista y fiable realista los esfuerzos de adherencia en la zona de anclaje. Por otra parte, para la realización de estos ensayos se ha puesto a punto, además del procedimiento de ensayo, un sistema de adquisición de datos entre los que se incluye el empleo de sensores de tipo fibra óptica con redes de Bragg embebidos en la armadura para determinar los parámetros representativos de la adherencia en el hormigón estructural con armaduras corroídas. Por otra parte, la recopilación de los datos de los estudios de adherencia con armaduras corroídas procedentes de la literatura científica, además de los resultados de la presente investigación, junto con la identificación de las variables relevantes en el comportamiento de la adherencia con armaduras sanas y corroídas ha servido para la obtención de una formulación realista y fiable para la evaluación conjunta de la adherencia con armaduras sanas y corroídas a partir de modelos de regresión múltiple. La formulación propuesta ha sido validada mediante criterios estadísticos y comparada con otras formulaciones propuestas en la literatura científica. Además se ha realizado un análisis de las variables influyentes de la formulación propuesta. También se ha obtenido un modelo numérico simple y eficiente, validado con alguno de los ensayos realizados en esta tesis, para simular la adherencia con armaduras sanas y corroídas. Finalmente, se presenta un procedimiento para realizar la evaluación de vigas deterioradas por corrosión mediante el método de los campos de tensiones que incluye la evaluación de la adherencia mediante la formulación sugerida en esta Tesis Doctoral. Las conclusiones alcanzadas en este trabajo han permitido evaluar la adherencia con armaduras corroídas de forma realista y fiable. Asimismo, se ha podido incluir la evaluación de la adherencia en el marco de la verificación de la seguridad estructural en elementos de hormigón armado deteriorados por corrosión. ABSTRACT Structural safety verification of both structures allowing a certain degree of deterioration in design and deteriorated existing structures needs strength models that factor in the effects of deterioration. In case of corrosion of steel bars in reinforced concrete structures, the resistance depends on many things such as the remaining cross-section of the corroded reinforcement bars, the stress-strain diagrams of steel, the concrete-reinforcement bond and corrosion-induced concrete cracking or spalling. Accordingly, the force transfer through the contact surface between concrete and reinforcement, bond, is one of the most important aspects to consider and it is the basis of the structural performance of reinforced concrete. Bond must assure anchorage of reinforcement and transmit shear stresses as a consequence of the different stresses along a structural element As a consequence of corrosion, the bond development may be affected and hence the transfer of longitudinal stresses. This PhD Thesis deals with ultimate limit state bond behaviour in structural concrete with corrode steel bars. The main objective is to obtain a realistic and reliable model for the assessment of bond within the context of structural safety verifications of reinforced concrete members with corroded steel bars. In that context, an experimental programme of eccentric pull-out tests were conducted, with different specimens, ones without corrosion and others subjected to accelerated or natural corrosion with different corrosion degrees. This type of bond test reproduces in a realistic and reliable way bond stresses in the anchorage zone. Moreover, for conducting these tests it was necessary to develop both a test procedure and also a data acquisition system including the use of an embedded fibre-optic sensing system with fibre Bragg grating sensors to obtain the representative parameters of bond strength in structural concrete with corroded steel bars. Furthermore, the compilation of data from bond studies with corroded steel bars from scientific literature, including tests conducted in the present study, along with the identification of the relevant variables influencing bond behaviour for both corroded and non-corroded steel bars was used to obtain a realistic and reliable formulation for bond assessment in corroded and non-corroded steel bars by multiple linear regression analysis. The proposed formulation was validated with a number of statistical criteria and compared to other models from scientific literature. Moreover, an analysis of the influencing variables of the proposed formulation has been performed. Also, a simplified and efficient numerical model has been obtained and validated with several tests performed in this PhD Thesis for simulating the bond in corroded and non-corroded steel bars. Finally, a proposal for the assessment of corrosion-damaged beams with stress field models including bond assessment with the proposed formulation is presented. The conclusions raised in this work have allowed a realistic and reliable bond assessment in corroded steel bars. Furthermore, bond assessment has been included within the context of structural safety verifications in corrosion-damaged reinforced concrete elements.

Bending reinforcement of timber beams with composite carbon fiber and basalt fiber materials

En el presente trabajo se lleva a cabo un estudio basado en datos obtenidos experimentalmente mediante el ensayo a flexión de vigas de madera de pino silvestre reforzadas con materiales compuestos. Las fibras que componen los tejidos utilizados para la ejecución de los refuerzos son de basalto y de carbono. En el caso de los compuestos de fibra de basalto se aplican en distintos gramajes, y los de carbono en tejido unidireccional y bidireccional. El material compuesto se realizó in situ, simultáneamente a la ejecución del refuerzo. Se aplicaron en una y en dos capas, según el caso, y la forma de colocación fue en ?U?, adhiriéndose al canto inferior y a las caras laterales de la viga mediante resina o mortero epoxi. Se analiza el comportamiento de las vigas según las variables de refuerzo aplicadas y se comparan con los resultados de vigas ensayadas sin reforzar. Con este trabajo queda demostrado el buen funcionamiento del FRP de fibra de basalto aplicado en el refuerzo de vigas de madera y de los tejidos de carbono bidireccionales con respecto a los unidireccionales.

Design of Reinforcement in Concrete Shells: a unified Approach

The problem of design/verification of reinforcement in concrete shells is reviewed. Methods of analysis are classified, and the elastic-plastic approach is described in detail in the general case of shells subjected to both bending and membrane action. The procedure is then reduced to membrane shells (applicable also to concrete walls) and to pure bending, as in the case of plates. The procedure, which is based on previous research,generally requires the use of a desk-top computer.

Consolidación estructural a la espera de nuevas cargas = Structural reinforcement awainting new loads

Artículo en base a extractos de la memoria del proyecto de rehabilitación de las naves 18 y 19 de Matadero Madrid.