Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Acoustic Simulation of a Special Switched Reluctance Drive by Means of Field-Circuit Coupling and Multiphysics Simulation

The approach presented in this paper consists of an energy-based field-circuit coupling in combination with multi-physics simulation of the acoustic radiation of electrical machines. The proposed method is applied to a special switched reluctance motor with asymmetric pole geometry to improve the start-up torque. The pole shape has been optimized, subject to low torque ripple, in a previous study. The proposed approach here is used to analyze the impact of the optimization on the overall acoustic behavior. The field-circuit coupling is based on a temporary lumped-parameter model of the magnetic part incorporated into a circuit simulation based on the modified nodal analysis. The harmonic force excitation is calculated by means of stress tensor computation, and it is transformed to a mechanical mesh by mapping techniques. The structural dynamic problem is solved in the frequency domain using a finite-element modal analysis and superposition. The radiation characteristic is obtained from boundary element acoustic simulation. Simulation results of both rotor types are compared, and measurements of the drive are presented.

Harmonic Distortion State Estimation Using an Evolutionary Strategy

This paper presents a new methodology to estimate harmonic distortions in a power system, based on measurements of a limited number of given sites. The algorithm utilizes evolutionary strategies (ES), a development branch of evolutionary algorithms. The main advantage in using such a technique relies upon its modeling facilities as well as its potential to solve fairly complex problems. The problem-solving algorithm herein proposed makes use of data from various power-quality (PQ) meters, which can either be synchronized by high technology global positioning system devices or by using information from a fundamental frequency load flow. This second approach makes the overall PQ monitoring system much less costly. The algorithm is applied to an IEEE test network, for which sensitivity analysis is performed to determine how the parameters of the ES can be selected so that the algorithm performs in an effective way. Case studies show fairly promising results and the robustness of the proposed method.

Reconfiguration of distribution networks to minimize loss and disruption costs using genetic algorithms

In this paper a computational implementation of an evolutionary algorithm (EA) is shown in order to tackle the problem of reconfiguring radial distribution systems. The developed module considers power quality indices such as long duration interruptions and customer process disruptions due to voltage sags, by using the Monte Carlo simulation method. Power quality costs are modeled into the mathematical problem formulation, which are added to the cost of network losses. As for the EA codification proposed, a decimal representation is used. The EA operators, namely selection, recombination and mutation, which are considered for the reconfiguration algorithm, are herein analyzed. A number of selection procedures are analyzed, namely tournament, elitism and a mixed technique using both elitism and tournament. The recombination operator was developed by considering a chromosome structure representation that maps the network branches and system radiality, and another structure that takes into account the network topology and feasibility of network operation to exchange genetic material. The topologies regarding the initial population are randomly produced so as radial configurations are produced through the Prim and Kruskal algorithms that rapidly build minimum spanning trees. (C) 2009 Elsevier B.V. All rights reserved.

Desalination of water by reverse osmosis using gravitational potential energy and wind energy

This paper proposes ail alternative configuration to conventional reverse osmosis (RO) desalination systems by incorporating the use of gravitational potential energy. The proposal suggests a model that can be viewed as the energy station of a RO desalination plant. Conventionally, RO plants use a high-pressure pump, powered by electricity or fossil fuel. The function of the pump is to send a flux of saline water to a group of semi-permeable membrane modules, capable of ""filtering"" the dissolved salts. In this proposed model, we intend to achieve a flux at the inlet of the membrane modules with a pressure high enough for the desalination process, without using, either electricity or fossil fuels. To do this we divised a hybrid system that uses both gravitational potential energy and wind energy. The technical viability of the alternative was theoretically proven by deductions based on physics and mathematics.

A 2-D Delaunay refinement algorithm using an initial prerefinement from the boundary mesh

An improvement to the quality bidimensional Delaunay mesh generation algorithm, which combines the mesh refinement algorithms strategy of Ruppert and Shewchuk is proposed in this research. The developed technique uses diametral lenses criterion, introduced by L. P. Chew, with the purpose of eliminating the extremely obtuse triangles in the boundary mesh. This method splits the boundary segment and obtains an initial prerefinement, and thus reducing the number of necessary iterations to generate a high quality sequential triangulation. Moreover, it decreases the intensity of the communication and synchronization between subdomains in parallel mesh refinement.

Transmission lines distance protection using artificial neural networks

This work presents the development and implementation of an artificial neural network based algorithm for transmission lines distance protection. This algorithm was developed to be used in any transmission line regardless of its configuration or voltage level. The described ANN-based algorithm does not need any topology adaptation or ANN parameters adjustment when applied to different electrical systems. This feature makes this solution unique since all ANN-based solutions presented until now were developed for particular transmission lines, which means that those solutions cannot be implemented in commercial relays. (c) 2011 Elsevier Ltd. All rights reserved.

DESIGN OF CONCRETE PLATFORMS OFFSHORE USING THE THREE-LAYER SHELL THEORY

The concrete offshore platforms, which are subjected a several loading combinations and, thus, requires an analysis more generic possible, can be designed using the concepts adopted to shell elements, but the resistance must be verify in particular cross-sections to shear forces. This work about design of shell elements will be make using the three-layer shell theory. The elements are subject to combined loading of membrane and plate, totalizing eight components of internal forces, which are three membrane forces, three moments (two out-of-plane bending moments and one in-plane, or torsion, moment) and two shear forces. The design method adopted, utilizing the iterative process proposed by Lourenco & Figueiras (1993) obtained from equations of equilibrium developed by Gupta (1896) , will be compared to results of experimentally tested shell elements found in the literature using the program DIANA.

2D evaluation of crack openings using smeared and embedded crack models

This work deals with the determination of crack openings in 2D reinforced concrete structures using the Finite Element Method with a smeared rotating crack model or an embedded crack model In the smeared crack model, the strong discontinuity associated with the crack is spread throughout the finite element As is well known, the continuity of the displacement field assumed for these models is incompatible with the actual discontinuity However, this type of model has been used extensively due to the relative computational simplicity it provides by treating cracks in a continuum framework, as well as the reportedly good predictions of reinforced concrete members` structural behavior On the other hand, by enriching the displacement field within each finite element crossed by the crack path, the embedded crack model is able to describe the effects of actual discontinuities (cracks) This paper presents a comparative study of the abilities of these 2D models in predicting the mechanical behavior of reinforced concrete structures Structural responses are compared with experimental results from the literature, including crack patterns, crack openings and rebar stresses predicted by both models

BIOLOGICAL NITROGEN REMOVAL OVER NITRITATION/DENITRITATION USING PHENOL AS CARBON SOURCE

A laboratory scale activated sludge sequencing batch reactor was operated in order to obtain total removal of influent ammonia (200; 300 and 500 mg NH(3)-N.L(-1)) with sustained nitrite accumulation at the end of the aerobic stages with phenol (1,000 mg C(6)H(5)OH.L(-1)) as the carbon source for denitrifying microorganisms during the anoxic stages. Ammonia removal above 95% and ratios of (NO(2)(-)-N / (NO(2)(-)-N + NO(3)(-)-N)) ranging from 89 to 99% were obtained by controlling the dissolved oxygen concentration (1.0 mg O(2).L(-1)) and the pH value of 8.3 during the aerobic stages. Phenol proved to be an adequate source of carbon for nitrogen removal via nitrite with continuous feeding throughout part of the anoxic stage. Nitrite concentrations greater than 70.0 mg NO(2)(-)-N.L(-1) inhibited the biological denitritation process.

Numerical solution of the two-phase expansion of a metastable flashing liquid jet using the dispersion-controlled dissipative scheme

This paper presents a study of the stationary phenomenon of superheated or metastable liquid jets, flashing into a two-dimensional axisymmetric domain, while in the two-phase region. In general, the phenomenon starts off when a high-pressure, high-temperature liquid jet emerges from a small nozzle or orifice expanding into a low-pressure chamber, below its saturation pressure taken at the injection temperature. As the process evolves, crossing the saturation curve, one observes that the fluid remains in the liquid phase reaching a superheated condition. Then, the liquid undergoes an abrupt phase change by means of an oblique evaporation wave. Across this phase change the superheated liquid becomes a two-phase high-speed mixture in various directions, expanding to supersonic velocities. In order to reach the downstream pressure, the supersonic fluid continues to expand, crossing a complex bow shock wave. The balance equations that govern the phenomenon are mass conservation, momentum conservation, and energy conservation, plus an equation-of-state for the substance. A false-transient model is implemented using the shock capturing scheme: dispersion-controlled dissipative (DCD), which was used to calculate the flow conditions as the steady-state condition is reached. Numerical results with computational code DCD-2D vI have been analyzed. Copyright (C) 2009 John Wiley & Sons, Ltd.

Simulation of the Barkhausen Noise using random field Ising model with long-range interaction

We present a method to simulate the Magnetic Barkhausen Noise using the Random Field Ising Model with magnetic long-range interaction. The method allows calculating the magnetic flux density behavior in particular sections of the lattice reticule. The results show an internal demagnetizing effect that proceeds from the magnetic long-range interactions. This demagnetizing effect induces the appearing of a magnetic pattern in the region of magnetic avalanches. When compared with the traditional method, the proposed numerical procedure neatly reduces computational costs of simulation. (c) 2008 Published by Elsevier B.V.

Flow Visualization in Arteriovenous Fistula and Aneurysm Using Computational Fluid Dynamics

The arteriovenous fistula (AVF) is characterized by enhanced blood flow and is the most widely used vascular access for chronic haemodialysis (Sivanesan et al., 1998). A large proportion of the AVF late failures are related to local haemodynamics (Sivanesan et al., 1999a). As in AVF, blood flow dynamics plays an important role in growth, rupture, and surgical treatment of aneurysm. Several techniques have been used to study the flow patterns in simplified models of vascular anastomose and aneurysm. In the present investigation, Computational Fluid Dynamics (CFD) is used to analyze the flow patterns in AVF and aneurysm through the velocity waveform obtained from experimental surgeries in dogs (Galego et al., 2000), as well as intra-operative blood flow recordings of patients with radiocephalic AVF ( Sivanesan et al., 1999b) and physiological pulses (Aires, 1991), respectively. The flow patterns in AVF for dog and patient surgeries data are qualitatively similar. Perturbation, recirculation and separation zones appeared during cardiac cycle, and these were intensified in the diastole phase for the AVF and aneurysm models. The values of wall shear stress presented in this investigation of AVF and aneurysm models oscillated in the range that can both cause damage to endothelial cells and develop atherosclerosis.

Nondestructive inspection of plastic deformation in commercial carbon steels using magnetic Barkhausen noise

The present work shows measurements of the Magnetic Barkhausen Noise (MBN) in commercial AISI/SAE 1045 and ASTM 36 steel deformed samples. The correlation between the MBN root mean square, Barkhausen signal profile and MBN power spectrum with the plastic deformation is established. The results show that the power spectral density of the Barkhausen signal is more effective as nondestructive evaluator than root mean square of Barkhausen signal. The Outcomes also suggest the presence of unbalanced tensions between the surface and the bulk of sample due to the presence of plastic deformation.