Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Adaptive Approach for a Maximum Entropy Algorithm in Ecological Niche Modeling

This paper presents an Adaptive Maximum Entropy (AME) approach for modeling biological species. The Maximum Entropy algorithm (MaxEnt) is one of the most used methods in modeling biological species geographical distribution. The approach presented here is an alternative to the classical algorithm. Instead of using the same set features in the training, the AME approach tries to insert or to remove a single feature at each iteration. The aim is to reach the convergence faster without affect the performance of the generated models. The preliminary experiments were well performed. They showed an increasing on performance both in accuracy and in execution time. Comparisons with other algorithms are beyond the scope of this paper. Some important researches are proposed as future works.

A Study of Influence of Configurations of the Windings on the Performance of Single Phase Induction Motor with Capacitor Start

The single phase induction motors needs two stator windings to produce rotating magnetic field : one main winding and the other auxiliary winding. The aim of the auxiliary winding is to create the rotating electromagnetic field when the machine is started-up and is afterwards turned off, generally through the centrifugal switch coupled together with the shaft of the machine rotor. The main purpose of this document is to evaluate the influence that the two windings have on the external characteristics of the single phase induction motor. For this purpose, two different kinds of windings were carried out and simulated, with the proposal to obtain some benefits. The main winding and the auxiliary winding were prepared and mounted on a prototype. The simulation was done via software based FEM, to make the extraction and results analysis possible. This results are shown at the end this document.

Ergonomic Planned Supply in an Automotive Assembly Line

The objective of this research is to identify the benefits of ergonomic improvements in workstations and in planned parts supply in an automotive assembly line. Another aim is to verify to what extent it is possible to create competitive advantages in the manufacturing area with reduction in vehicle assembly time by using technological investments in ergonomics with benefits to the worker and to the company. The Methods Time Measurement (MTM) methodology is chosen to measure the process time differences. To ensure a reliable comparison, a company in Brazil that has two different types of assembly line installations in the same plant was observed, and both assembly lines were under the same influences in terms of human resources, wages, food, and educational level of the staff. In this article, the first assembly line is called ""new"" and was built 6 years ago, with high investments in ergonomic solutions, in the supply system, and in the process. The other is called ""traditional"" and was built 23 years ago with few investments in the area. (C) 2010 Wiley Periodicals, Inc.

Exergy and thermoeconomic analysis of a turbofan engine during a typical commercial flight

In an energy perspective of cost-reduction and configuration-optimization, it becomes necessary to develop and use advanced tools for the analysis, design and improvement of energy conversion systems. In the aeronautical industry, such trend is fundamental since this industry has evolved to design extremely complex aircrafts, with highly integrated systems, requiring more information in order to evaluate the whole system. The aim of this paper is to present an exergy-based analysis as to evaluate the global performance of a typical turbofan engine and its components. The study presents values for exergy efficiency over the whole flight cycle, critical equipment and flight phases considering exergy destruction and estimating internal and exhaust flow costs. (C) 2009 Elsevier Ltd. All rights reserved.

Friction behavior of lubricated zinc phosphate coatings

The aim of the present work is to elucidate the influence of lubricants on the friction behavior of zinc phosphated coatings and provide an explanation for the results in terms of physical-chemical interactions between lubricant and phosphate. The friction behavior was studied through a sliding wear test, with a conventional ball-on-disc configuration. Discs, made of AISI 1006 low carbon steel. uncoated and coated with zinc phosphate, were tested against bearing steel balls. A stearate sodium soap, paraffinic oil and both soap and oil were used as lubricants. The sodium stearate soap was found to have the best seizure resistance. The nature of the interfacial forces between the lubricant and surface has an important role in determining the friction behavior. (C) 2008 Elsevier B.V. All rights reserved.

Experiments on stress-triaxiality dependence of material behavior of aluminum alloys

The paper presents and discusses experimental procedures, visual observations and test results considered important to obtain data that can be used in validation of constitutive relations and failure criteria. The aim is to investigate the combined effects of stress intensity, stress-triaxiality and Lode parameter on the material response and failure behavior of aluminum alloys. Smooth and pre-notched tensile and shear specimens were manufactured from both very thin sheets and thicker plates to cover a wide range of stress triaxialities and Lode parameters. In addition, modified Arcan specimens were designed allowing investigation of the effect of sudden changes in stress states and deformation modes on the material behavior. (C) 2009 Elsevier Ltd. All rights reserved.

Piezoresistive sensor design using topology optimization

Piezoresistive materials, materials whose resistivity properties change when subjected to mechanical stresses, are widely utilized in many industries as sensors, including pressure sensors, accelerometers, inclinometers, and load cells. Basic piezoresistive sensors consist of piezoresistive devices bonded to a flexible structure, such as a cantilever or a membrane, where the flexible structure transmits pressure, force, or inertial force due to acceleration, thereby causing a stress that changes the resistivity of the piezoresistive devices. By applying a voltage to a piezoresistive device, its resistivity can be measured and correlated with the amplitude of an applied pressure or force. The performance of a piezoresistive sensor is closely related to the design of its flexible structure. In this research, we propose a generic topology optimization formulation for the design of piezoresistive sensors where the primary aim is high response. First, the concept of topology optimization is briefly discussed. Next, design requirements are clarified, and corresponding objective functions and the optimization problem are formulated. An optimization algorithm is constructed based on these formulations. Finally, several design examples of piezoresistive sensors are presented to confirm the usefulness of the proposed method.

Quantitative analysis of aluminum dross by the Rietveld method

Aluminum white dross is a valuable material principally due to its high metallic aluminum content. The aim of this work is to develop a method for quantitative analysis of aluminum white dross with high accuracy. Initially, the material was separated into four granulometric fractions by means of screening. Two samples of each fraction were obtained, which were analyzed by means of X-ray fluorescence and energy dispersive spectroscopy in order to determine the elements present in the samples. The crystalline phases aluminum, corundum, spinel, defect spinel, diaoyudaoite, aluminum nitride, silicon and quartz low were identified by X-ray diffraction. The quantitative phase analysis was performed by fitting the X-ray diffraction profile with the Rietveld method using the GSAS software. The following quantitative results were found: 77.8% aluminum, 7.3% corundum, 2.6% spinel, 7.6% defect spinel, 1.8% diaoyudaoite, 2.9% aluminum nitride, and values not significant of quartz and silicon.

Reaction rate and product morphology in carbon composite iron ore pellets with and without Portland cement

The aim of this work is to study the reaction rate and the morphology of intermediate reaction products during iron ore reduction when iron ore and carbonaceous materials are agglomerated together with or without Portland cement. The reaction was performed at high temperatures, and used small size samples in order to minimise heat transfer constraints. Coke breeze and pure graphite were the carbonaceous materials employed. Portland cement was applied as a binder, and pellet diameters were in the range 5.6-6.5 mm. The experimental technique involved the measurement of the pellet weight loss, as well as the interruption of the reaction at different stages, in order to submit the partially reduced pellet to scanning electron microscopy. The experimental temperature was in the range 1423-1623 K, and the total reaction time varied from 240 to 1200 s. It was observed that above 1523 K the formation of liquid slag occurred inside the pellets, which partially dissolved iron oxides. The apparent activation energies obtained were 255 kJ mol(-1) for coke breeze containing pellets, and 230 kJ mol(-1) for those pellets containing graphite. It was possible to avoid heat transfer control of the reaction rate up to 1523 K by employing small composite pellets.

Study on Iron Formation During the Carbothermic Reduction of Iron Ore in Carbon Composite Pellets in the Temperature Range 1423 K-1623 K

The aim of this work is to study the reaction rate and the morphology of the intermediary reaction products during reduction of iron ore, when iron ore and carbonaceous material are agglomerated together as a carbon composite iron ore pellet. The reaction was performed at high temperatures, and in order to avoid heat transfer constraints small size samples were used. The carbonaceous materials employed were coke breeze and pure graphite. Portland cement was employed as a binder, and the pellets diameter was 5.2 mm. The experimental technique involved the measurement of the pellets weight loss, as well as interruption of the reaction at different stages in order to submit the partially reduced pellet to scanning electron microscopy. It has been observed that above 1523 K there is the formation of liquid slag inside the pellets, which partially dissolves iron oxides. The apparent activation energies obtained were 255 kJ/mol for coke breeze containing pellets, and 230 kJ/mol for those pellets containing graphite. It was possible to avoid heat transfer control of the reaction rate up to 1523 K by employing small composite pellets.

Influence of Temperature, Basiscity and Particle Size on MnO Reduction

The aim of this work is to study MnO reduction by solid carbon. The influence of size of carbon particles, slag basicity, and bath temperature on MnO reduction was investigated. Fine Manganese ore particles were used as a source of MnO. Three sizes of carbon particles were used; 0.230 mm, 0.162 mm and 0.057 mm, binary basicity of 1 and 1.5 and temperatures of 1550, 1550 and 1600 degrees C. Curves were drawn for Mn content in the bath as a function of time and temperature for the several studied parameters. The MnO reduction rates were determined using these data. [doi:10.2320/matertrans.M2011007]

Electrochemical impedance spectroscopy investigation of the electrochemical behaviour of copper coated with artificial patina layers and submitted to wet and dry cycles

Due to rain events historical monuments exposed to the atmosphere are frequently submitted to wet and dry cycles. During drying periods wetness is maintained in some confined regions and the corrosion product layer, generally denominated patinas, builds up and gets thicker. The aim of this study is to use electrochemical impedance spectroscopy (EIS) to investigate the electrochemical behaviour of pure copper coated with two artificial patina layers and submitted either to continuous or to intermittent immersion tests, this latter aiming to simulate wet and dry cycles. The experiments were performed in 0.1 mol dm(-3) NaCl solution and in artificial rainwater containing the most significant pollutants of the city of Sao Paulo. The results of the continuous immersion tests in the NaCl solution have shown that the coated samples behave like a porous electrode with finite pore length. On the other hand, in the intermittent tests a porous electrode response with semi-infinite pore length can be developed. The results were interpreted based on the model of de Levie and a critical comparison with previous interpretations reported in the literature for similar systems is presented. (C) 2011 Elsevier Ltd. All rights reserved.

Batch Liquid-Liquid Extraction of Phenol from Aqueous Solutions

The aim of this work is the study of batch liquid-liquid extraction of phenol from aqueous solutions in a bench-scale well-mixed reactor. The influence of the ratio of phase volumes, temperature, and rotational speed on phenol removal (0.72-1.1% w/w) was investigated using methyl isobutyl ketone as an extracting solvent. For this purpose, the ratio of phase volumes were set at 0.1 and 0.2, the temperature at 10, 20, and 30 degrees C, and the rotational speed at 300, 400, and 500 rpm. A physical model based on the material balance of the phases as well as the equation of mass flux between the phases allowed the estimation of the overall coefficient of mass transfer coupled with the superficial area. Moreover, it proved to fit, satisfactorily well, the experimental data of residual phenol concentration in the organic phase versus time under all the conditions investigated.

Corrosion resistant and adsorbent plasma polymerized thin film

Adsorbent and corrosion resistant films are useful for sensor development. Therefore, the aim of this work is the production and characterization of plasma polymerized fluorinated organic ether thin films for sensor development. The polymerized reactant was methyl nonafluoro(iso)butyl ether. Infrared Spectroscopy showed fluorinated species and eventually CO but CH(n) is a minor species. Contact angle measurements indicated that the film is hydrophobic and organophilic but oleophobic. Optical microscopy reveals not only a good adherence on metals and acrylic but also resistance for organic solvents, acid and basic aqueous solution exposure. Double layer and intermixing are possible and might lead to island formation. Quartz Crystal Microbalance showed that 2-propanol permeates the film but there is no sensitivity to n-hexane. The microreactor manufactured using a 73 cm long microchannel can retain approximately 9 X 10(-4) g/cm(2) of 2-propanol in vapor phase. Therefore, the film is a good candidate for preconcentration of volatile organic compounds even in corrosive environment. (C) 2009 Elsevier B.V. All rights reserved.