A reinforcement learning based algorithm for finite horizon Markov decision processes

We develop a simulation based algorithm for finite horizon Markov decision processes with finite state and finite action space. Illustrative numerical experiments with the proposed algorithm are shown for problems in flow control of communication networks and capacity switching in semiconductor fabrication.

Investigations on sand reinforced with different geosynthetics

This paper presents results of triaxial compression tests on sand reinforced with different types of geosynthetics in different layer configurations to study the effect of quantity of reinforcement and tensile strength of the geosynthetic material on the mechanical behavior of geosynthetic-reinforced sand. The reinforcement types used are woven geotextile, geogrid, and polyester film. The layer configurations used are two, three, four, and eight horizontal reinforcing layers in a triaxial test sample. From the triaxial tests, it is found that the geosynthetic reinforcement imparts cohesive strength to otherwise cohesionless sand. The effect of reinforcement on the friction angle was found to be insignificant. The magnitude of imparted apparent cohesion is found to depend not only on the tensile strength of the geosynthetic material but also the surface roughness changes during loading. Special triaxial tests using rice flour as the reinforced medium, microscopic images, and surface roughness studies revealed the effect of indent formation on the surface of polyester film, which was the reason for the unusually high strength exhibited by the sand reinforced with polyester film.

Effect of densification and TiB2 reinforcement on the wear of molybdenum disilicide

Wear tests were done in a pin-on-disc machine by sliding MoSi2 pins against hard-steel discs in a normal load range of 5-140 N and a speed of 0.5 m/s under nominally dry conditions in the ambient. The specific wear rate of the pin undergoes two transitions: severe to mild at low load and mild to severe at high load. The mild-wear domain is distinguished by the formation of a protective mechanically mixed layer of steel and its oxides, transferred from the counterface in particulate form. Increasing the hardness by densification and TiB2 reinforcement lowers the specific wear rate and expands the mild-wear load domain. However, even when the volume wear rate is normalised with respect to the real contact area (load/hardness) the non-dimensional wear factor is still seen to decrease with densification and reinforcement. This indicates that fracture toughness may also play an important role in determining the wear-resistance of these materials. The surface coverage on the pin by the mechanically mixed layer increases with densification and reinforcement.

Microwave driven hydrothermal synthesis of LiMn2O4 nanoparticles as cathode material for Li-ion batteries

Among the various cathode materials studied for Li-ion batteries over the past many years, spinet LiMn2O4 is found to be one of the most attractive materials. Nanoparticles of the electrode materials sustain high rate capability due to large surface to volume ratio and small diffusion path length. Nanoparticles of spinel LiMn2O4 have been synthesized by microwave hydrothermal technique using prior synthesized amorphous MnO2 and LiOH. The phase and purity of spinel LiMn2O4 are confirmed by powder X-ray diffraction. The morphological studies have been investigated using field emission scanning electron microscopy and high-resolution transmission electron microscopy. The electrochemical performances of the material for Li insertion/extraction are evaluated by cyclic voltammetry, galvanostatic charge-discharge cycling and AC impedance studies. The initial discharge capacity is found to be about 89 mAh g(-1) at current density of 21 mA g(-1). (C) 2010 Elsevier B.V. All rights reserved.

Sonochemical synthesis of Ce1-xFexO2-delta (0 <= x <= 0.45) and Ce0.65Fe0.33Pd0.02O2-delta nanocrystallites: oxygen storage material, CO oxidation and water gas shift catalyst

Nanocrystalline Ce1-xFexO2-delta (0 <= x <= 0.45) and Ce0.65Fe0.33Pd0.02O2-delta of similar to 4 nm sizes were synthesized by a sonochemical method using diethyletriamine (DETA) as a complexing agent. Compounds were characterized by powder X-ray diffraction (XRD), X-ray photo-electron spectroscopy (XPS) and transmission electron microscopy (TEM). Ce1-xFexO2-delta (0 <= x <= 0.45) and Ce0.65Fe0.33Pd0.02O2-delta crystallize in fluorite structure where Fe is in +3, Ce is in +4 and Pd is in +2 oxidation state. Due to substitution of smaller Fe3+ ion in CeO2, lattice oxygen is activated and 33% Fe substituted CeO2 i.e. Ce0.67Fe0.33O1.835 reversibly releases 0.31O] up to 600 degrees C which is higher or comparable to the oxygen storage capacity of CeO2-ZrO2 based solid solutions (Catal. Today 2002, 74, 225-234). Due to interaction of redox potentials of Pd2+/0(0.89 V) and Fe3+/2+ (0.77 V) with Ce4+/3+ (1.61 V), Pd ion accelerates the electron transfer from Fe2+ to Ce4+ in Ce0.65Fe0.33Pd0.02O1.815, making it a high oxygen storage material as well as a highly active catalyst for CO oxidation and water gas shift reaction. The activation energy for CO oxidation with Ce0.65Fe0.33Pd0.02O1.815 is found to be as low as 38 kJ mol(-1). Ce0.67Fe0.33O1.835 and Ce0.65Fe0.33Pd0.02O1.815 have also shown high activity for the water gas shift reaction. CO conversion to CO2 is 100% H-2 specific with these catalysts and conversion rate was found to be as high 27.2 mu moles g(-1) s(-1) and the activation energy was found to be 46.4 kJ mol(-1) for Ce0.65Fe0.33Pd0.02O1.815.

Technique for Using Fine-Grained Soil in Reinforced Earth

The performance of reinforced earth structures depends on the mobilization of interfacial shearing resistance between soil and reinforcement. This criterion typically eliminates the use of fine-grained soil as a backfill material in reinforced earth structures. Considering the distribution of induced interfacial shear stress in soil around the surface of the reinforcement, it has been shown that only a thin zone of frictional material around the reinforcement is required to mobilize almost full interfacial shearing resistance of sand. Six series of pullout tests have been conducted, with different types of reinforcement, to study the effect of thickness of sand (frictional material) around the reinforcement on the pullout resistance. Sawdust and kaolin clay have been used as bulk backfill material, providing the soil with negligible friction. With low-friction-strength soil as bulk material, a 15-mm thickness of sand around the reinforcement is required to increase the interfacial shearing resistance to that with sand as the bulk material. With this new technique, low-frictional fine-grained soils can be used as bulk backfill material in reinforced earth constructions.

Evaluation of Erosion Resistance of Metallic Materials and the Role of Material Properties in Correlations

A study of the correlations between material properties and normalized erosion resistance (inverse of erosion rates) of various materials tested in the rotating disk and the flow venturi at various intensities indicates that different individual properties influence different stages of erosion. At high and low intensities of erosion, energy properties predominate the phenomenon, whereas at intermediate intensities strength and acoustic properties become more significant. However, both strength and energy properties are significant in the correlations for the entire spectrum of erosion when extensive cavitation and liquid impingement data from several laboratories involving different intensities and hydrodynamic conditions are considered. The use of true material properties improved the statistical parameters by 3 to 37%, depending on the intensity of erosion. It is possible to evaluate qualitatively the erosion resistances of materials based on the true stress-true strain curves.

Platinum particles supported on titanium nitride: an efficient electrode material for the oxidation of methanol in alkaline media

In the present study, titanium nitride which shows exceptional stability, extreme corrosion resistance, good electronic conductivity and adhesion behaviour is used to support platinum particles and then used for methanol oxidation in an alkaline medium. The catalyst shows very good CO tolerance for the electrochemical oxidation of methanol. In situ infrared spectroelectrochemical data show the remarkable ability of TiN to decompose water at low over potentials leading to -OH type functional groups on its surface which in turn help in alleviating the carbon monoxide poisoning associated with methanol oxidation. TiN supported catalysts are found to be very good in terms of long term stability, exchange current density and stable currents at low over voltages. Supporting evidence from X-ray photoelectron spectroscopic data and cyclic voltammetry clearly demonstrates the usefulness of TiN supported Pt catalysts for efficient methanol oxidation in alkaline media.

Mechanical Properties of Al-Mica Particulate Composite Material

Cast aluminium alloy mica particle composites of varying mica content were tested in tension, compression, and impact. With 2.2 percent mica (size range 40µm – 120µm) the tensile and compression strengths of aluminium alloy decreased by 56 and 22 percent, respectively. The corresponding decreases in percent elongation and percent reduction are 49 and 39 percent. Previous work [2] shows that despite this decrease in strength the composite with 2.5 percent mica and having an UTS of 15 kg/mm2 and compression strength of 28 kg/mm2 performs well as a bearing material under severe running conditions. The differences in strength characteristics of cast aluminium-mica particle composites between tension and compression suggests that, as in cast iron, expansion of voids at the matrix particle interface may be the guiding mechanism of the deformation. SEM studies show that on the tensile fractured specimen surface, there are large voids at the particle matrix interface.

Dynamic growth of tensile cracks by ductile and brittle fracture mechanisms in a viscoplastic material

In this paper, a finite element analysis of steady-state dynamic crack growth under Mode I, plane strain, small-scale yielding conditions is performed in a rate dependent plastic material characterized by the over-stress model. The main objective of the paper is to obtain theoretically the dependence of dynamic fracture toughness on crack speed. Crack propagation due to a ductile (micro-void) mechanism or a brittle (cleavage) mechanism, as well as transition from one mode to another are considered. The conversion from ductile to brittle has been observed experimentally but has received very little attention using analytical methods. Local fracture criteria based on strains and stresses are used to describe ductile and brittle fracture mechanisms. The results obtained in this paper are in general agreement with micro-structural observations of mode conversion during fracture initiation. Finally, the particular roles played by material rate sensitivity and inertia are examined in some detail.

Interferometry with a novel composite material

An interesting application of optical phase conjugation is phase conjugate interferometry. We report here a new approach to real-time interferometry which combines the high phase conjugate efficiency of photorefractive crystals and the fast response times offered by dye-doped polymer films by using a composite structure. The ability of this material to generate two independent but overlapping phase conjugate waves. which can interfere to reveal the phase changes in a test object, is discussed and demonstrated with a specific example.

Structural refinement using high-resolution powder X-ray diffraction data of Ca0.5Ti2P3O12, a low-thermal-expansion material

The structures of Ca0.5Ti2P3O12 and Sr0.5Ti2P3O12, low-thermal-expansion materials, have been refined by the Rietveld method using high-resolution powder X-ray diffraction (XRD) data. The assignment of space group R[3 with combining macron] to NASICON-type compounds containing divalent cations is confirmed. 31P magic-angle spinning nuclear magnetic resonance (MASNMR) data are presented as supporting data. A comparison of changes in the polyhedral network resulting from the cation distribution, is made with NaTi2P3O12 and Nb2P3O12. Factors that may govern thermal expansion in this family of compounds are discussed.

Coupled electrostatic-elastic analysis for topology optimization using material interpolation

In this paper, we present a novel analytical formulation for the coupled partial differential equations governing electrostatically actuated constrained elastic structures of inhomogeneous material composition. We also present a computationally efficient numerical framework for solving the coupled equations over a reference domain with a fixed finite-element mesh. This serves two purposes: (i) a series of problems with varying geometries and piece-wise homogeneous and/or inhomogeneous material distribution can be solved with a single pre-processing step, (ii) topology optimization methods can be easily implemented by interpolating the material at each point in the reference domain from a void to a dielectric or a conductor. This is attained by considering the steady-state electrical current conduction equation with a `leaky capacitor' model instead of the usual electrostatic equation. This formulation is amenable for both static and transient problems in the elastic domain coupled with the quasi-electrostatic electric field. The procedure is numerically implemented on the COMSOL Multiphysics (R) platform using the weak variational form of the governing equations. Examples have been presented to show the accuracy and versatility of the scheme. The accuracy of the scheme is validated for the special case of piece-wise homogeneous material in the limit of the leaky-capacitor model approaching the ideal case.

A tutorial survey of reinforcement learning

This paper gives a compact, self-contained tutorial survey of reinforcement learning, a tool that is increasingly finding application in the development of intelligent dynamic systems. Research on reinforcement learning during the past decade has led to the development of a variety of useful algorithms. This paper surveys the literature and presents the algorithms in a cohesive framework.