Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Effect of boundary condition description on convergence of solution in a boundary-value problem

It is well known that the numerical accuracy of a series solution to a boundary-value problem by the direct method depends on the technique of approximate satisfaction of the boundary conditions and on the stage of truncation of the series. On the other hand, it does not appear to be generally recognized that, when the boundary conditions can be described in alternative equivalent forms, the convergence of the solution is significantly affected by the actual form in which they are stated. The importance of the last aspect is studied for three different techniques of computing the deflections of simply supported regular polygonal plates under uniform pressure. It is also shown that it is sometimes possible to modify the technique of analysis to make the accuracy independent of the description of the boundary conditions.

Mineralogical changes and geotechnical properties of an expansive soil interacted with caustic solution

The type and amount of clay mineral plays an important role in the behaviour of fine-grained soils. Clay minerals are the primary source and moisture is often the external agent of swelling in soils. Also soils may exhibit increased/reduced swelling due to interaction with chemicals. Alkalis used in industrial operations are one such example. Concentrations of alkali and mineral type are the key factors in such interactions. The present paper reports the changes in the properties of an expansive Black Cotton soil containing a mixed layer mineral, rectorite upon interaction with high concentration caustic solutions. X-ray diffraction studies have shown that the rectorite present in the soil undergoes changes with increase in the concentration of alkali. Saponite gets transformed to nantronite. Small amount of kaolinitic mineral present in the soil also reacts with alkali producing some changes in its mineralogy. Many hydroxides are produced. Differential thermal analysis studies have been supportive of these changes. Consequent of these changes, the soil-specific surface increases, changes its Atterberg limits and free swell volume increases. The results have been supported by the characteristics and behaviour of samples contaminated in the field with alkali from an alumina extraction plant.

Analysis of continuous beams—a three dimensional elasticity solution

A three dimensional elasticity solution for the analysis of beams continuous over an infinite number of equally spaced supports has been given. The beam has been subjected to normal tractions on its two opposite faces and these loads are identical over each span. The other two faces are traction free. Numerical results have been given for different cases when the beam is loaded on its bottom face. The results obtained have been compared with the results of two dimensional elasticity solution.

A symmetric solution for a cylindrical shell enclosed in an elastic casing

The problem of a long, thin circular cylindrical shell enclosed in an elastic casing and subjected to a ring of radial load on the inner rim is solved using the Love function for the casing in conjunction with Flügge shell theory. Numerical work has been done with a digital computer and the results for stress and displacement fields are given for various values of the shell geometry parameters and material constants.

An exact similarity solution in radiation-gas-dynamics

We have found an exact similarity solution of the point explosion problem in the case when the total energy of the shock wave that is produced is not constant but decreases with time and when the loss due to radiation escape is significant. We have compared the results of our exact solution with those of exact numerical solutions of Elliot and Wang and have explained the cause why our solution differs from theirs in certain aspects.

Compressibility of dilute solutions of sulphuric acid

By employing Carstensen's phase-comparison pulse method for measuring ultrasonic velocity-differences, the compressibility of sulphuric acid has been studied anew, the special interest being in the low concentration region. Sulphuric acid is found to show at first a decrease in velocity with increasing concentration and then an increase. The curve representing the apparent molal compressibility Φ(κ̄2) against the square root of the molar concentration c, shows a maximum and a minimum. This anomalous behaviour is interesting in view of the extreme anomalies in other colligative properties of sulphuric acid. A qualitative explanation of the observed maximum and minimum has been suggested.

A fourier-integral solution for the elastic quarter-plane

The problem of an elastic quarter-plane with arbitrary loadings on the boundaries has been solved using a Fourier-integral approach.

A three-dimensional solution for plates and laminates

A general three-dimensional solution is presented for statics and dynamics of plates, homogeneous or laminated, of orthotropic materials. The solution is in series form. Using parts of the general solution a variety of problems, especially of rectangular configurations, can be solved. As Mindlin's approximate analysis for vibration of thick plates is often adequate for specific practical purposes, a general solution for Mindlin's analysis is also given.

Nature of the colour-forming species in peroxy titanium sulphate

ALTHOUGH titanium is determined colorimetrically in aqueous sulphuric acid medium in presence of excess of hydrogen peroxide, the nature of the colour-forming species is not known definitely. Schwarz1 suggested that the colour was due to the peroxo-disulphato titanate anion [O 2Ti(SO4)2]2-. On the other hand, Jahr2 and later Gastinger3 considered that the colour of the compound was due to the peroxy titanyl cation [TiO2 aq.] 2+, and suggested the following equilibrium in solution: Schaeppi and Treadwell4 attributed the colour bo O2TiSO4 or [O2Ti(SO4)2]2-, whereas Babko and Volkova5 represented the coloured complex ion as [Ti(H 2O2)]4+. Mori, Shibata, Kyuno and Ito 6 regarded the coloured species as [TiO2 aq.]2+ or [Ti(OH)2 (H2O)(H2O2)] 2+, assuming the co-ordination number of titanium to be four. Thus, a variety of constitutions has been proposed to explain the colour-forming species of the titanium complex, based on the investigations carried out in dilute sulphuric acid medium, but the complex has not been isolated so far.

A Computationally Efficient Generalized Poisson Solution for Independent Double-Gate Transistors

Previous techniques used for solving the 1-D Poisson equation ( PE) rigorously for long-channel asymmetric and independent double-gate (IDG) transistors result in potential models that involve multiple intercoupled implicit equations. As these equations need to be solved self-consistently, such potential models are clearly inefficient for compact modeling. This paper reports a different rigorous technique for solving the same PE by which one can obtain the potential profile of a generalized IDG transistor that involves a single implicit equation. The proposed Poisson solution is shown to be computationally more efficient for circuit simulation than the previous solutions.

Solution-Combustion Synthesized Nanocrystalline Li4Ti5O12 As High-Rate Performance Li-Ion Battery Anode

Nanocrystalline Li4Ti5O12 (LTO) crystallizing in cubic spinel-phase has been synthesized by single-step-solution-combustion method in less than one minute. LTO particles thus synthesized are flaky and highly porous in nature with a surface area of 12 m(2)/g. Transmission electron micrographs indicate the primary particles to be agglomerated crystallites of varying size between 20 and 50 nm with a 3-dimensional interconnected porous network. During their galvanostatic charge-discharge at varying rates, LTO electrodes yield a capacity value close to the theoretical value of 175 mA h/g at C/2 rate. The electrodes also exhibit promising capacity retention with little capacity loss over 100 cycles at varying discharge rates together with attractive discharge-rate capabilities yielding capacity values of 140 mA h/g and 70 mA h/g at 10 and 100 C discharge rates, respectively. The ameliorated electrode-performance is ascribed to nano and highly porous morphology of the electrodes that provide short diffusion-paths for Li in conjunction with electrolyte percolation through the electrode pores ensuring a high flux of Li.