Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Effect of boundary condition description on convergence of solution in a boundary-value problem

It is well known that the numerical accuracy of a series solution to a boundary-value problem by the direct method depends on the technique of approximate satisfaction of the boundary conditions and on the stage of truncation of the series. On the other hand, it does not appear to be generally recognized that, when the boundary conditions can be described in alternative equivalent forms, the convergence of the solution is significantly affected by the actual form in which they are stated. The importance of the last aspect is studied for three different techniques of computing the deflections of simply supported regular polygonal plates under uniform pressure. It is also shown that it is sometimes possible to modify the technique of analysis to make the accuracy independent of the description of the boundary conditions.

Analysis of continuous beams—a three dimensional elasticity solution

A three dimensional elasticity solution for the analysis of beams continuous over an infinite number of equally spaced supports has been given. The beam has been subjected to normal tractions on its two opposite faces and these loads are identical over each span. The other two faces are traction free. Numerical results have been given for different cases when the beam is loaded on its bottom face. The results obtained have been compared with the results of two dimensional elasticity solution.

A symmetric solution for a cylindrical shell enclosed in an elastic casing

The problem of a long, thin circular cylindrical shell enclosed in an elastic casing and subjected to a ring of radial load on the inner rim is solved using the Love function for the casing in conjunction with Flügge shell theory. Numerical work has been done with a digital computer and the results for stress and displacement fields are given for various values of the shell geometry parameters and material constants.

An exact similarity solution in radiation-gas-dynamics

We have found an exact similarity solution of the point explosion problem in the case when the total energy of the shock wave that is produced is not constant but decreases with time and when the loss due to radiation escape is significant. We have compared the results of our exact solution with those of exact numerical solutions of Elliot and Wang and have explained the cause why our solution differs from theirs in certain aspects.

Numerical procedure for second order non-linear ordinary differential equations and application to heat transfer problem

In this paper, we have first given a numerical procedure for the solution of second order non-linear ordinary differential equations of the type y″ = f (x;y, y′) with given initial conditions. The method is based on geometrical interpretation of the equation, which suggests a simple geometrical construction of the integral curve. We then translate this geometrical method to the numerical procedure adaptable to desk calculators and digital computers. We have studied the efficacy of this method with the help of an illustrative example with known exact solution. We have also compared it with Runge-Kutta method. We have then applied this method to a physical problem, namely, the study of the temperature distribution in a semi-infinite solid homogeneous medium for temperature-dependent conductivity coefficient.

Comparative study of different formulations and solution methods for two phase flow in saturated porous media

Six models (Simulators) are formulated and developed with all possible combinations of pressure and saturation of the phases as primary variables. A comparative study between six simulators with two numerical methods, conventional simultaneous and modified sequential methods are carried out. The results of the numerical models are compared with the laboratory experimental results to study the accuracy of the model especially in heterogeneous porous media. From the study it is observed that the simulator using pressure and saturation of the wetting fluid (PW, SW formulation) is the best among the models tested. Many simulators with nonwetting phase as one of the primary variables did not converge when used along with simultaneous method. Based on simulator 1 (PW, SW formulation), a comparison of different solution methods such as simultaneous method, modified sequential and adaptive solution modified sequential method are carried out on 4 test problems including heterogeneous and randomly heterogeneous problems. It is found that the modified sequential and adaptive solution modified sequential methods could save the memory by half and as also the CPU time required by these methods is very less when compared with that using simultaneous method. It is also found that the simulator with PNW and PW as the primary variable which had problem of convergence using the simultaneous method, converged using both the modified sequential method and also using adaptive solution modified sequential method. The present study indicates that pressure and saturation formulation along with adaptive solution modified sequential method is the best among the different simulators and methods tested.

Precursor Dependent Microstructure Evolution and Nonstoichiometry in Nanostructured Cerium Oxide Coatings Using the Solution Precursor Plasma Spray Technique

A solution precursor plasma spray (SPPS) technique has been used for direct deposition of cerium oxide nanoparticles (CNPs) from various cerium salt solutions as precursors. Solution precursors were injected into the hot zone of a plasma plume to deposit CNP coatings. A numerical study of the droplet injection model has been employed for microstructure development during SPPS. The decomposition of each precursor to cerium oxide was analyzed by thermogravimetric-differential thermal analysis and validated by thermodynamic calculations. The presence of the cerium oxide phase in the coatings was confirmed by X-ray diffraction studies. Transmission electron microscopy studies confirmed nanocrystalline (grain size <14 nm) characteristic of the coatings. X-ray photoelectron spectroscopy studies indicated the presence of a high concentration of Ce3+ (up to 0.32) in the coating prepared by SPPS. The processing and microstructure evolution of cerium oxide coatings with high nonstoichiometry are reported.

An improved iterative finite element solution for pin joints

Accurate, reliable and economical methods of determining stress distributions are important for fastener joints. In the past the contact stress problems in these mechanically fastened joints using interference or push or clearance fit pins were solved using both inverse and iterative techniques. Inverse techniques were found to be most efficient, but at times inadequate in the presence of asymmetries. Iterative techniques based on the finite element method of analysis have wider applications, but they have the major drawbacks of being expensive and time-consuming. In this paper an improved finite element technique for iteration is presented to overcome these drawbacks. The improved iterative technique employs a frontal solver for elimination of variables not requiring iteration, by creation of a dummy element. This automatically results in a large reduction in computer time and in the size of the problem to be handled during iteration. Numerical results are compared with those available in the literature. The method is used to study an eccentrically located pin in a quasi-isotropic laminated plate under uniform tension.

Analytical solution of the laminar mean flow wave equation in a lined or unlined two-dimensional rectangular duct

The prediction of the sound attenuation in lined ducts with sheared mean flow has been a topic of research for many years. This involves solving the sheared mean flow wave equation, satisfying the relevant boundary condition. As far as the authors' knowledge goes, this has always been done using numerical techniques. Here, an analytical solution is presented for the wave propagation in two-dimensional rectangular lined ducts with laminar mean flow. The effect of laminar mean flow is studied for both the downstream and the upstream wave propagation. The attenuation values predicted for the laminar mean flow case are compared with those for the case of uniform mean flow. Analytical expressions are derived for the transfer matrices.

Numerical Electromagnetic Analysis of Current and Voltage Distribution along Down Conductors and Towers Hit by Direct Lightning

In order to answer the practically important question of whether the down conductors of lightning protection systems to tall towers and buildings can be electrically isolated from the structure itself, this work is conducted. As a first step in this regard, it is presumed that the down conductor placed on metallic tower will be a pessimistic representation of the actual problem. This opinion was based on the fact that the proximity of heavy metallic structure will have a large damping effect. The post-stroke current distributions along the down conductors and towers, which can be quite different from that in the lightning channel, govern the post-stroke near field and the resulting gradient in the soil. Also, for a reliable estimation of the actual stroke current from the measured down conductor currents, it is essential to know the current distribution characteristics along the down conductors. In view of these, the present work attempts to deduce the post-stroke current and voltage distribution along typical down conductors and towers. A solution of the governing field equations on an electromagnetic model of the system is sought for the investigation. Simulation results providing the spatio-temporal distribution of the post-stroke current and voltage has provided very interesting results. It is concluded that it is almost impossible to achieve electrical isolation between the structure and the down conductor. Furthermore, there will be significant induction into the steel matrix of the supporting structure.

A characteristic based numerical method with tracking for nonlinear wave equations

Many physical problems can be modeled by scalar, first-order, nonlinear, hyperbolic, partial differential equations (PDEs). The solutions to these PDEs often contain shock and rarefaction waves, where the solution becomes discontinuous or has a discontinuous derivative. One can encounter difficulties using traditional finite difference methods to solve these equations. In this paper, we introduce a numerical method for solving first-order scalar wave equations. The method involves solving ordinary differential equations (ODEs) to advance the solution along the characteristics and to propagate the characteristics in time. Shocks are created when characteristics cross, and the shocks are then propagated by applying analytical jump conditions. New characteristics are inserted in spreading rarefaction fans. New characteristics are also inserted when values on adjacent characteristics lie on opposite sides of an inflection point of a nonconvex flux function, Solutions along characteristics are propagated using a standard fourth-order Runge-Kutta ODE solver. Shocks waves are kept perfectly sharp. In addition, shock locations and velocities are determined without analyzing smeared profiles or taking numerical derivatives. In order to test the numerical method, we study analytically a particular class of nonlinear hyperbolic PDEs, deriving closed form solutions for certain special initial data. We also find bounded, smooth, self-similar solutions using group theoretic methods. The numerical method is validated against these analytical results. In addition, we compare the errors in our method with those using the Lax-Wendroff method for both convex and nonconvex flux functions. Finally, we apply the method to solve a PDE with a convex flux function describing the development of a thin liquid film on a horizontally rotating disk and a PDE with a nonconvex flux function, arising in a problem concerning flow in an underground reservoir.

Evaluation of strain-rate effects in transitional round jets using direct numerical simulation

The coherent flame model uses the strain rate to predict reaction rate per unit flame surface area and some procedure that solves for the dynamics of flame surfaces to predict species distributions. The strainrate formula for the reaction rate is obtained from the analytical solution for a flame in a laminar, plane stagnation point flow. Here, the formula's effectiveness is examined by comparisons with data from a direct numerical simulation (DNS) of a round jetlike flow that undergoes transition to turbulence. Significant differences due to general flow features can be understood qualitatively: Model predictions are good in the braids between vortex rings, which are present in the near field of round jets, as the strain rate is extensional and reaction surfaces are isolated. In several other regions, the strain rate is compressive or flame surfaces are folded close together. There, the predictions are poor as the local flow no longer resembles the model flow. Quantitative comparisons showed some discrepancies. A modified, consistent application of the strain-rate solution did not show significant changes in the prediction of mean reaction rate distributions.

Numerical modeling of heat and mass transfer in laser surface alloying: Non-equilibrium solidification effects

A transient macroscopic model is developed for studying heat and mass transfer in a single-pass laser surface alloying process, with particular emphasis on non-equilibrium solidification considerations. The solution for species concentration distribution requires suitable treatment of non-equilibrium mass transfer conditions. In this context, microscopic features pertaining to non-equilibrium effects on account of solutal undercooling are incorporated through the formulation of a modified partition-coefficient. The effective partition-coefficient is numerically modeled by Means of a number of macroscopically observable parameters related to the solidifying domain. The numerical model is so developed that the modifications on account of non-equilibrium solidification considerations can be conveniently implemented in existing numerical codes based on equilibrium solidification considerations.

Rayleigh-Benard convection during solidification of an eutectic solution cooled from the top

The interaction between laminar Rayleigh-Benard convection and directional solidification is studied for the case of an eutectic solution kept in a rectangular cavity cooled from the top. Experiments and numerical simulations are carried out using an NH4Cl-H2O solution as the model fluid. The flow is visualized using a sheet of laser light scattered by neutrally buoyant, hollow-glass spheres seeded in the fluid. The numerical modeling is performed using a pressure-based finite-volume method according to the SIMPLER algorithm. The present configuration enables us to visualize flow vortices in the presence of a continuously evolving solid/liquid interface. Clear visualization of the Rayleigh-Benard convective cells and their interaction with the solidification front are obtained. It is observed that the convective cells are characterized by zones of up-flow and down-flow, resulting in the development of a nonplanar interface. Because of the continuous advancement of the solid/liquid interface, the effective liquid height of the cavity keeps decreasing. Once the height of the fluid layer falls below a critical value, the convective cells become weaker and eventually die out, leading to the growth of a planar solidification front. Results of flow visualization and temperature measurement are compared with those from the numerical simulation, and a good agreement is found.