Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Orientational melting and reorientational motion in a cubane molecular crystal: A molecular simulation study

Detailed molecular simulations are carried out to investigate the effect of temperature on orientational order in cubane molecular crystal. We report a transition from an orientationally ordered to an orientationally disordered plastic crystalline phase in the temperature range 425-450 K. This is similar to the experimentally reported transition at 395 K. The nature of this transition is first order and is associated with a 4.8% increase in unit Cell volume that is comparable to the experimentally reported unit cell volume change of 5.4% (Phys. Rev. Lett. 1997, 78, 4938). An orientational order parameter, eta(T), has been defined in terms of average angle of libration of a molecular 3-fold axis and the orientational melting has been characterized by using eta(T). The orientational melting is associated with an anomaly in specific heat at constant pressure (C-p) and compressibility (kappa). The enthalpy of transition and entropy of transition associated with this orientational melting are 20.8 J mol(-1) and 0.046 J mol(-1) K-1, respectively. The structure of crystalline as well as plastic crystalline phases is characterized by using various radial distribution functions and orientational distribution functions. The coefficient of thermal expansion of the plastic crystalline phase is more than twice that of the crystalline phase.

Hybrid moving block bootstrap for stochastic simulation of multi-site multi-season streamflows

The Hybrid approach introduced by the authors for at-site modeling of annual and periodic streamflows in earlier works is extended to simulate multi-site multi-season streamflows. It bears significance in integrated river basin planning studies. This hybrid model involves: (i) partial pre-whitening of standardized multi-season streamflows at each site using a parsimonious linear periodic model; (ii) contemporaneous resampling of the resulting residuals with an appropriate block size, using moving block bootstrap (non-parametric, NP) technique; and (iii) post-blackening the bootstrapped innovation series at each site, by adding the corresponding parametric model component for the site, to obtain generated streamflows at each of the sites. It gains significantly by effectively utilizing the merits of both parametric and NP models. It is able to reproduce various statistics, including the dependence relationships at both spatial and temporal levels without using any normalizing transformations and/or adjustment procedures. The potential of the hybrid model in reproducing a wide variety of statistics including the run characteristics, is demonstrated through an application for multi-site streamflow generation in the Upper Cauvery river basin, Southern India. (C) 2004 Elsevier B.V. All rights reserved.

Three-Dimensional simulation of deformation fields underneath vickers indenter:Effects of power-law Plasticity

The effects of power-law plasticity (yield strength and strain hardening exponent) on the plastic strain distribution underneath a Vickers indenter was systematically investigated by recourse to three-dimensional finite element analysis, motivated by the experimental macro-and micro-indentation on heat-treated Al-Zn-Mg alloy. For meaningful comparison between simulated and experimental results, the experimental heat treatment was carefully designed such that Al alloy achieve similar yield strength with different strain hardening exponent, and vice versa. On the other hand, full 3D simulation of Vickers indentation was conducted to capture subsurface strain distribution. Subtle differences and similarities were discussed based on the strain field shape, size and magnitude for the isolated effect of yield strength and strain hardening exponent.

Real-Time Simulation of Electrical Machines on FPGA Platform

This paper presents real-time simulation models of electrical machines on FPGA platform. Implementation of the real-time numerical integration methods with digital logic elements is discussed. Several numerical integrations are presented. A real-time simulation of DC machine is carried out on this FPGA platform and important transient results are presented. These results are compared to simulation results obtained through a commercial off-line simulation software

Elastic property estimation using Ultrasound Assisted Optical Elastography through Remote Palpation - A simulation study - art. no. 61640Q

We propose an effective elastography technique in which an acoustic radiation force is used for remote palpation to generate localized tissue displacements, which are directly correlated to localized variations of tissue stiffness and are measured using a light probe in the same direction of ultrasound propagation. The experimental geometry has provision to input light beam along the ultrasound propagation direction, and hence it can be prealigned to ensure proper interception of the focal region by the light beam. Tissue-mimicking phantoms with homogeneous and isotropic mechanical properties of normal and malignant breast tissue are considered for the study. Each phantom is insonified by a focusing ultrasound transducer (1 MHz). The focal volume of the transducer and the ultrasound radiation force in the region are estimated through solving acoustic wave propagation through medium assuming average acoustic properties. The forward elastography problem is solved for the region of insonification assuming the Lame's parameters and Poisson's ratio, under Dirichlet boundary conditions which gives a distribution of displacement vectors. The direction of displacement, though presented spatial variation, is predominantly towards the ultrasound propagation direction. Using Monte Carlo (MC) simulation we have traced the photons through the phantom and collected the photons arriving at the detector on the boundary of the object in the direction of ultrasound. The intensity correlations are then computed from detected photons. The intensity correlation function computed through MC simulation showed a modulation whose strength is found to be proportional to the amplitude of displacement and inversely related to the storage (elastic) modulus. It is observed that when the storage modulus in the focal region is increased the computed displacement magnitude, as indicated by the depth of modulation in the intensity autocorrelation, decreased and the trend is approximately exponential.

Elimination of cross-talk in diffuse optical tomographic reconstructions through a weighted update procedure: results of simulation study - art. no. 61640S

Reconstructions in optical tomography involve obtaining the images of absorption and reduced scattering coefficients. The integrated intensity data has greater sensitivity to absorption coefficient variations than scattering coefficient. However, the sensitivity of intensity data to scattering coefficient is not zero. We considered an object with two inhomogeneities (one in absorption and the other in scattering coefficient). The standard iterative reconstruction techniques produced results, which were plagued by cross talk, i.e., the absorption coefficient reconstruction has a false positive corresponding to the location of scattering inhomogeneity, and vice-versa. We present a method to remove cross talk in the reconstruction, by generating a weight matrix and weighting the update vector during the iteration. The weight matrix is created by the following method: we first perform a simple backprojection of the difference between the experimental and corresponding homogeneous intensity data. The built up image has greater weightage towards absorption inhomogeneity than the scattering inhomogeneity and its appropriate inverse is weighted towards the scattering inhomogeneity. These two weight matrices are used as multiplication factors in the update vectors, normalized backprojected image of difference intensity for absorption inhomogeneity and the inverse of the above for the scattering inhomogeneity, during the image reconstruction procedure. We demonstrate through numerical simulations, that cross-talk is fully eliminated through this modified reconstruction procedure.

Simulation of precipitation reactions in reverse micelles

Precipitation involving mixing of two sets of reverse micellar solutions-containing a reactant and precipitant respectively-has been analyzed. Particle formation in such systems has been simulated by a Monte Carlo (MC) scheme (Li, Y.; Park, C. W. Langmuir 1999, 15, 952), which however is very restrictive in its approach. We have simulated particle formation by developing a general Monte Carlo scheme, using the interval of quiescence technique (IQ). It uses Poisson distribution with realistic, low micellar occupancies of reactants, Brownian collision of micelles with coalescence efficiency, fission of dimers with binomial redispersion of solutes, finite nucleation rate of particles with critical number of molecules, and instantaneous particle growth. With the incorporation of these features, the previous work becomes a special case of our simulation. The present scheme was then used to predict experimental data on two systems. The first is the experimental results of Lianos and Thomas (Chem. Phys. Lett. 1986, 125, 299, J. Colloid Interface Sci. 1987, 117, 505) on formation of CdS nanoparticles. They reported the number of molecules in a particle as a function of micellar size and reactant concentrations, which have been predicted very well. The second is on the formation of Fe(OH)(3) nanoparticles, reported by Li and Park. Our simulation in this case provides a better prediction of the experimental particle size range than the prediction of the authors. The present simulation scheme is general and can be applied to explain nanoparticle formation in other systems.

Flow Generated By Pitched Blade Turbines Ii: Simulation Using Κ-Ε Model

Experimental data on average velocity and turbulence intensity generated by pitched blade downflow turbines (PTD) were presented in Part I of this paper. Part II presents the results of the simulation of flow generated by PTD The standard κ-ε model along with the boundary conditions developed in the Part 1 have been employed to predict the flow generated by PTD in cylindrical baffled vessel. This part describes the new software FIAT (Flow In Agitated Tanks) for the prediction of three dimensional flow in stirred tanks. The basis of this software has been described adequately. The influence of grid size, impeller boundary conditions and values of model parameters on the predicted flow have been analysed. The model predictions successfully reproduce the three dimensionality and the other essential characteristics of the flow. The model can be used to improve the overall understanding about the relative distribution of turbulence by PTD in the agitated tank

Detection of moisture stress by indicator plots — A simulation

The possibility of advanced indication of moisture stress in a crop by small prepared plots with compacted or partially sand-substituted soils is examined by an analytical simulation. A series of soils and three crops are considered for the simulation. The moisture characteristics of the soils are calculated with an available model. Using average potential evapotranspiration values and a simple actual evapotranspiration model, the onset of moisture stress in the natural and indicator plots is calculated for different degrees of sand substitution and compaction. Cases where sand substitution fails are determined. The effect of intervening rainfall and limited root depth on the beginning of moisture stress is investigated.

Simulation of magnetovolume effects in Fe65Ni35 nanoparticles

We compare magnetovolume effects in bulk and nanoparticles by performing Monte Carlo simulations of a spin-analogous model with coupled spatial and magnetic degrees of freedom and chemical disorder. We find that correlations between surface and bulk atoms lead with decreasing particle size to a substantial modification of the magnetic and elastic behavior at low temperatures.

Direct numerical simulation of autoignition in a non-premixed, turbulent medium

In this paper, direct numerical simulation of autoignition in an initially non-premixed medium under isotropic, homogeneous, and decaying turbulence is presented. The pressure-based method developed herein is a spectral implementation of the sequential steps followed in the predictor-corrector type of algorithms; it includes the effects of density fluctuations caused by spatial inhomogeneities ill temperature and species. The velocity and pressure field are solved in the spectral space while the scalars and density field are solved in the physical space. The presented results reveal that the autoignition spots originate and evolve at locations where (1) the composition corresponds to a small range around a specific mixture fraction, and (2) the conditional scaler dissipation rate is low. A careful examination of the data obtained indicates that the autoignition spots originate in the vortex cores, and the hot gases travel outward as combustion progresses. Hence, the applicability of the transient laminar flamelet model for this problem is questioned. The dependence of autoignition characteristics on parameters such as (1) die initial eddy-turnover time and (2) the initial ratio of length scale of scalars to that of velocities are investigated. Certain implications of new results on the conditional moment closure modeling are discussed.

Computer simulation of protein—carbohydrate complexes: application to arabinose-binding protein and pea lectin

The CCEM method (Contact Criteria and Energy Minimisation) has been developed and applied to study protein-carbohydrate interactions. The method uses available X-ray data even on the native protein at low resolution (above 2.4 Å) to generate realistic models of a variety of proteins with various ligands.The two examples discussed in this paper are arabinose-binding protein (ABP) and pea lectin. The X-ray crystal structure data reported on ABP-β-l-arabinose complex at 2.8, 2.4 and 1.7 Å resolution differ drastically in predicting the nature of the interactions between the protein and ligand. It is shown that, using the data at 2.4 Å resolution, the CCEM method generates complexes which are as good as the higher (1.7 Å) resolution data. The CCEM method predicts some of the important hydrogen bonds between the ligand and the protein which are missing in the interpretation of the X-ray data at 2.4 Å resolution. The theoretically predicted hydrogen bonds are in good agreement with those reported at 1.7 Å resolution. Pea lectin has been solved only in the native form at 3 Å resolution. Application of the CCEM method also enables us to generate complexes of pea lectin with methyl-α-d-glucopyranoside and methyl-2,3-dimethyl-α-d-glucopyranoside which explain well the available experimental data in solution.

Sliding Modes for the Simulation of Mechanical and Electrical Systems Defined by Differential-Algebraic Equations

We offer a technique, motivated by feedback control and specifically sliding mode control, for the simulation of differential-algebraic equations (DAEs) that describe common engineering systems such as constrained multibody mechanical structures and electric networks. Our algorithm exploits the basic results from sliding mode control theory to establish a simulation environment that then requires only the most primitive of numerical solvers. We circumvent the most important requisite for the conventionalsimulation of DAEs: the calculation of a set of consistent initial conditions. Our algorithm, which relies on the enforcement and occurrence of sliding mode, will ensure that the algebraic equation is satisfied by the dynamic system even for inconsistent initial conditions and for all time thereafter. [DOI:10.1115/1.4001904]