Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Orientational melting and reorientational motion in a cubane molecular crystal: A molecular simulation study

Detailed molecular simulations are carried out to investigate the effect of temperature on orientational order in cubane molecular crystal. We report a transition from an orientationally ordered to an orientationally disordered plastic crystalline phase in the temperature range 425-450 K. This is similar to the experimentally reported transition at 395 K. The nature of this transition is first order and is associated with a 4.8% increase in unit Cell volume that is comparable to the experimentally reported unit cell volume change of 5.4% (Phys. Rev. Lett. 1997, 78, 4938). An orientational order parameter, eta(T), has been defined in terms of average angle of libration of a molecular 3-fold axis and the orientational melting has been characterized by using eta(T). The orientational melting is associated with an anomaly in specific heat at constant pressure (C-p) and compressibility (kappa). The enthalpy of transition and entropy of transition associated with this orientational melting are 20.8 J mol(-1) and 0.046 J mol(-1) K-1, respectively. The structure of crystalline as well as plastic crystalline phases is characterized by using various radial distribution functions and orientational distribution functions. The coefficient of thermal expansion of the plastic crystalline phase is more than twice that of the crystalline phase.

Physicochemical studies on the gelation of hen egg yolk; separation of gelling protein components from yolk plasma

A study of the component(s) in egg yolk responsible for gelation of yolk on freezing and thawing has shown that granule-free yolk plasma, obtained by high-speed centrifugation of yolk, has the capacity to gel. As with the whole yolk, gelation of yolk plasma on freezing and thawing could be inhibited by additives such as sugars, sodium chloride, proteolytic enzymes, and phospholipase-A. Phospholipase-C, which induces gelation of whole yolk at room temperature, has a similar effect on yolk plasma. Yolk plasma has been separated into aggregating (gelling) and soluble fractions by delipidation, using formic acid. Each of these fractions consists of three or four protein components, as observed by gel filtration, ultracentrifugation, and agar electrophoresis. The proteins are glycoproteins and contain bound hexoses, hexosamine, and sialic acid. The gelation of yolk has been attributed to the interactions between protein molecules following disruption of lipid-protein bonds.

Hybrid moving block bootstrap for stochastic simulation of multi-site multi-season streamflows

The Hybrid approach introduced by the authors for at-site modeling of annual and periodic streamflows in earlier works is extended to simulate multi-site multi-season streamflows. It bears significance in integrated river basin planning studies. This hybrid model involves: (i) partial pre-whitening of standardized multi-season streamflows at each site using a parsimonious linear periodic model; (ii) contemporaneous resampling of the resulting residuals with an appropriate block size, using moving block bootstrap (non-parametric, NP) technique; and (iii) post-blackening the bootstrapped innovation series at each site, by adding the corresponding parametric model component for the site, to obtain generated streamflows at each of the sites. It gains significantly by effectively utilizing the merits of both parametric and NP models. It is able to reproduce various statistics, including the dependence relationships at both spatial and temporal levels without using any normalizing transformations and/or adjustment procedures. The potential of the hybrid model in reproducing a wide variety of statistics including the run characteristics, is demonstrated through an application for multi-site streamflow generation in the Upper Cauvery river basin, Southern India. (C) 2004 Elsevier B.V. All rights reserved.

Two-stream instability in plasma

The problem of two-stream instability in plasma is studied by specifying the importance of initial magnetic field associated with the motion of the charged particles and the boundary effects. In Part I the accurate initial steady state is studied when the streams of electrons and ions move with different uniform speeds in plasmas with plane and cylindrical geometry. In Part II, in order to show the effects of finiteness and inhomogeneity of the system, small transverse plasma oscillations are studied in the case of plane plasmas. The role of plasma-sheath oscillations at the boundaries is found to be very important in driving the instabilities associated with the electromagnetic modes. The numerical estimates of the growth rates of the instability are given for the specific case of the physical data in discharge tubes.

Chemical modification of sheep plasma glycoprotein

Glycoprotein isolated from sheep plasma was chemically modified, and the effect of chemical modification on biological activities and immunological cross reactions has been studied. The removal of sialic acid resulted in a change in the “overall conformation” of the glycoprotein as evidenced by a decrease in viscosity of the glycoprotein solution and an increased susceptibility of the glycoprotein to proteolytic enzymes. Sialic acid-free glycoprotein no longer inhibited the tryptic activity or prolonged the clotting time of plasma. However, it could react with the antiserum to sheep plasma glycoprotein. The periodate oxidation of sheep plasma glycoprotein resulted in a complete loss of inhibition of trypsin activity, prolongation of plasma clotting time, and the ability to cross-react with the rabbit antiserum. The significance of periodate oxidation in relation to the possible sequence of sugars in the carbohydrate prosthetic group in the glycoprotein is discussed. Iodination and heating in buffers of acid and alkaline pH values of sheep plasma glycoprotein resulted in complete loss of trypsin activity and ability to prolong plasma clotting time. Iodination of the glycoprotein did not affect the immunological cross-reactivity.

Physicochemical studies on the gelation of hen's egg yolk: Delipidation of yolk plasma by treatment with phospholipase-C and extraction with solvents

A method for the delipidation of egg yolk plasma using phospholipase-C, n-heptane, and 1-butanol has been described. An aggregating protein fraction and a soluble protein fraction were separated by the action of phospholipase-C. The aggregating protein fraction freed of most of the lipids by treatment with n-heptane and 1-butanol was shown to be the apolipoproteins of yolk plasma, whereas the soluble proteins were identified as the livetins. Carbohydrate and the N-terminal amino acid analysis of these protein fractions are reported. A comparison of these protein fractions with the corresponding fractions obtained by formic acid delipidation of yolk plasma has been made. The gelation of yolk plasma by the action of phospholipase-C has been interpreted as an aggregation of lipoproteins caused by ionic interactions. The role of lecithin in maintaining the structural integrity of lipoproteins has been discussed.

Stability of a cylindrical plasma in the presence of a monotonic field-II

The stability of an incompressible inviscid, perfectly conducting cylindrical plasma against azimuthal disturbances in the presence of a monotonic decreasing magnetic field having a constant pitch is discussed by using energy principle. The results obtained by this principle are compared for m = 1 mode (which is a dangerous mode in which there is a lateral shift of the entire column) with that obtained by normal mode analysis. It is found that m = 1 mode is always unstable. Further, an axial line current, external axial field and the surface tension tend to stabilise m ≠ modes.

Harmonic and anharmonic oscillations of a cylindrical plasma in the presence of a uniform axial magnetic field and a steady axial current

In the present note we have studied the harmonic and anharmonic oscillations of cylindrical plasma using Lagrangian formalism. In order to study the harmonic oscillations, the equations are linearized and the resulting equation for the displacement has been numerically solved. For situations present in thermonuclear reactors, the presence of axial magnetic field is found necessary to make the periods of oscillation to become comparable with the time required for the thermonuclear reactions to set in. A detailed analysis of the anharmonic oscillations reveals that the significant interaction is between the first and the second mode. The fundamental period of anharmonic oscillation is more than the corresponding period of harmonic oscillations by 9·2%. Graphs have been drawn for the amplitudes of relative variations in density and magnetic field and of the time-varying part of anharmonic oscillation.

Electron energy equation for an atomic radiating plasma

The electron-energy equation for an atomic radiating plasma is considered in this work. Using the atomic model of Bates, Kingston and McWhirter, the radiation loss-term valid for all optical thicknesses is obtained. A study of the energy gained by electrons in inelastic collisions shows that the radiation loss term can be neglected only for rapidly-decaying or fast-growing plasmas. Emission from optically thin plasmas is considered next and an exact expression is given for the total radiation loss in a recombination continuum. A derivation of the Kramers-Unsöld approximation is presented and the error involved in estimating the total emitted recombination radiation by this approximation is shown to be small.

Isolation and partial characterization of sheep plasma α1-mucoprotein

1. 1. Sheep plasma α1-mucoprotein was isolated in an electrophoretically homogeneous state by a combination of ammonium sulphate saturation, isoelectric precipitation and preparative agar electrophoresis in a yield of approx. 150 mg/l of plasma. 2. 2. The mucoprotein was water-soluble, non-coagulable on heating at 100°, not precipitable by 1.8 M perchloric acid, 10% trichloroacetic acid but precipitable by saturated ammonium sulphate solution, 0.6 M sulfosalicylic acid and 5% phosphotungstic acid in 2 N HCl. It had E1 cm1 % value of 9.57 at 278 mμ in water, refractive-index index increment 1.9·10-4 (g/l) in water, isoelectric point at pH 4.45 (sodium acetate-acetic acid buffer) and was homogeneous in pH range 4.0-11.5 but at pH values 2.6 and 3.5 showed some dissociation. 3. 3. The mucoprotein had the following chemical composition: Nitrogen, 12.4%; polypeptide, 77.4%; total hexose (only mannose and galactose), 7.1%; fucose, 1.0%; glucosamine, 4.9% and sialic acid, 4.8%. It had no N-terminal amino acid.

Three-Dimensional simulation of deformation fields underneath vickers indenter:Effects of power-law Plasticity

The effects of power-law plasticity (yield strength and strain hardening exponent) on the plastic strain distribution underneath a Vickers indenter was systematically investigated by recourse to three-dimensional finite element analysis, motivated by the experimental macro-and micro-indentation on heat-treated Al-Zn-Mg alloy. For meaningful comparison between simulated and experimental results, the experimental heat treatment was carefully designed such that Al alloy achieve similar yield strength with different strain hardening exponent, and vice versa. On the other hand, full 3D simulation of Vickers indentation was conducted to capture subsurface strain distribution. Subtle differences and similarities were discussed based on the strain field shape, size and magnitude for the isolated effect of yield strength and strain hardening exponent.

Real-Time Simulation of Electrical Machines on FPGA Platform

This paper presents real-time simulation models of electrical machines on FPGA platform. Implementation of the real-time numerical integration methods with digital logic elements is discussed. Several numerical integrations are presented. A real-time simulation of DC machine is carried out on this FPGA platform and important transient results are presented. These results are compared to simulation results obtained through a commercial off-line simulation software