Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Boundary value problems for third-order nonlinear ordinary differential equations

In this paper, we describe how to analyze boundary value problems for third-order nonlinear ordinary differential equations over an infinite interval. Several physical problems of interest are governed by such systems. The seminumerical schemes described here offer some advantages over solutions obtained by using traditional methods such as finite differences, shooting method, etc. These techniques also reveal the analytic structure of the solution function. For illustrative purposes, several physical problems, mainly drawn from fluid mechanics, are considered; they clearly demonstrate the efficiency of the techniques presented here.

Effect of boundary condition description on convergence of solution in a boundary-value problem

It is well known that the numerical accuracy of a series solution to a boundary-value problem by the direct method depends on the technique of approximate satisfaction of the boundary conditions and on the stage of truncation of the series. On the other hand, it does not appear to be generally recognized that, when the boundary conditions can be described in alternative equivalent forms, the convergence of the solution is significantly affected by the actual form in which they are stated. The importance of the last aspect is studied for three different techniques of computing the deflections of simply supported regular polygonal plates under uniform pressure. It is also shown that it is sometimes possible to modify the technique of analysis to make the accuracy independent of the description of the boundary conditions.

Recombination and trapping in n-type cobalt-doped germanium

The role of cobalt centers in promoting the recombination and trapping processes in n-type germanium has been investigated. Data on lifetime measurements carried out by the steadystate photoconductivity and photo-magneto-electric methods in the temperature range 145 to 300°K on n-type germanium samples containing cobalt in the concentration range 1·1013 to 5.·014/cm3 are presented. The results are analysed on the basis of Sah-Shockley's multi-level formula to yield the capture cross-sections Sp= (hole capture cross-section at doubly negatively charged center) and Sn-(electron capture cross-section at singly negatively charged center) and temperature dependence. It is found that Sp= is (22 ± 6). 10-16 cm2 and Sn- is ∼ 0·1. 10-16 cm2 at 145°K. Sp= varies (n = 3·5 to 4·5) in the range 145-220°K; above 225°K the index 'n' tends to a smaller value. Sn- is practically temperature independent below 180°K and increases with increase of temperature above 180°K. The value of Sp= and its temperature variation lead one to the conclusion that during capture at attractive centers, the phonon cascade mechanism is responsible for the dissipation of the recombination energy.

Isolation and partial characterization of sheep plasma α1-mucoprotein

1. 1. Sheep plasma α1-mucoprotein was isolated in an electrophoretically homogeneous state by a combination of ammonium sulphate saturation, isoelectric precipitation and preparative agar electrophoresis in a yield of approx. 150 mg/l of plasma. 2. 2. The mucoprotein was water-soluble, non-coagulable on heating at 100°, not precipitable by 1.8 M perchloric acid, 10% trichloroacetic acid but precipitable by saturated ammonium sulphate solution, 0.6 M sulfosalicylic acid and 5% phosphotungstic acid in 2 N HCl. It had E1 cm1 % value of 9.57 at 278 mμ in water, refractive-index index increment 1.9·10-4 (g/l) in water, isoelectric point at pH 4.45 (sodium acetate-acetic acid buffer) and was homogeneous in pH range 4.0-11.5 but at pH values 2.6 and 3.5 showed some dissociation. 3. 3. The mucoprotein had the following chemical composition: Nitrogen, 12.4%; polypeptide, 77.4%; total hexose (only mannose and galactose), 7.1%; fucose, 1.0%; glucosamine, 4.9% and sialic acid, 4.8%. It had no N-terminal amino acid.

Solution-Combustion Synthesized Nanocrystalline Li4Ti5O12 As High-Rate Performance Li-Ion Battery Anode

Nanocrystalline Li4Ti5O12 (LTO) crystallizing in cubic spinel-phase has been synthesized by single-step-solution-combustion method in less than one minute. LTO particles thus synthesized are flaky and highly porous in nature with a surface area of 12 m(2)/g. Transmission electron micrographs indicate the primary particles to be agglomerated crystallites of varying size between 20 and 50 nm with a 3-dimensional interconnected porous network. During their galvanostatic charge-discharge at varying rates, LTO electrodes yield a capacity value close to the theoretical value of 175 mA h/g at C/2 rate. The electrodes also exhibit promising capacity retention with little capacity loss over 100 cycles at varying discharge rates together with attractive discharge-rate capabilities yielding capacity values of 140 mA h/g and 70 mA h/g at 10 and 100 C discharge rates, respectively. The ameliorated electrode-performance is ascribed to nano and highly porous morphology of the electrodes that provide short diffusion-paths for Li in conjunction with electrolyte percolation through the electrode pores ensuring a high flux of Li.

Photodissociation of isomeric dichloroethylenes in the ultraviolet: Effect of the second chlorine atom substitution on the dynamics

We report the Cl-*(P-2(1/2)) production dynamics in the near-UV dissociation of three isomers (cis-, gem-, and trans-) of dichloroethylene using the conventional resonance enhanced multiphoton ionization technique. Substantial amounts of Cl-* are produced in the wavelength range 222-304 nm. The Cl-* quantum yield (phi(*)) i maximum at 304 nm for all the isomers and phi(*)(cis) is markedly higher than phi(*)(gem) and phi(*)(trans) except at 222 nm. Existence of both direct and indirect dissociation pathways at these wavelengths complicates the Cl* production dynamics. The higher value of phi(*)(cis) originates from a large contribution from direct dissociation via the (n, sigma(*)) state.

Comparative study on damage identification from lso-Eigen-Value-Change contours and smeared damage model

The paper proposes two methodologies for damage identification from measured natural frequencies of a contiguously damaged reinforced concrete beam, idealised with distributed damage model. The first method identifies damage from Iso-Eigen-Value-Change contours, plotted between pairs of different frequencies. The performance of the method is checked for a wide variation of damage positions and extents. The method is also extended to a discrete structure in the form of a five-storied shear building and the simplicity of the method is demonstrated. The second method is through smeared damage model, where the damage is assumed constant for different segments of the beam and the lengths and centres of these segments are the known inputs. First-order perturbation method is used to derive the relevant expressions. Both these methods are based on distributed damage models and have been checked with experimental program on simply supported reinforced concrete beams, subjected to different stages of symmetric and un-symmetric damages. The results of the experiments are encouraging and show that both the methods can be adopted together in a damage identification scenario.

Reliability models for existing structures based on dynamic state estimation and data based asymptotic extreme value analysis

The problem of time variant reliability analysis of existing structures subjected to stationary random dynamic excitations is considered. The study assumes that samples of dynamic response of the structure, under the action of external excitations, have been measured at a set of sparse points on the structure. The utilization of these measurements m in updating reliability models, postulated prior to making any measurements, is considered. This is achieved by using dynamic state estimation methods which combine results from Markov process theory and Bayes' theorem. The uncertainties present in measurements as well as in the postulated model for the structural behaviour are accounted for. The samples of external excitations are taken to emanate from known stochastic models and allowance is made for ability (or lack of it) to measure the applied excitations. The future reliability of the structure is modeled using expected structural response conditioned on all the measurements made. This expected response is shown to have a time varying mean and a random component that can be treated as being weakly stationary. For linear systems, an approximate analytical solution for the problem of reliability model updating is obtained by combining theories of discrete Kalman filter and level crossing statistics. For the case of nonlinear systems, the problem is tackled by combining particle filtering strategies with data based extreme value analysis. In all these studies, the governing stochastic differential equations are discretized using the strong forms of Ito-Taylor's discretization schemes. The possibility of using conditional simulation strategies, when applied external actions are measured, is also considered. The proposed procedures are exemplifiedmby considering the reliability analysis of a few low-dimensional dynamical systems based on synthetically generated measurement data. The performance of the procedures developed is also assessed based on a limited amount of pertinent Monte Carlo simulations. (C) 2010 Elsevier Ltd. All rights reserved.

Density-wave theory of dislocations in crystals

The density-wave theory of Ramakrishnan and Yussouff is extended to provide a scheme for describing dislocations and other topological defects in crystals. Quantitative calculations are presented for the order-parameter profiles, the atomic configuration, and the free energy of a screw dislocation with Burgers vector b=(a/2, a/2, a/2) in a bcc solid. These calculations are done using a simple parametrization of the direct correlation function and a gradient expansion. It is conventional to express the free energy of the dislocation in a crystal of size R as (λb2/4π)ln(αR/‖b‖), where λ is the shear elastic constant, and α is a measure of the core energy. Our results yield for Na the value α≃1.94a/(‖c1’’‖)1/2 (≃1.85) at the freezing temperature (371 K) and α≃2.48a/(‖c1’’‖)1/2 at 271 K, where c1’’ is the curvature of the first peak of the direct correlation function c(q). Detailed results for the density distribution in the dislocation, particularly the core region, are also presented. These show that the dislocation core has a columnar character. To our knowledge, this study represents the first calculation of dislocation structure, including the core, within the framework of an order-parameter theory and incorporating thermal effects.

High-yield bacterial expression and structural characterization of recombinant human insulin-like growth factor binding protein-2

The diverse biological activities of the insulin-like growth factors (IGF-1 and IGF-2) are mediated by the IGF-1 receptor (IGF-1R). These actions are modulated by a family of six IGF-binding proteins (ICFBP-1-6; 22-31 kDa) that via high affinity binding to the IGFs (K-D similar to 300-700 pM) both protect the IGFs in the circulation and attenuate IGF action by blocking their receptor access In recent years, IGFBPs have been implicated in a variety of cancers However, the structural basis of their interaction with IGFs and/or other proteins is not completely understood A critical challenge in the structural characterization of full-length IGFBPs has been the difficulty in expressing these proteins at levels suitable for NMR/X-ray crystallography analysis Here we describe the high-yield expression of full-length recombinant human IGFBP-2 (rhIGFBP-2) in Eschericha coli Using a single step purification protocol, rhIGFBP-2 was obtained with >95% purity and structurally characterized using NMR spectroscopy. The protein was found to exist as a monomer at the high concentrations required for structural studies and to exist in a single conformation exhibiting a unique intra-molecular disulfide-bonding pattern The protein retained full biologic activity. This study represents the first high-yield expression of wild-type recombinant human IGFBP-2 in E coli and first structural characterization of a full-length IGFBP (C) 2010 Elsevier Inc. All rights reserved

Topological defects in crystals: A density-wave theory

A new approach for describing dislocations and other topological defects in crystals, based on the density wave theory of Ramakrishnan and Yussouff is presented. Quantitative calculations are discussed in brief for the order parameter profiles, the atomic configuration and the free energy of a screw dislocation with Burgers vector b = (a/2, a/2,a/2 ) in a bcc solid. Our results for the free energy of the dislocation in a crystal of sizeR, when expressed as (λb 2/4π) ln (αR/|b|) whereλ is the shear elastic constant, yield, for example, the valueα ⋍ 1·85 for sodium at its freezing temperature (371°K). The density distribution in the presence of the dislocation shows that the dislocation core has a columnar character. To our knowledge, this study represents the first calculation of dislocation structure, including the core, within the framework of an order parameter theory incorporating thermal effects.

A convenient and high-yield synthesis for pyridinium and metal hexafluorocomplexes of vanadium, chromium, iron and cobalt

Pyridinium poly(hydrogen fluoride) reacts with the oxide of vanadium(V) and chlorides of chromium(III), iron (III) and Co(II) at room temperature forming the pyridinium salts of hexafluoro vanadate(V), hexafluorochromate(III), hexafluoroferrate(III) and hexafluorocobaltate(II) in near quantitative yields (80%). These pyridinium salts are the precursors for the preparation of the alkali metal hexafluorometallates by metathetic reactions in acetonitrile medium with the corresponding metal chlorides. The prepared salts have been identified by their infrared spectral data and elemental analysis.