Solution of MDPS using simulation-based value iteration

This article proposes a three-timescale simulation based algorithm for solution of infinite horizon Markov Decision Processes (MDPs). We assume a finite state space and discounted cost criterion and adopt the value iteration approach. An approximation of the Dynamic Programming operator T is applied to the value function iterates. This 'approximate' operator is implemented using three timescales, the slowest of which updates the value function iterates. On the middle timescale we perform a gradient search over the feasible action set of each state using Simultaneous Perturbation Stochastic Approximation (SPSA) gradient estimates, thus finding the minimizing action in T. On the fastest timescale, the 'critic' estimates, over which the gradient search is performed, are obtained. A sketch of convergence explaining the dynamics of the algorithm using associated ODEs is also presented. Numerical experiments on rate based flow control on a bottleneck node using a continuous-time queueing model are performed using the proposed algorithm. The results obtained are verified against classical value iteration where the feasible set is suitably discretized. Over such a discretized setting, a variant of the algorithm of [12] is compared and the proposed algorithm is found to converge faster.

Optimal threshold policies for admission control in communication networks via discrete parameter stochastic approximation

The problem of admission control of packets in communication networks is studied in the continuous time queueing framework under different classes of service and delayed information feedback. We develop and use a variant of a simulation based two timescale simultaneous perturbation stochastic approximation (SPSA) algorithm for finding an optimal feedback policy within the class of threshold type policies. Even though SPSA has originally been designed for continuous parameter optimization, its variant for the discrete parameter case is seen to work well. We give a proof of the hypothesis needed to show convergence of the algorithm on our setting along with a sketch of the convergence analysis. Extensive numerical experiments with the algorithm are illustrated for different parameter specifications. In particular, we study the effect of feedback delays on the system performance.

GMRT observations of the group Holmberg 124: Evolution by tidal forces and ram pressure?

We report new radio continuum and 21 cm HI observations using the Giant Metrewave Radio Telescope (GMRT) of the group Holmberg 124 ( Ho 124) comprising four late-type galaxies, namely NGC 2820, Mrk 108, NGC 2814 and NGC 2805. The three galaxies, NGC 2820, Mrk 108 and NGC 2814 which are closely located in the sky plane have clearly undergone tidal interactions as seen from the various morphological tidal signatures and debris. Moreover we note various features in the group members which we believe might be due to ram pressure. In this paper, we describe four interesting results emerging from our observations: a) detection of the tidal radio continuum bridge at 330 MHz connecting the galaxies NGC 2820+ Mrk 108 with NGC 2814. The radio bridge was discovered at 1465 MHz by van der Hulst & Hummel ( 1985, A& A, 150, 17). We find that the bridge has a fairly steep spectrum with a spectral index alpha(S proportional to nu(alpha)) of - 1.8(-0.2)(+0.3) which is much steeper than the - 0.8 quoted by van der Hulst & Hummel ( 1985); b) detection of other tidal features like the tilted HI and radio continuum disk of NGC 2814, a HI streamer and a radio continuum tail arising from the south of NGC 2814. We also report the detection of a possible tidal dwarf galaxy in HI; c) sharp truncation in the HI distribution in the south of NGC 2820 and in the HI and radio continuum distribution in the north of NGC 2814. The optical disks in both the cases look undisturbed. As pointed out by Davis et al. ( 1997, AJ, 114, 613), ram pressure affects different components of the interstellar medium to varying degrees. Simple estimates of pressure in different components of the interstellar medium ( radio continuum, Ha and HI) in NGC 2820 indicate that ram pressure will significantly influence HI; d) detection of a large one-sided HI loop to the north of NGC 2820. No radio continuum emission or Ha emission is associated with the HI loop. We discuss various scenarios for the origin of this loop including a central starburst, ram pressure stripping and tidal interaction. We do not support the central starburst scenario since the loop is not detected in ionized gas. Using the upper limit on X-ray luminosity of Ho 124 (Mulchaey et al. 2003, ApJS, 145, 39), we estimate an upper limit on the intragroup medium (IGrM) density of 8.8 x 10(-4) cm(-3). For half this electron density, we estimate the ram pressure force of the IGrM to be comparable to the gravitational pull of the disk of NGC 2820. Since tidal interaction has obviously influenced the group, we suggest that the loop could have formed by ram pressure stripping if tidal effects had reduced the surface density of HI in NGC 2820. From the complex observational picture of Ho 124 and the numerical estimates, we suggest that the evolution of the Ho 124 group may be governed by both tidal forces due to the interaction and the ram pressure due to motion of the member galaxies in the IGrM and that the IGrM densities should not be too low (i.e. >= 4 x 10(-4)). However this needs to be verified by further observations.

Spectroscopic studies on n-donor + σ-acceptor systems: Alkylthioureas and thiocarbanilides

The donor-acceptor interactions of alkylthioureas and thiocarbanilides with halogens have been investigated in detail employing electronic and infra-red spectroscopy. Various correlations of the spectroscopic and thermodynamic data have been presented. Alkylthioureas are by far the strongest donors known, and give high equilibrium constants (10,000-40,000 l. mole-1) and enthalpies of formation (9-18 kcal mole-1). The perturbation of the various vibrational frequencies due to charge transfer have also been studied. Hydrogen bonding of thioureas with hydroxylic compounds have been reported.

The buoyant plume above a heat source

The boundary-layer type conservation equations of mass, momentum and energy for the steady free turbulent flow in gravitational convection over heat sources are set up for both two-dimensional and axisymmetric cases. These are reduced to ordinary differential equations in a similarity parameter by suitable transformations. The three classical hypotheses of turbulent diffusion-the Constant Exchange Coefficient hypothesis, Prandtl's Momentum Transfer theory and Taylor's Vorticity Transfer theory-are then incorporated into these equations in succession. The resulting equations are solved numerically and the results compared with some experimental results on gravitational convection over heat sources reported by Rouse et al.

Analysis of multiple crystal forms of Bacillus subtilis BacB suggests a role for a metal ion as a nucleant for crystallization

Bacillus subtilis BacB is an oxidase that is involved in the production of the antibiotic bacilysin. This protein contains two double-stranded beta-helix (cupin) domains fused in a compact arrangement. BacB crystallizes in three crystal forms under similar crystallization conditions. An interesting observation was that a slight perturbation of the crystallization droplet resulted in the nucleation of a different crystal form. An X-ray absorption scan of BacB suggested the presence of cobalt and iron in the crystal. Here, a comparative analysis of the different crystal forms of BacB is presented in an effort to identify the basis for the different lattices. It is noted that metal ions mediating interactions across the asymmetric unit dominate the different packing arrangements. Furthermore, a normalized B-factor analysis of all the crystal structures suggests that the solvent-exposed metal ions decrease the flexibility of a loop segment, perhaps influencing the choice of crystal form. The residues coordinating the surface metal ion are similar in the triclinic and monoclinic crystal forms. The coordinating ligands for the corresponding metal ion in the tetragonal crystal form are different, leading to a tighter packing arrangement. Although BacB is a monomer in solution, a dimer of BacB serves as a template on which higher order symmetrical arrangements are formed. The different crystal forms of BacB thus provide experimental evidence for metal-ion-mediated lattice formation and crystal packing.

Helical Conformations of Hexapeptides Containing N-Terminus Diproline Segments

The role of N-terminus diproline segments in facilitating helical folding in short peptides has been investigated in a set of model hexapeptides of the type Piv-Xxx-Yyy-Aib-Leu-Aib-Phe-OMe (Piv, pivaloyl). Nine sequences have been investigated with the following N-terminus dipeptide segments: (D)Pro-Ala (4) and Pro-Psi Pro (5, Psi, pseudoproline), Ala-Ala (6), Ala-Pro (7), Pro-Ala (8), Aib-Ala (9), Ala-Aib (10). The analog sequences Piv-Pro-Pro-Ala-Leu-Aib-Phe-OMe (2) and Piv-Pro-Pro-Ala-Aib-Ala-Aib-OMe (3) have also been studied. Solid state conformations have been determined by X-ray crystallography for peptides 4, 6, and 8 and compared with the previously determined crystal structure of peptide 1 (Boc-Pro-Pro-Aib-Leu-Aib-Val-OMe); (Rai et al., JACS 2006, 128, 7916-7928). Peptides 1 and 6 adopt almost identical helical conformations with unfolding of the helix at the N-terminus Pro (1) residue. Peptide 4 reveals the anticipated (D)Pro-Ala type II' beta-turn, followed by a stretch of 3(10)-helix. Peptide 8 adopts a folded conformation stabilized by four successive 4 -> 1 intramolecular hydrogen bonds. Ala (2) adopts an alpha(L) conformation, resulting in a type II beta-turn conformation followed by a stretch of 3(10)-helix. Conformational properties in solution were probed using solvent perturbation of NH chemical shifts which permit delineation of hydrogen bonded NH groups and nuclear Overhauser effects (NOEs) between backbone protons, which are diagnostic of local residue conformations. The results suggest that continuous helical conformations are indeed significantly populated for peptides 2 and 3. Comparison of the results for peptides 1 and 2, suggest that there is a significant influence of the residue that follows diproline segments in influencing backbone folding. (C) 2010 Wiley Periodicals, Inc. Biopolymers (Pept Sci) 94: 360-370, 2010.

Anomalous behavior of hydrodynamic modes in the two dimensional shear flow of a granular material

The growth rates of the hydrodynamic modes in the homogeneous sheared state of a granular material are determined by solving the Boltzmann equation. The steady velocity distribution is considered to be the product of the Maxwell Boltzmann distribution and a Hermite polynomial expansion in the velocity components; this form is inserted into them Boltzmann equation and solved to obtain the coeificients of the terms in the expansion. The solution is obtained using an expansion in the parameter epsilon =(1 - e)(1/2), and terms correct to epsilon(4) are retained to obtain an approximate solution; the error due to the neglect of higher terms is estimated at about 5% for e = 0.7. A small perturbation is placed on the distribution function in the form of a Hermite polynomial expansion for the velocity variations and a Fourier expansion in the spatial coordinates: this is inserted into the Boltzmann equation and the growth rate of the Fourier modes is determined. It is found that in the hydrodynamic limit, the growth rates of the hydrodynamic modes in the flow direction have unusual characteristics. The growth rate of the momentum diffusion mode is positive, indicating that density variations are unstable in the limit k--> 0, and the growth rate increases proportional to kslash} k kslash}(2/3) in the limit k --> 0 (in contrast to the k(2) increase in elastic systems), where k is the wave vector in the flow direction. The real and imaginary parts of the growth rate corresponding to the propagating also increase proportional to kslash k kslash(2/3) (in contrast to the k(2) and k increase in elastic systems). The energy mode is damped due to inelastic collisions between particles. The scaling of the growth rates of the hydrodynamic modes with the wave vector I in the gradient direction is similar to that in elastic systems. (C) 2000 Elsevier Science B.V. All rights reserved.

SPSA algorithms with measurement reuse

Four algorithms, all variants of Simultaneous Perturbation Stochastic Approximation (SPSA), are proposed. The original one-measurement SPSA uses an estimate of the gradient of objective function L containing an additional bias term not seen in two-measurement SPSA. As a result, the asymptotic covariance matrix of the iterate convergence process has a bias term. We propose a one-measurement algorithm that eliminates this bias, and has asymptotic convergence properties making for easier comparison with the two-measurement SPSA. The algorithm, under certain conditions, outperforms both forms of SPSA with the only overhead being the storage of a single measurement. We also propose a similar algorithm that uses perturbations obtained from normalized Hadamard matrices. The convergence w.p. 1 of both algorithms is established. We extend measurement reuse to design two second-order SPSA algorithms and sketch the convergence analysis. Finally, we present simulation results on an illustrative minimization problem.

Comparative study on damage identification from lso-Eigen-Value-Change contours and smeared damage model

The paper proposes two methodologies for damage identification from measured natural frequencies of a contiguously damaged reinforced concrete beam, idealised with distributed damage model. The first method identifies damage from Iso-Eigen-Value-Change contours, plotted between pairs of different frequencies. The performance of the method is checked for a wide variation of damage positions and extents. The method is also extended to a discrete structure in the form of a five-storied shear building and the simplicity of the method is demonstrated. The second method is through smeared damage model, where the damage is assumed constant for different segments of the beam and the lengths and centres of these segments are the known inputs. First-order perturbation method is used to derive the relevant expressions. Both these methods are based on distributed damage models and have been checked with experimental program on simply supported reinforced concrete beams, subjected to different stages of symmetric and un-symmetric damages. The results of the experiments are encouraging and show that both the methods can be adopted together in a damage identification scenario.

External Bias Dependent Direct To Indirect Band Gap Transition in Graphene Nanoribbon

In this work, using self-consistent tight-binding calculations. for the first time, we show that a direct to indirect band gap transition is possible in an armchair graphene nanoribbon by the application of an external bias along the width of the ribbon, opening up the possibility of new device applications. With the help of the Dirac equation, we qualitatively explain this band gap transition using the asymmetry in the spatial distribution of the perturbation potential produced inside the nanoribbon by the external bias. This is followed by the verification of the band gap trends with a numerical technique using Magnus expansion of matrix exponentials. Finally, we show that the carrier effective masses possess tunable sharp characters in the vicinity of the band gap transition points.

A singularity-free cosmological model in ECSK theory

In the framework of the ECSK [Einstein-Cartan-Sciama-Kibble] theory of cosmology, a scalar field nonminimally coupled to the gravitational field is considered. For a Robertson-Walker open universe (k=0) in the radiation era, the field equations admit a singularity-free solution for the scale factor. In theory, the torsion is generated through nonminimal coupling of a scalar field to the gravitation field. The nonsingular nature of the cosmological model automatically solves the flatness problem. Further absence of event horizon and particle horizon explains the high degree of isotropy, especially of 2.7-K background radiation.

Capillary-gravity waves against a corrugated vertical cliff

An analysis involving a transformation of the velocity potential and a Fourier Sine Transform technique is described to study the effect of surface tension on incoming surface waves against a vertical cliff with a periodic wall perturbation. Known results are recovered as particular cases of the general problem considered. An analytical expression is derived for the surface elevation, at far distances from the shore-line, by using Watson's lemma and a representative table of numerical values of the coefficients of the resulting asymptotic expansion is also presented.

Nonsingular cosmological models: the massive scalar field case

The nonminimal coupling of a massive self-interacting scalar field with a gravitational field is studied. Spontaneous symmetry breaking occurs in the open universe even when the sign on the mass term is positive. In contrast to grand unified theories, symmetry breakdown is more important for the early universe and it is restored only in the limit of an infinite expansion. Symmetry breakdown is shown to occur in flat and closed universes when the mass term carries a wrong sign. The model has a naturally defined effective gravitational coupling coefficient which is rendered time-dependent due to the novel symmetry breakdown. It changes sign below a critical value of the cosmic scale factor indicating the onset of a repulsive field. The presence of the mass term severely alters the behaviour of ordinary matter and radiation in the early universe. The total energy density becomes negative in a certain domain. These features make possible a nonsingular cosm

The superfluid as a source of all interactions

The superfluid state of fermion-antifermion fields developed in our previous papers is generalized to include higher orbital and spin states. In addition to single-particle excitations, the system is capable of having real and virtual bound or quasibound composite excitations which are akin to bosons of spinJ P equal to0 �, 1�, 2+, etc. These pseudoscalar, vector, and tensor bosons can be massive or massless and provide the vehicles for strong, electromagnetic, weak, and gravitational interactions. The concept that the basic (unmanifest) fermion-antifermion interaction can lead to a multiplicity of manifest interactions seems to provide a basis for a unified field theory.