New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

Self-acylation properties of type II fatty acid biosynthesis acyl carrier protein

Acyl carrier protein (ACIP) plays a central role in many metabolic processes inside the cell, and almost 4% of the total enzymes inside the cell require it as a cofactor. Here, we report self-acylation properties in ACPs from Plasmodium falciparum and Brassica napus that are essential components of type II fatty acid biosynthesis (FAS II), disproving the existing notion that this phenomenon is restricted only to ACPs involved in polyketide biosynthesis. We also provide strong evidence to suggest that catalytic self-acylation is intrinsic to the individual ACP. Mutational analysis of these ACPs revealed the key residue(s) involved in this phenomenon. We also demonstrate that these FAS 11 ACPs exhibit a high degree of selectivity for self-acylation employing only dicarboxylic acids as substrates. A plausible mechanism for the self-acylation reaction is also proposed.

One-dimensional zig-zag type coordination polymers of Ni(II) and Cu(II) containing 1,3-benzenedicarboxylate and 1,3-diaminopropane: Structural, spectral and thermal studies

Two coordination polymers [Ni(ipt)(dap)(2)](n) (1) and [Cu(ipt)(dap)H2O](n) center dot nH(2)O (2) with an overall one-dimensional arrangement and having isophthalate (ipt) as bridging moieties and chelating 1,3-diaminopropane (dap) as structure modulating units have been prepared and characterized by crystallographic, spectroscopic and thermo-analytical studies. Both have an overall one-dimensional zig-zag nature but with a distorted octahedral NiN4O2 chromophore for 1 and a distorted square pyramidal CuN2O3 chromophore for 2. Even though the ipt units are acting as bridging units through mono-dentatively coordinating carboxylate functions in both polymers, compound 1 has the carboxylate oxygen linkages at the trans positions, while in 2 the oxygen linkages occur at the cis positions leading to a different type of zig-zag arrangement. Relevant spectral and bonding parameters also could be evaluated for the compounds using UV-Vis and EPR spectra. Thermal stability and possible structural modifications on thermal treatment of the compounds were also investigated and the relevant thermodynamic and kinetic parameters evaluated from the thermal data. (C) 2007 Elsevier B.V. All rights reserved.

Tuning the beta-turn segment in designed peptide beta-hairpins: Construction of a stable type I ' beta-turn nucleus and hairpin-helix transition promoting segments

Designed octapeptides Boc-Leu-Val-Val-Aib-(D)Xxx-Leu- Val-Val-OMe ((D)Xxx = (D)Ala, 3a; (D)Val, 3c and (D)Pro, 5a) and Boc-Leu-Phe-Val-Aib-DAla-Leu-Phe-Val-OMe (3b) have been investigated to construct models of a stable type I' beta-turn nucleated hairpin and to generate systems for investigating helix-hairpin conformational transitions. Peptide 5a, which contains a central Aib-(D)Pro segment, is shown to adopt a stable type I' beta-turn nucleated hairpin structure, stabilized by four cross-strand hydrogen bonds. The stability of the structure in diverse solvents is established by the observation of all diagnostic NOEs expected in a beta-hairpin conformation. Replacement of (D)Pro5 by (D)Ala/(D)Val (3a-c) results in sequences that form beta-hairpins in hydrogen bonding solvents like CD3OH and DMSO-d(6). However, in CDCl3 evidence for population of helical conformations is obtained. Peptide 6b (Boc-Leu-Phe-Val-Aib-Aib-Leu-Phe-Val-OMe), which contains a centrally positioned Aib-Aib segment, provides a clear example of a system, which exhibits a helical conformation in CDCl3 and a significant population of both helices and hairpins in CD3OH and DMSO-d(6). The coexistence of multiple conformations is established by the simultaneous observation of diagnostic NOEs. Control over stereochemistry of the central beta-turn permits generation of models for robust beta-hairpins and also for the construction of systems that may be used to probe helix-hairpin conformational transitions. (c) 2006 Wiley Periodicals, Inc.

A Fair Contract for Managing Water Scarcity

In public utilities, under supply constraints, fairness considerations lead to a market failure. This paper characterizes a two-period principal-agent contract for demand management, that mitigates this market failure in urban water systems. The contract is designed as an extensive form mechanism using subgame perfect Nash equilibrium (SPNE) as the solution concept. The contract is fair; and is shown to be economically efficient if, in case of deviation by the agent, the gain to the agent and the loss to the principal are small. It is shown that the assumption can be avoided in an infinite horizon contract.

Evidence for an association with type 2 diabetes mellitus at the PPARG locus in a South Indian population

Peroxisome proliferator activated receptor-gamma 2 (PPARG2) is a nuclear hormone receptor of ligand-dependent ranscription factor involved in adipogenesis and a molecular target of the insulin sensitizers thiazolidinediones. We addressed the question of whether the 3 variants (-1279G/A, Pro12Ala, and His478His) in the PPARG2 gene are associated with type 2 diabetes mellitus and its related traits in a South Indian population. The study subjects (1000 type 2 diabetes mellitus and 1000 normal glucose-tolerant subjects) were chosen randomly from the Chennai Urban Rural Epidemiology Study, an ongoing population-based study in southern India. The variants were screened by single-stranded conformational variant, direct sequencing, and restriction fragment length polymorphism. Linkage disequilibrium was estimated from the estimates of haplotypic frequencies. The -1279G/A, Pro12Ala, and His478His variants of the PPARG2 gene were not associated with type 2 diabetes mellitus. However, the 2-loci analyses showed that, in the presence of Pro/Pro genotype of the Pro12Ala variant, the -1279G/A promoter variant showed increased susceptibility to type 2 diabetes mellitus (odds ratio, 2.092; 95% confidence interval, 1.22-3.59; P = .008), whereas in the presence of 12Ala allele, the -1279G/A showed a protective effect against type 2 diabetes mellitus (odds ratio, 0.270; 95% confidence interval, 0.15-0.49; P < .0001). The 3-loci haplotype analysis showed that the A-Ala-T (-1279G/A-Pro12Ala-His478His) haplotype was associated with a reduced risk of type 2 diabetes mellitus (P < .0001). Although our data indicate that the PPARG2 gene variants, independently, have no association with type 2 diabetes mellitus, the 2-loci genotype analysis involving -1279G/A and Pro12Ala variants and the 3-loci haplotype analysis have shown a significant association with type 2 diabetes mellitus in this South Indian population. (C) 2010 Elsevier Inc. All rights reserved.

Monoclinic polymorph of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe(anhydrous). Parallel packing of 3(10)-/alpha-helices and a transition of helix type

The structures of two crystal forms of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe have been determined. The triclinic form (P1, Z = 1) from DMSO/H2O crystallizes as a dihydrate (Karle, Sukumar & Balaram (1986) Proc, Natl, Acad. Sci. USA 83, 9284-9288). The monoclinic form (P2(1), Z = 2) crystallized from dioxane is anhydrous. The conformation of the peptide is essentially the same in both crystal system, but small changes in conformational angles are associated with a shift of the helix from a predominantly alpha-type to a predominantly 3(10)-type. The r.m.s. deviation of 33 atoms in the backbone and C beta positions of residues 2-8 is only 0.29 A between molecules in the two polymorphs. In both space groups, the helical molecules pack in a parallel fashion, rather than antiparallel. The only intermolecular hydrogen bonding is head-to-tail between helices. There are no lateral hydrogen bonds. In the P2(1) cell, a = 9.422(2) A, b = 36.392(11) A, c = 10.548(2) A, beta = 111.31(2) degrees and V = 3369.3 A for 2 molecules of C60H97N11O13 per cell.

Conformation of di-n-propylglycine residues (Dpg) in peptides: crystal structures of a type I 'beta-turn forming tetrapeptide and an alpha-helical tetradecapeptide

The crystal structures of two oligopeptides containing di-n-propylglycine (Dpg) residues, Boc-Gly-Dpg-Gly-Leu-OMe (1) and Boc-Val-Ala-Leu-Dpg-Val-Ala-Leu-Val-Ala-Leu-Dpg-Val-Ala-Leu-OMe (2) are presented. Peptide 1 adopts a type I' beta-turn conformation with Dpg(2)-Gly(3) at the corner positions. The 14-residue peptide 2 crystallizes with two molecules in the asymmetric unit, both of which adopt alpha-helical conformations stabilized by 11 successive 5 -> 1 hydrogen bonds. In addition, a single 4 -> 1 hydrogen bond is also observed at the N-terminus. All live Dpg residues adopt backbone torsion angles (phi, psi) in the helical region of conformational space. Evaluation of the available structural data on Dpg peptides confirm the correlation between backbone bond angle N-C-alpha-C' (tau) and the observed backbone phi,psi values. For tau > 106 degrees, helices are observed, while fully extended structures are characterized by tau < 106 degrees. The mean r values for extended and folded conformations for the Dpg residue are 103.6 degrees +/- 1.7 degrees and 109.9 degrees +/- 2.6 degrees, respectively. Copyright (C) 2007 European Peptide Society and John Wiley & Sons, Ltd.

Energetics of carbohydrate binding by a 14 kDa S-type mammalian lectin

The thermodynamics of the binding of derivatives of galactose and lactose to a 14 kDa beta-galactoside-binding lectin (L-14) from sheep spleen has been studied in 10 nM phosphate/150 mM NaCl/10 mM beta-mercaptoethanol buffer, pH 7.4, and in the temperature range 285-300 K using titration calorimetry. The single-site binding constants of various sugars for the lectin were in the following order: N-acetyl-lactosamine thiodigalactoside > 4-methylumbelliferyl lactoside > lactose > 4-methylumbelliferyl alpha-D-galactoside > methyl-alpha-galactose > methyl-beta-galactose. Reactions were essentially enthalpically driven with the binding enthalpies ranging from -53.8 kJ/mol for thiodigalactoside at 301 K to -2.2 kJ/mol for galactose at 300 K, indicating that hydrogen-bonding and van der Waals interactions provide the major stabilization for these reactions. However, the binding of 4-methylumbelliferyl-alpha-D-galactose displays relatively favourable entropic contributions, indicating the existence of a non-polar site adjacent to the galactose-binding subsite. From the increments in the enthalpies for the binding of lactose, N-acetyl-lactosamine and thiodigalactoside relative to methyl-beta-galactose, the contribution of glucose binding in the subsite adjacent to that for galactose shows that glucose makes a major contribution to the stability of L-14 disaccharide complexes. Observation of enthalpy-entropy compensation for the recognition of saccharides such as lactose by L-14 and the absence of it for monosaccharides such as galactose, together with the lack of appreciable changes in the heat capacity (delta Cp), indicate that reorganization of water plays an important role in these reactions.

Approximate methods for step function response of undamped non-linear spring mass systems with arbitrary hardening type spring characteristic

The possibility of applying two approximate methods for determining the salient features of response of undamped non-linear spring mass systems subjected to a step input, is examined. The results obtained on the basis of these approximate methods are compared with the exact results that are available for some particular types of spring characteristics. The extension of the approximate methods for non-linear systems with general polynomial restoring force characteristics is indicated.

Quinone studies—Istar, open: Evidence for a new type of substitution reaction of phenanthrene-9,10-quinone derivatives

The para orientation by the carbonyl groups in the bromination of phenanthrenequinone derivatives has been explained on the basis of an excited state resulting from thermal excitation of the quinone and/or from a n→π* transition of the nonbonding electrons of the oxygen atoms. A general preparative method for the syntheses of 3-bromophenanthrenequinone derivatives has been developed. The structure of 2-nitro-6-bromophenanthrenequinone has been established by degradation. Synthesis of 2-nitro-6-bromofluorenone is described. Direct bromination of phenanthrenequinone to 2-bromo and 2,7-dibromo derivatives has also been described.

Recombination and trapping in n-type cobalt-doped germanium

The role of cobalt centers in promoting the recombination and trapping processes in n-type germanium has been investigated. Data on lifetime measurements carried out by the steadystate photoconductivity and photo-magneto-electric methods in the temperature range 145 to 300°K on n-type germanium samples containing cobalt in the concentration range 1·1013 to 5.·014/cm3 are presented. The results are analysed on the basis of Sah-Shockley's multi-level formula to yield the capture cross-sections Sp= (hole capture cross-section at doubly negatively charged center) and Sn-(electron capture cross-section at singly negatively charged center) and temperature dependence. It is found that Sp= is (22 ± 6). 10-16 cm2 and Sn- is ∼ 0·1. 10-16 cm2 at 145°K. Sp= varies (n = 3·5 to 4·5) in the range 145-220°K; above 225°K the index 'n' tends to a smaller value. Sn- is practically temperature independent below 180°K and increases with increase of temperature above 180°K. The value of Sp= and its temperature variation lead one to the conclusion that during capture at attractive centers, the phonon cascade mechanism is responsible for the dissipation of the recombination energy.

Electron-hole recombination in cobalt-doped p-type germanium

The recombination properties of cobalt centers in p-type germanium containing cobalt in the concentration range 1014 to 1016 atoms/cm3 have been investigated. The measurement of lifetime has been carried out by steady-state photoconductivity and photo-magneto-electric methods in the temperature range 145 to 300°K. The cross-sections Sno (electron capture cross-section at neutral centers). Sn- (electron capture cross-section at singly negatively charged centers) and their temperature variations have been estimated by the analysis of the lifetime data on the basis of Sah-Shockley's multi-level formula. The value of Sno is (15±5).10-16 cm2 and is temperature independent. The value of Sn- is ≈4·10-16 cm2 around 225°K and it increases with increase of temperature. The possible mechanisms for capture at neutral and repulsive centers are discussed and a summary of the capture cross-sections for cobalt centers is given. A comparison of the cross-section values of cobalt and their temperature variations with those of the related impurities-manganese, iron and nickel-in germanium has been made.