New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

The effect of blood glucose on the vasculature in young patients with type 1 diabetes

Background. Patients with type 1 diabetes are at markedly increased risk of vascular complications. In this respect it is noteworthy that hyperglycaemia that is shown to cause endothelial dysfunction, has clearly been shown to be a risk factor for diabetic microvascular disease. However, the role of hyperglycaemia as a predictor of macrovascular disease is not as clear as for microvascular disease, although type 1 diabetes itself increases the risk of cardiovascular disease substantially. Furthermore, it is not known whether it is the short-term or the long-term hyperglycaemia that confers possible risk. In addition, the role of glucose variability as a predictor of complications is to a large extent unexplored. Interestingly, although hyperglycaemia increases the risk of pre-eclampsia in women with type 1 diabetes, it is unclear whether pre-eclampsia, a condition characterized by endothelial dysfunction, is also a risk factor for microvascular complication, diabetic nephropathy. Aims. This doctoral thesis investigated the role of acute hyperglycaemia and glucose variability on arterial stiffness and cardiac ventricular repolarisation in male patients with type 1 diabetes as well as in healthy male volunteers. The thesis also explored whether acute hyperglycaemia leads to an inflammatory response, endothelial dysfunction and oxidative stress. Finally, the role of pre-eclampsia, as a predictor of diabetic nephropathy in type 1 diabetes was examined. Subjects and methods. In order to study glucose variability and the daily glycaemic control, 22 male patients with type 1 diabetes, without any diabetic complications, were monitored for 72-h with a continuous glucose monitoring system. At the end of the 72-h glucose monitoring period a 2-h hyperglycaemic clamp was performed both in the patients with type 1 diabetes and in the 13 healthy age-matched male volunteers. Blood pressure, arterial stiffness and QT time were measured to detect vascular changes during acute hyperglycaemia. Blood samples were drawn at baseline (normoglycaemia) and during acute hyperglycaemia. In another patient sample, women with type 1 diabetes were followed during their pregnancy and restudied eleven years later to elucidate the role of pre-eclampsia and pregnancy-induced hypertension as potential risk factors for diabetic nephropathy. Results and conclusions. Acute hyperglycaemia increased arterial stiffness as well as caused a disturbance in the myocardial ventricular repolarisation, emphasizing the importance of a strict daily glycaemic control in male patients with type 1 diabetes. An inflammatory response was also observed during acute hyperglycaemia. Furthermore, a high mean daily blood glucose but not glucose variability per se is associated with arterial stiffness. While glucose variability in turn correlated with central blood pressure, the results suggest that the glucose metabolism is closely linked to the haemodynamic changes in male patients with uncomplicated type 1 diabetes. Notably, the results are not directly applicable to females. Finally, a history of a pre-eclamptic pregnancy, but not pregnancy-induced hypertension was associated with increased risk of diabetic nephropathy.

Self-acylation properties of type II fatty acid biosynthesis acyl carrier protein

Acyl carrier protein (ACIP) plays a central role in many metabolic processes inside the cell, and almost 4% of the total enzymes inside the cell require it as a cofactor. Here, we report self-acylation properties in ACPs from Plasmodium falciparum and Brassica napus that are essential components of type II fatty acid biosynthesis (FAS II), disproving the existing notion that this phenomenon is restricted only to ACPs involved in polyketide biosynthesis. We also provide strong evidence to suggest that catalytic self-acylation is intrinsic to the individual ACP. Mutational analysis of these ACPs revealed the key residue(s) involved in this phenomenon. We also demonstrate that these FAS 11 ACPs exhibit a high degree of selectivity for self-acylation employing only dicarboxylic acids as substrates. A plausible mechanism for the self-acylation reaction is also proposed.

Semigroups on Frechet spaces and equations with infinite delays

In this paper, we show existence and uniqueness of a solution to a functional differential equation with infinite delay. We choose an appropriate Frechet space so as to cover a large class of functions to be used as initial functions to obtain existence and uniqueness of solutions.

One-dimensional zig-zag type coordination polymers of Ni(II) and Cu(II) containing 1,3-benzenedicarboxylate and 1,3-diaminopropane: Structural, spectral and thermal studies

Two coordination polymers [Ni(ipt)(dap)(2)](n) (1) and [Cu(ipt)(dap)H2O](n) center dot nH(2)O (2) with an overall one-dimensional arrangement and having isophthalate (ipt) as bridging moieties and chelating 1,3-diaminopropane (dap) as structure modulating units have been prepared and characterized by crystallographic, spectroscopic and thermo-analytical studies. Both have an overall one-dimensional zig-zag nature but with a distorted octahedral NiN4O2 chromophore for 1 and a distorted square pyramidal CuN2O3 chromophore for 2. Even though the ipt units are acting as bridging units through mono-dentatively coordinating carboxylate functions in both polymers, compound 1 has the carboxylate oxygen linkages at the trans positions, while in 2 the oxygen linkages occur at the cis positions leading to a different type of zig-zag arrangement. Relevant spectral and bonding parameters also could be evaluated for the compounds using UV-Vis and EPR spectra. Thermal stability and possible structural modifications on thermal treatment of the compounds were also investigated and the relevant thermodynamic and kinetic parameters evaluated from the thermal data. (C) 2007 Elsevier B.V. All rights reserved.

Tuning the beta-turn segment in designed peptide beta-hairpins: Construction of a stable type I ' beta-turn nucleus and hairpin-helix transition promoting segments

Designed octapeptides Boc-Leu-Val-Val-Aib-(D)Xxx-Leu- Val-Val-OMe ((D)Xxx = (D)Ala, 3a; (D)Val, 3c and (D)Pro, 5a) and Boc-Leu-Phe-Val-Aib-DAla-Leu-Phe-Val-OMe (3b) have been investigated to construct models of a stable type I' beta-turn nucleated hairpin and to generate systems for investigating helix-hairpin conformational transitions. Peptide 5a, which contains a central Aib-(D)Pro segment, is shown to adopt a stable type I' beta-turn nucleated hairpin structure, stabilized by four cross-strand hydrogen bonds. The stability of the structure in diverse solvents is established by the observation of all diagnostic NOEs expected in a beta-hairpin conformation. Replacement of (D)Pro5 by (D)Ala/(D)Val (3a-c) results in sequences that form beta-hairpins in hydrogen bonding solvents like CD3OH and DMSO-d(6). However, in CDCl3 evidence for population of helical conformations is obtained. Peptide 6b (Boc-Leu-Phe-Val-Aib-Aib-Leu-Phe-Val-OMe), which contains a centrally positioned Aib-Aib segment, provides a clear example of a system, which exhibits a helical conformation in CDCl3 and a significant population of both helices and hairpins in CD3OH and DMSO-d(6). The coexistence of multiple conformations is established by the simultaneous observation of diagnostic NOEs. Control over stereochemistry of the central beta-turn permits generation of models for robust beta-hairpins and also for the construction of systems that may be used to probe helix-hairpin conformational transitions. (c) 2006 Wiley Periodicals, Inc.

Evidence for an association with type 2 diabetes mellitus at the PPARG locus in a South Indian population

Peroxisome proliferator activated receptor-gamma 2 (PPARG2) is a nuclear hormone receptor of ligand-dependent ranscription factor involved in adipogenesis and a molecular target of the insulin sensitizers thiazolidinediones. We addressed the question of whether the 3 variants (-1279G/A, Pro12Ala, and His478His) in the PPARG2 gene are associated with type 2 diabetes mellitus and its related traits in a South Indian population. The study subjects (1000 type 2 diabetes mellitus and 1000 normal glucose-tolerant subjects) were chosen randomly from the Chennai Urban Rural Epidemiology Study, an ongoing population-based study in southern India. The variants were screened by single-stranded conformational variant, direct sequencing, and restriction fragment length polymorphism. Linkage disequilibrium was estimated from the estimates of haplotypic frequencies. The -1279G/A, Pro12Ala, and His478His variants of the PPARG2 gene were not associated with type 2 diabetes mellitus. However, the 2-loci analyses showed that, in the presence of Pro/Pro genotype of the Pro12Ala variant, the -1279G/A promoter variant showed increased susceptibility to type 2 diabetes mellitus (odds ratio, 2.092; 95% confidence interval, 1.22-3.59; P = .008), whereas in the presence of 12Ala allele, the -1279G/A showed a protective effect against type 2 diabetes mellitus (odds ratio, 0.270; 95% confidence interval, 0.15-0.49; P < .0001). The 3-loci haplotype analysis showed that the A-Ala-T (-1279G/A-Pro12Ala-His478His) haplotype was associated with a reduced risk of type 2 diabetes mellitus (P < .0001). Although our data indicate that the PPARG2 gene variants, independently, have no association with type 2 diabetes mellitus, the 2-loci genotype analysis involving -1279G/A and Pro12Ala variants and the 3-loci haplotype analysis have shown a significant association with type 2 diabetes mellitus in this South Indian population. (C) 2010 Elsevier Inc. All rights reserved.

Monoclinic polymorph of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe(anhydrous). Parallel packing of 3(10)-/alpha-helices and a transition of helix type

The structures of two crystal forms of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe have been determined. The triclinic form (P1, Z = 1) from DMSO/H2O crystallizes as a dihydrate (Karle, Sukumar & Balaram (1986) Proc, Natl, Acad. Sci. USA 83, 9284-9288). The monoclinic form (P2(1), Z = 2) crystallized from dioxane is anhydrous. The conformation of the peptide is essentially the same in both crystal system, but small changes in conformational angles are associated with a shift of the helix from a predominantly alpha-type to a predominantly 3(10)-type. The r.m.s. deviation of 33 atoms in the backbone and C beta positions of residues 2-8 is only 0.29 A between molecules in the two polymorphs. In both space groups, the helical molecules pack in a parallel fashion, rather than antiparallel. The only intermolecular hydrogen bonding is head-to-tail between helices. There are no lateral hydrogen bonds. In the P2(1) cell, a = 9.422(2) A, b = 36.392(11) A, c = 10.548(2) A, beta = 111.31(2) degrees and V = 3369.3 A for 2 molecules of C60H97N11O13 per cell.

Semigroups on Frechet spaces and equations with infinite delays

In this paper, we show existence and uniqueness of a solution to a functional differential equation with infinite delay. We choose an appropriate Frechet space so as to cover a large class of functions to be used as initial functions to obtain existence and uniqueness of solutions.

Conformation of di-n-propylglycine residues (Dpg) in peptides: crystal structures of a type I 'beta-turn forming tetrapeptide and an alpha-helical tetradecapeptide

The crystal structures of two oligopeptides containing di-n-propylglycine (Dpg) residues, Boc-Gly-Dpg-Gly-Leu-OMe (1) and Boc-Val-Ala-Leu-Dpg-Val-Ala-Leu-Val-Ala-Leu-Dpg-Val-Ala-Leu-OMe (2) are presented. Peptide 1 adopts a type I' beta-turn conformation with Dpg(2)-Gly(3) at the corner positions. The 14-residue peptide 2 crystallizes with two molecules in the asymmetric unit, both of which adopt alpha-helical conformations stabilized by 11 successive 5 -> 1 hydrogen bonds. In addition, a single 4 -> 1 hydrogen bond is also observed at the N-terminus. All live Dpg residues adopt backbone torsion angles (phi, psi) in the helical region of conformational space. Evaluation of the available structural data on Dpg peptides confirm the correlation between backbone bond angle N-C-alpha-C' (tau) and the observed backbone phi,psi values. For tau > 106 degrees, helices are observed, while fully extended structures are characterized by tau < 106 degrees. The mean r values for extended and folded conformations for the Dpg residue are 103.6 degrees +/- 1.7 degrees and 109.9 degrees +/- 2.6 degrees, respectively. Copyright (C) 2007 European Peptide Society and John Wiley & Sons, Ltd.

Energetics of carbohydrate binding by a 14 kDa S-type mammalian lectin

The thermodynamics of the binding of derivatives of galactose and lactose to a 14 kDa beta-galactoside-binding lectin (L-14) from sheep spleen has been studied in 10 nM phosphate/150 mM NaCl/10 mM beta-mercaptoethanol buffer, pH 7.4, and in the temperature range 285-300 K using titration calorimetry. The single-site binding constants of various sugars for the lectin were in the following order: N-acetyl-lactosamine thiodigalactoside > 4-methylumbelliferyl lactoside > lactose > 4-methylumbelliferyl alpha-D-galactoside > methyl-alpha-galactose > methyl-beta-galactose. Reactions were essentially enthalpically driven with the binding enthalpies ranging from -53.8 kJ/mol for thiodigalactoside at 301 K to -2.2 kJ/mol for galactose at 300 K, indicating that hydrogen-bonding and van der Waals interactions provide the major stabilization for these reactions. However, the binding of 4-methylumbelliferyl-alpha-D-galactose displays relatively favourable entropic contributions, indicating the existence of a non-polar site adjacent to the galactose-binding subsite. From the increments in the enthalpies for the binding of lactose, N-acetyl-lactosamine and thiodigalactoside relative to methyl-beta-galactose, the contribution of glucose binding in the subsite adjacent to that for galactose shows that glucose makes a major contribution to the stability of L-14 disaccharide complexes. Observation of enthalpy-entropy compensation for the recognition of saccharides such as lactose by L-14 and the absence of it for monosaccharides such as galactose, together with the lack of appreciable changes in the heat capacity (delta Cp), indicate that reorganization of water plays an important role in these reactions.

Approximate methods for step function response of undamped non-linear spring mass systems with arbitrary hardening type spring characteristic

The possibility of applying two approximate methods for determining the salient features of response of undamped non-linear spring mass systems subjected to a step input, is examined. The results obtained on the basis of these approximate methods are compared with the exact results that are available for some particular types of spring characteristics. The extension of the approximate methods for non-linear systems with general polynomial restoring force characteristics is indicated.

Physical activity and diabetic complications in patients with type 1 diabetes

Type 1 diabetes is associated with the risk for late diabetic complications which are divided into microvascular (retinopathy, nephropathy, and neuropathy) and macrovascular (cardiovascular disease, CVD) diseases. The risk for diabetic complication can be reduced by effective treatment, most importantly the glycaemic control. Glycaemia in type 1 diabetes is influenced by the interplay between insulin injections and lifestyle factors such as physical activity and diet. The effect of physical activity in patients with type 1 diabetes is not well known, however. The aim of this thesis was to investigate the physical activity and the physical fitness of patients with type 1 diabetes with special emphasis on glycaemic control and the diabetic complications. The patients included in the study were all part of the nationwide, multicenter Finnish Diabetic Nephropathy (FinnDiane) Study which aims to characterise genetic, clinical, and environmental factors that predispose to diabetic complications in patients with type 1 diabetes. In addition, subjects from the IDentification of EArly mechanisms in the pathogenesis of diabetic Late complications (IDEAL) Study were studied. Physical activity was assessed in the FinnDiane Study in 1945 patients by a validated questionnaire. Physical fitness was measured in the IDEAL Study by spiroergometry (cycle test with measurement of respiratory gases) in 86 young adults with type 1 diabetes and in 27 healthy controls. All patients underwent thorough clinical characterisation of their diabetic complication status. Four substudies were cross-sectional using baseline data and one study additionally used follow-up data. Physical activity, especially the intensity of activities, was reduced in patients affected by diabetic nephropathy, retinopathy, and CVD. Low physical activity was associated with poor glycaemic control, a finding most clear in women and evident also in patients with no signs of diabetic complications. Furthermore, low physical activity was associated with a higher HbA1c variability, which in turn was associated with the progression of renal disease and CVD during follow-up. A higher level of physical activity was also associated with better insulin sensitivity. The prevalence of the metabolic syndrome in type 1 diabetes was also lower the higher the physical activity. The aerobic physical fitness level of young adults with type 1 diabetes was reduced compared with healthy peers and in men an association between higher fitness level and lower HbA1c was observed. In patients with type 1 diabetes, a higher physical activity was associated with better glycaemic control and may thus be beneficial with respect to the prevention of diabetic complications.