New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

The effect of blood glucose on the vasculature in young patients with type 1 diabetes

Background. Patients with type 1 diabetes are at markedly increased risk of vascular complications. In this respect it is noteworthy that hyperglycaemia that is shown to cause endothelial dysfunction, has clearly been shown to be a risk factor for diabetic microvascular disease. However, the role of hyperglycaemia as a predictor of macrovascular disease is not as clear as for microvascular disease, although type 1 diabetes itself increases the risk of cardiovascular disease substantially. Furthermore, it is not known whether it is the short-term or the long-term hyperglycaemia that confers possible risk. In addition, the role of glucose variability as a predictor of complications is to a large extent unexplored. Interestingly, although hyperglycaemia increases the risk of pre-eclampsia in women with type 1 diabetes, it is unclear whether pre-eclampsia, a condition characterized by endothelial dysfunction, is also a risk factor for microvascular complication, diabetic nephropathy. Aims. This doctoral thesis investigated the role of acute hyperglycaemia and glucose variability on arterial stiffness and cardiac ventricular repolarisation in male patients with type 1 diabetes as well as in healthy male volunteers. The thesis also explored whether acute hyperglycaemia leads to an inflammatory response, endothelial dysfunction and oxidative stress. Finally, the role of pre-eclampsia, as a predictor of diabetic nephropathy in type 1 diabetes was examined. Subjects and methods. In order to study glucose variability and the daily glycaemic control, 22 male patients with type 1 diabetes, without any diabetic complications, were monitored for 72-h with a continuous glucose monitoring system. At the end of the 72-h glucose monitoring period a 2-h hyperglycaemic clamp was performed both in the patients with type 1 diabetes and in the 13 healthy age-matched male volunteers. Blood pressure, arterial stiffness and QT time were measured to detect vascular changes during acute hyperglycaemia. Blood samples were drawn at baseline (normoglycaemia) and during acute hyperglycaemia. In another patient sample, women with type 1 diabetes were followed during their pregnancy and restudied eleven years later to elucidate the role of pre-eclampsia and pregnancy-induced hypertension as potential risk factors for diabetic nephropathy. Results and conclusions. Acute hyperglycaemia increased arterial stiffness as well as caused a disturbance in the myocardial ventricular repolarisation, emphasizing the importance of a strict daily glycaemic control in male patients with type 1 diabetes. An inflammatory response was also observed during acute hyperglycaemia. Furthermore, a high mean daily blood glucose but not glucose variability per se is associated with arterial stiffness. While glucose variability in turn correlated with central blood pressure, the results suggest that the glucose metabolism is closely linked to the haemodynamic changes in male patients with uncomplicated type 1 diabetes. Notably, the results are not directly applicable to females. Finally, a history of a pre-eclamptic pregnancy, but not pregnancy-induced hypertension was associated with increased risk of diabetic nephropathy.

The effects of humidity on tin whisker growth by immersion tin plating and tin solder dipping surface finishes

The drive to replace lead (Pb) from electronics has led to the replacement of tin (Sn) alloys as the terminal plating for electronic devices. However, the deposition of Sn based alloys as the component surface finish tends to induce Sn whisker that causes unintended electric shorts when the conductive whiskers grow across to the adjacent conductor. Internal stress is considered as the driving force that causes the growth of Sn whiskers. In this study, stress type of elevated temperature/ humidity exposure at 55C/85%RH with the storage for up to 24 months was conducted to define the acceleration factor in samples with deposition of immersion Sn plating and Sn solder dipping. The addition of Nickel (Ni) under-layer was also applied to examine the correlation to field conditions. The results showed that the whisker length increased in high humidity irrespective of the deposition methods. It was also shown that pure Sn solder dipping mitigated the whisker growth but does not completely prevent it when alloying Sn with 0.4%wtCu. Additionally, Ni under-layer was indicated to be more efficient in mitigating the growth of whisker by prolonging the incubation time for whisker formation.

Optimal production resource reallocation for CO2 emissions reduction in manufacturing sectors

To mitigate the effects of climate change, countries worldwide are advancing technologies to reduce greenhouse gas emissions. This paper proposes and measures optimal production resource reallocation using data envelopment analysis. This research attempts to clarify the effect of optimal production resource reallocation on CO2 emissions reduction, focusing on regional and industrial characteristics. We use finance, energy, and CO2 emissions data from 13 industrial sectors in 39 countries from 1995 to 2009. The resulting emissions reduction potential is 2.54 Gt-CO2 in the year 2009, with former communist countries having the largest potential to reduce CO2 emissions in the manufacturing sectors. In particular, basic material industry including chemical and steel sectors has a lot of potential to reduce CO2 emissions.

Self-acylation properties of type II fatty acid biosynthesis acyl carrier protein

Acyl carrier protein (ACIP) plays a central role in many metabolic processes inside the cell, and almost 4% of the total enzymes inside the cell require it as a cofactor. Here, we report self-acylation properties in ACPs from Plasmodium falciparum and Brassica napus that are essential components of type II fatty acid biosynthesis (FAS II), disproving the existing notion that this phenomenon is restricted only to ACPs involved in polyketide biosynthesis. We also provide strong evidence to suggest that catalytic self-acylation is intrinsic to the individual ACP. Mutational analysis of these ACPs revealed the key residue(s) involved in this phenomenon. We also demonstrate that these FAS 11 ACPs exhibit a high degree of selectivity for self-acylation employing only dicarboxylic acids as substrates. A plausible mechanism for the self-acylation reaction is also proposed.

One-dimensional zig-zag type coordination polymers of Ni(II) and Cu(II) containing 1,3-benzenedicarboxylate and 1,3-diaminopropane: Structural, spectral and thermal studies

Two coordination polymers [Ni(ipt)(dap)(2)](n) (1) and [Cu(ipt)(dap)H2O](n) center dot nH(2)O (2) with an overall one-dimensional arrangement and having isophthalate (ipt) as bridging moieties and chelating 1,3-diaminopropane (dap) as structure modulating units have been prepared and characterized by crystallographic, spectroscopic and thermo-analytical studies. Both have an overall one-dimensional zig-zag nature but with a distorted octahedral NiN4O2 chromophore for 1 and a distorted square pyramidal CuN2O3 chromophore for 2. Even though the ipt units are acting as bridging units through mono-dentatively coordinating carboxylate functions in both polymers, compound 1 has the carboxylate oxygen linkages at the trans positions, while in 2 the oxygen linkages occur at the cis positions leading to a different type of zig-zag arrangement. Relevant spectral and bonding parameters also could be evaluated for the compounds using UV-Vis and EPR spectra. Thermal stability and possible structural modifications on thermal treatment of the compounds were also investigated and the relevant thermodynamic and kinetic parameters evaluated from the thermal data. (C) 2007 Elsevier B.V. All rights reserved.

Tuning the beta-turn segment in designed peptide beta-hairpins: Construction of a stable type I ' beta-turn nucleus and hairpin-helix transition promoting segments

Designed octapeptides Boc-Leu-Val-Val-Aib-(D)Xxx-Leu- Val-Val-OMe ((D)Xxx = (D)Ala, 3a; (D)Val, 3c and (D)Pro, 5a) and Boc-Leu-Phe-Val-Aib-DAla-Leu-Phe-Val-OMe (3b) have been investigated to construct models of a stable type I' beta-turn nucleated hairpin and to generate systems for investigating helix-hairpin conformational transitions. Peptide 5a, which contains a central Aib-(D)Pro segment, is shown to adopt a stable type I' beta-turn nucleated hairpin structure, stabilized by four cross-strand hydrogen bonds. The stability of the structure in diverse solvents is established by the observation of all diagnostic NOEs expected in a beta-hairpin conformation. Replacement of (D)Pro5 by (D)Ala/(D)Val (3a-c) results in sequences that form beta-hairpins in hydrogen bonding solvents like CD3OH and DMSO-d(6). However, in CDCl3 evidence for population of helical conformations is obtained. Peptide 6b (Boc-Leu-Phe-Val-Aib-Aib-Leu-Phe-Val-OMe), which contains a centrally positioned Aib-Aib segment, provides a clear example of a system, which exhibits a helical conformation in CDCl3 and a significant population of both helices and hairpins in CD3OH and DMSO-d(6). The coexistence of multiple conformations is established by the simultaneous observation of diagnostic NOEs. Control over stereochemistry of the central beta-turn permits generation of models for robust beta-hairpins and also for the construction of systems that may be used to probe helix-hairpin conformational transitions. (c) 2006 Wiley Periodicals, Inc.

ACE Research Vignette #52: Business growth and new initiatives in small and medium manufacturing enterprises from a design innovation program

This series of research vignettes is aimed at sharing current and interesting research findings from our team of international Entrepreneurship researchers. This vignette, written by Dr Judy Matthews examines the effects of firm engagement with design innovation programs on entrepreneurial activities of small and medium enterprises.

Evidence for an association with type 2 diabetes mellitus at the PPARG locus in a South Indian population

Peroxisome proliferator activated receptor-gamma 2 (PPARG2) is a nuclear hormone receptor of ligand-dependent ranscription factor involved in adipogenesis and a molecular target of the insulin sensitizers thiazolidinediones. We addressed the question of whether the 3 variants (-1279G/A, Pro12Ala, and His478His) in the PPARG2 gene are associated with type 2 diabetes mellitus and its related traits in a South Indian population. The study subjects (1000 type 2 diabetes mellitus and 1000 normal glucose-tolerant subjects) were chosen randomly from the Chennai Urban Rural Epidemiology Study, an ongoing population-based study in southern India. The variants were screened by single-stranded conformational variant, direct sequencing, and restriction fragment length polymorphism. Linkage disequilibrium was estimated from the estimates of haplotypic frequencies. The -1279G/A, Pro12Ala, and His478His variants of the PPARG2 gene were not associated with type 2 diabetes mellitus. However, the 2-loci analyses showed that, in the presence of Pro/Pro genotype of the Pro12Ala variant, the -1279G/A promoter variant showed increased susceptibility to type 2 diabetes mellitus (odds ratio, 2.092; 95% confidence interval, 1.22-3.59; P = .008), whereas in the presence of 12Ala allele, the -1279G/A showed a protective effect against type 2 diabetes mellitus (odds ratio, 0.270; 95% confidence interval, 0.15-0.49; P < .0001). The 3-loci haplotype analysis showed that the A-Ala-T (-1279G/A-Pro12Ala-His478His) haplotype was associated with a reduced risk of type 2 diabetes mellitus (P < .0001). Although our data indicate that the PPARG2 gene variants, independently, have no association with type 2 diabetes mellitus, the 2-loci genotype analysis involving -1279G/A and Pro12Ala variants and the 3-loci haplotype analysis have shown a significant association with type 2 diabetes mellitus in this South Indian population. (C) 2010 Elsevier Inc. All rights reserved.

Monoclinic polymorph of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe(anhydrous). Parallel packing of 3(10)-/alpha-helices and a transition of helix type

The structures of two crystal forms of Boc-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe have been determined. The triclinic form (P1, Z = 1) from DMSO/H2O crystallizes as a dihydrate (Karle, Sukumar & Balaram (1986) Proc, Natl, Acad. Sci. USA 83, 9284-9288). The monoclinic form (P2(1), Z = 2) crystallized from dioxane is anhydrous. The conformation of the peptide is essentially the same in both crystal system, but small changes in conformational angles are associated with a shift of the helix from a predominantly alpha-type to a predominantly 3(10)-type. The r.m.s. deviation of 33 atoms in the backbone and C beta positions of residues 2-8 is only 0.29 A between molecules in the two polymorphs. In both space groups, the helical molecules pack in a parallel fashion, rather than antiparallel. The only intermolecular hydrogen bonding is head-to-tail between helices. There are no lateral hydrogen bonds. In the P2(1) cell, a = 9.422(2) A, b = 36.392(11) A, c = 10.548(2) A, beta = 111.31(2) degrees and V = 3369.3 A for 2 molecules of C60H97N11O13 per cell.

Urban growth dilemmas and solutions in China: Looking forward to 2030

China’s urbanization and industrialization are occupying farmland in large amounts, which is strongly driven by land finance regime. This is due to the intensified regional/local competition for manufacturing investment opportunities that push local governments to expropriate farmland at low prices while lease land at high market value to property developers. The additional revenue obtained in this way, termed financial increment in land values, can drive local economic growth, and provide associated infrastructure and other public services. At the same time, however, a floating population of large numbers of inadequately compensated land-lost farmers, although unable to become citizens, have to migrate into the urban areas for work, causing overheated employment and housing markets, with rocketing unaffordable housing prices. This, together with various micro factors relating to the party/state’s promotion/evaluation system play an essential role leading to some serious economic, environment and social consequences, e.g., on migrant welfare, the displacement of peasants and the loss of land resources that requires immediate attention. Our question is: whether such type of urbanization is sustainable? What are the mechanisms behind such a phenomenal urbanization process? From the perspective of institutionalism, this paper aims to investigate the institutional background of the urban growth dilemma and solutions in urban China and to introduce further an inter-regional game theoretical framework to indicate why the present urbanization pattern is unsustainable. Looking forward to 2030, paradigm policy changes are made from the triple consideration of floating population, social security and urban environmental pressures. This involves: (1) changing land increment based finance regime into land stock finance system; (2) the citizenization of migrant workers with affordable housing, and; (3) creating a more enlightened local government officer appraisal system to better take into account societal issues such as welfare and beyond.

Conformation of di-n-propylglycine residues (Dpg) in peptides: crystal structures of a type I 'beta-turn forming tetrapeptide and an alpha-helical tetradecapeptide

The crystal structures of two oligopeptides containing di-n-propylglycine (Dpg) residues, Boc-Gly-Dpg-Gly-Leu-OMe (1) and Boc-Val-Ala-Leu-Dpg-Val-Ala-Leu-Val-Ala-Leu-Dpg-Val-Ala-Leu-OMe (2) are presented. Peptide 1 adopts a type I' beta-turn conformation with Dpg(2)-Gly(3) at the corner positions. The 14-residue peptide 2 crystallizes with two molecules in the asymmetric unit, both of which adopt alpha-helical conformations stabilized by 11 successive 5 -> 1 hydrogen bonds. In addition, a single 4 -> 1 hydrogen bond is also observed at the N-terminus. All live Dpg residues adopt backbone torsion angles (phi, psi) in the helical region of conformational space. Evaluation of the available structural data on Dpg peptides confirm the correlation between backbone bond angle N-C-alpha-C' (tau) and the observed backbone phi,psi values. For tau > 106 degrees, helices are observed, while fully extended structures are characterized by tau < 106 degrees. The mean r values for extended and folded conformations for the Dpg residue are 103.6 degrees +/- 1.7 degrees and 109.9 degrees +/- 2.6 degrees, respectively. Copyright (C) 2007 European Peptide Society and John Wiley & Sons, Ltd.

Energetics of carbohydrate binding by a 14 kDa S-type mammalian lectin

The thermodynamics of the binding of derivatives of galactose and lactose to a 14 kDa beta-galactoside-binding lectin (L-14) from sheep spleen has been studied in 10 nM phosphate/150 mM NaCl/10 mM beta-mercaptoethanol buffer, pH 7.4, and in the temperature range 285-300 K using titration calorimetry. The single-site binding constants of various sugars for the lectin were in the following order: N-acetyl-lactosamine thiodigalactoside > 4-methylumbelliferyl lactoside > lactose > 4-methylumbelliferyl alpha-D-galactoside > methyl-alpha-galactose > methyl-beta-galactose. Reactions were essentially enthalpically driven with the binding enthalpies ranging from -53.8 kJ/mol for thiodigalactoside at 301 K to -2.2 kJ/mol for galactose at 300 K, indicating that hydrogen-bonding and van der Waals interactions provide the major stabilization for these reactions. However, the binding of 4-methylumbelliferyl-alpha-D-galactose displays relatively favourable entropic contributions, indicating the existence of a non-polar site adjacent to the galactose-binding subsite. From the increments in the enthalpies for the binding of lactose, N-acetyl-lactosamine and thiodigalactoside relative to methyl-beta-galactose, the contribution of glucose binding in the subsite adjacent to that for galactose shows that glucose makes a major contribution to the stability of L-14 disaccharide complexes. Observation of enthalpy-entropy compensation for the recognition of saccharides such as lactose by L-14 and the absence of it for monosaccharides such as galactose, together with the lack of appreciable changes in the heat capacity (delta Cp), indicate that reorganization of water plays an important role in these reactions.