New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

Providing QoS to Real and Data Applications in WiMAX Mesh Networks

We consider the problem of centralized routing and scheduling for IEEE 802.16 mesh networks so as to provide Quality of Service (QoS) to individual real and interactive data applications. We first obtain an optimal and fair routing and scheduling policy for aggregate demands for different source- destination pairs. We then present scheduling algorithms which provide per flow QoS guarantees while utilizing the network resources efficiently. Our algorithms are also scalable: they do not require per flow processing and queueing and the computational requirements are modest. We have verified our algorithms via extensive simulations.

Micro-treatment options for components of organic fraction of MSW in residential areas

There is a growing interest in management of MSW through micro-treatment of organic fraction of municipal solid wastes (OFMSW) in many cities of India. The OFMSW fraction is high (> 80%) in many pockets within South Indian cities like Bangalore, Chikkamagalur, etc. and is largely represented by vegetable, fruit, packing and garden wastes. Among these, the last three have shown problems for easy decomposition. Fruit wastes are characterized by a large pectin supported fraction that decomposes quickly to organic acids (becomes pulpy) that eventually slow down anaerobic and aerobic decomposition processes. Paper fraction (newsprint and photocopying paper) as well as paddy straw (packing), bagasse (from cane juice stalls) and tree leaf litter (typical garden waste and street sweepings) are found in reasonably large proportions in MSW. These decompose slowly due to poor nutrients or physical state. We have examined the suitability of these substrates for micro-composting in plastic bins by tracking decomposition pattern and physical changes. It was found that fruit wastes decompose rapidly to produce organic acids and large leachate fraction such that it may need to be mixed with leachate absorbing materials (dry wastes) for good composting. Leaf litter, paddy straw and bagasse decompose to the tune of 90, 68 and 60% VS and are suitable for composting micro-treatment. Paper fractions even when augmented with 10% leaf compost failed to show appreciable decomposition in 50 days. All these feedstocks were found to have good biological methane potential (BMP) and showed promise for conversion to biogas under a mixed feed operation. Suitability of this approach was verified by operating a plug-flow type anaerobic digester where only leaf litter gathered nearby (as street sweepings) was used as feedstock. Here only a third of the BMP was realized at this scale (0.18 m(3) biogas/kg VS 0.55 m(3)/kg in BMP). We conclude that anaerobic digestion in plug-flow like digesters appear a more suitable micro-treatment option (2-10 kg VS/day) because in addition to compost it also produces biogas for domestic use nearby.

Ethyl 6-chloro-2-[(2-chloro-7,8-dimethylquinolin-3-yl)methoxy]-4-phenylquino line-3-carboxylate

In the title compound, C30H24Cl2N2O3, the two quinoline ring systems are almost planar [maximum deviations = 0.029 (2) and 0.018 (3) angstrom] and the dihedral angle between them is 4.17 (8)degrees. The dihedral angle between the phenyl ring and its attached quinoline ring is 69.06 (13)degrees. The packing is stabilized by C-H center dot center dot center dot O, C-H center dot center dot center dot N, weak pi-pi stacking [centroid-centroid distances = 3.7985 (16) and 3.7662(17) angstrom] and C-H center dot center dot center dot pi interactions.

1-[(2-Chloro-7,8-dimethylquinolin-3-yl)methyl]pyridin-2(1H)-one

In the title compound, C17H15ClN2O, the quinoline ring system is nearly planar, with a maximum deviation from the mean plane of 0.074 (2) angstrom, and makes a dihedral angle of 81.03 (7)degrees with the pyridone ring. The crystal packing is stabilized by pi-pi stacking interactions between the pyridone and benzene rings of the quinoline ring system [centroid-centroid distance = 3.6754 (10) angstrom]. Furthermore, weak intermolecular C-H center dot center dot center dot O hydrogen bonding links molecules into supramolecular chains along [001].

Aggregation studies in crystals of apolar helical peptides: Boc-Aib-Val-Ala-Leu-Aib-Val-Ala-Leu-Aib-OMe

In the crystal, the backbone of Boc-(Aib-Val-Ala-Leu)2-Aib-OMe adopts a helical form with four alpha-type hydrogen bonds in the middle, flanked by 3(10)-type hydrogen bonds at either end. The helical molecules stack in columns with head-to-tail hydrogen bonds, either directly between NH and CO, or bridged by solvent molecules. The packing of the helices is parallel, even in space group P2(1). Cell parameters are a = 9.837(2) A, b = 15.565(3) A, c = 20.087(5) A, beta = 96.42(2) degrees, dcalc = 1.091 g/cm3 for C46H83N9O12.1.5H2O.0.67CH3OH. There appears to be some hydration of the backbone in this apolar helix.

Parallel and antiparallel aggregation of alpha-helices. Crystal structures of two apolar decapeptides X-Trp-Ile-Ala-Aib-Ile-Val-Aib-Leu-Aib-Pro-OMe (X = Boc, Ac)

An apolar helical decapeptide with different end groups, Boc- or Ac-, crystallizes in a completely parallel fashion for the Boc-analog and in an antiparallel fashion for the Ac-analog. In both crystals, the packing motif consists of rows of parallel molecules. In the Boc-crystals, adjacent rows assemble with the helix axes pointed in the same direction. In the Ac-crystals, adjacent rows assemble with the helix axes pointed in opposite directions. The conformations of the molecules in both crystals are quite similar, predominantly alpha-helical, except for the tryptophanyl side chain where chi 1 congruent to 60 degrees in the Boc- analog and congruent to 180 degrees in the Ac-analog. As a result, there is one lateral hydrogen bond between helices, N(1 epsilon)...O(7), in the Ac-analog. The structures do not provide a ready rationalization of packing preference in terms of side-chain interactions and do not support a major role for helix dipole interactions in determining helix orientation in crystals. The crystal parameters are as follow. Boc-analog: C60H97N11O13.C3H7OH, space group Pl with a = 10.250(3) A, b = 12.451(4) A, c = 15.077(6) A, alpha = 96.55(3) degrees, beta = 92.31(3) degrees, gamma = 106.37(3) degrees, Z = 1, R = 5.5% for 5581 data ([F] greater than 3.0 sigma(F)), resolution 0.89 A. Ac-analog: C57H91N11O12, space group P2(1) with a = 9.965(1) A, b = 19.707(3) A, c = 16.648(3) A, beta = 94.08(1), Z = 2, R = 7.2% for 2530 data ([F] greater than 3.0 sigma(F)), resolution 1.00 A.

Modular design of synthetic protein mimics. Crystal structures, assembly, and hydration of two 15- and 16-residue apolar, leucyl-rich helical peptides

Two IS- and 16-residue peptides containing a-aminoisobutyric acid (Aib) have been synthesized, as part of a strategy to construct stereochemically rigid peptide helices, in a modular approach to design of protein mimics. The peptides Boc-(Val-Ala-Leu-Aib),-OMe ( I ) and Boc-Val-Ala-Leu-Aib-Val-Ala-Leu-(Val-Ala-Leu-Aib()11z)- OhaMvee been crystallized.Both crystals are stable only in the presence of mother liquor or water. The crystal data are as follows. I: C78H140N16019~2H20,P2,, a = 16.391 (3) A, b = 16.860 (3) A, c = 18.428 (3) A, p = 103.02 (I)O, Z = 2, R = 9.6% for 3445 data with lFol >30(F), resolution 0.93 A. 11: C7,Hl,,N,S018.7.5H,0, C2221, a = 18.348 ( 5 ) A, b = 47.382 (1 1) A, c = 24.157 ( 5 ) A, Z =8, R = l0,6%, for 3147 data with lFol > 3a(F), resolution 1.00 A. The 15-residue peptide (11) is entirely a helical, while the 16-residue peptide ( I ) has a short segment of 310 helix at the N terminus. The packing of the helices in the crystals is rather incfficicnt with no particular attractions between Leu-Leu side chains, or any other pair. Both crystals have fairly large voids, which are filled with water molecules in a disordered fashion. Water molecule sites near the polar head-to-tail regions are well detcrmined, those closer to the hydrophobic side chains less so and a number of possible water sites in the remaining "empty" space are not determined. No interdigitation of Leu side chains is observed in the crystal as is hypothesized in the "leucine zipper" class of DNA binding proteins.

A combined extended and helical backbone for Boc-(Ala-Leu-Ac(7)c-)(2)-OMe

The structure of the peptide Boc-Ala-Leu-Ac(7)c-Ala-Leu-Ac(7)c-OMe (Ac(7)c,1-aminocycloheptane-1-carboxylic acid) is described in crystals. The presence of two Ac(7)c residues was expected to stabilize a 3(10)-helical fold. Contrary to expectation the structural analysis revealed an unfolded amino terminus, with Ala(1) adopting an extended beta-conformation (phi = -93degrees,psi = 112degrees). Residues 2-5 form a 3(10)-helix, stabilized by three successive intramolecular hydrogen bonds. Notably, two NH groups Ala(1) and Ac(7)c(3) do not form any hydrogen bonds in the crystal. Peptide assembly appears to be dominated by packing of the cycloheptane rings that stack against one another within the molecule and also throughout the crystal in columns.

Study of gas cavity size hysteresis in a packed bed using DEM

When a high velocity gas jet is introduced into a packed bed a cavity is formed. The size of the cavity shows hysteresis on increasing and decreasing gas flow rates. This hysteresis leads to different cavity sizes at same gas flow rate depending on the bed history. The size of cavity affects the gas flow profiles in the packed bed. In this study the cavity size hysteresis phenomenon has been modeled using discrete element method along with turbulent gas flow. A reasonable agreement has been found between computed and experimental results on cavity size ysteresis. The effect of various parameters, such as nozzle height from the bed bottom and packing height, on the cavity size hysteresis has been studied. It is found that inter-particle interaction forces along with gas drag and bed porosity play an important role in describing the cavity size hysteresis. The injection of gas flow allows the particles to go to an unconstrained state than they were previously in, and their ability to remain in that state, even under decreased gas drag force, leads to the phenomenon of cavity size hysteresis. (c) 2007 Elsevier Ltd. All rights reserved.

1-[2,4,6-Trimethyl-3,5-bis(4-oxopiperidin ylmethyl) benzyl ]piperidin- 4-one

In the structure of the title compound, C27H39N3O3, each of the (4-oxopiperidin-1-yl)methyl residues adopts a flattened chair conformation (with the N and carbonyl groups being oriented to either,side of the central C-4 plane) and they occupy positions approximatelym orthogonal to the central benzene ring [C-benzene-C-C-methylene-N torsion angles 103.4 (2), -104.4 (3) and 71.9 (3)degrees]; further, two of these residues are oriented to one side of the central benzene ring with the third to the other side. In the crystal packing, supramolecular layers in the ab plane are sustained by C-H center dotcenter dot center dot O interactions.

2-Chloro-8-methyl-3-[(pyrimidin-4-yloxy)methyl]quinoline

In the title compound, C15H12ClN3O, the quinoline ring system is essentially planar, with a maximum deviation of 0.017 (1) angstrom. The crystal packing is stabilized by pi-pi stacking interactions between the quinoline rings of adjacent molecule, with a centroid-centroid distance of 3.5913 (8) angstrom. Aweak C-H center dot center dot center dot pi contact is also observed between molecules.

Analysis of multiple crystal forms of Bacillus subtilis BacB suggests a role for a metal ion as a nucleant for crystallization

Bacillus subtilis BacB is an oxidase that is involved in the production of the antibiotic bacilysin. This protein contains two double-stranded beta-helix (cupin) domains fused in a compact arrangement. BacB crystallizes in three crystal forms under similar crystallization conditions. An interesting observation was that a slight perturbation of the crystallization droplet resulted in the nucleation of a different crystal form. An X-ray absorption scan of BacB suggested the presence of cobalt and iron in the crystal. Here, a comparative analysis of the different crystal forms of BacB is presented in an effort to identify the basis for the different lattices. It is noted that metal ions mediating interactions across the asymmetric unit dominate the different packing arrangements. Furthermore, a normalized B-factor analysis of all the crystal structures suggests that the solvent-exposed metal ions decrease the flexibility of a loop segment, perhaps influencing the choice of crystal form. The residues coordinating the surface metal ion are similar in the triclinic and monoclinic crystal forms. The coordinating ligands for the corresponding metal ion in the tetragonal crystal form are different, leading to a tighter packing arrangement. Although BacB is a monomer in solution, a dimer of BacB serves as a template on which higher order symmetrical arrangements are formed. The different crystal forms of BacB thus provide experimental evidence for metal-ion-mediated lattice formation and crystal packing.

Long-range synthon Aufbau modules (LSAM) in crystal structures: systematic changes in C6H6-nFn (0 <= n <= 6) fluorobenzenes

We discuss the assembly of a three-dimensional molecular crystal in terms of short-range supramolecular synthons that spontaneously organize themselves according to Aufbau principles into long-range geometries characteristic of the molecules themselves. For this purpose we have examined the systematic changes in the known crystal structures of a family of fluorobenzenes, C6H6-nFn, where 0 <= n <= 6. Crystal assembly is initiated by forming long-range synthon Aufbau modules (LSAM) that carry the imprint of the synthons. For example, when 1 <= n <= 5 the short-range synthons use H center dot center dot center dot F interactions to form the LSAMs. In the n = 0 and n = 6 compounds, the synthons are H center dot center dot center dot C and F center dot center dot center dot C interactions, respectively. The LSAMs are usually one-dimensional. In this study we show that these 1D LSAMs assemble into 2D quasi-hexagonal close-packed layers. The 3D crystal structure is obtained from the various kinds of close-packing known for these 2D layers. The final stages of this 1D -> 2D -> 3D assembly seem to be more influenced by the packing of LSAMs than by any other factor. In these final stages, there may not be so much influence exerted by the stronger short-range synthons. We discuss the evolution of these fluorobenzene crystal structures in terms of putative LSAMs and the purely geometric relationships between the n and (6 - n) compounds that can thus be expected. Such particle-hole pairs show structural similarities. Our discussion is quantified by the interpretation of intermolecular distances in terms of atomic sizes and with qualitative predictions of magnetic model systems.

Long-range synthon Aufbau modules (LSAM) in crystal structures: systematic changes in C6H6-nFn (0 <= n <= 6) fluorobenzenes

We discuss the assembly of a three-dimensional molecular crystal in terms of short-range supramolecular synthons that spontaneously organize themselves according to Aufbau principles into long-range geometries characteristic of the molecules themselves. For this purpose we have examined the systematic changes in the known crystal structures of a family of fluorobenzenes, C6H6-nFn, where 0 <= n <= 6. Crystal assembly is initiated by forming long-range synthon Aufbau modules (LSAM) that carry the imprint of the synthons. For example, when 1 <= n <= 5 the short-range synthons use H center dot center dot center dot F interactions to form the LSAMs. In the n = 0 and n = 6 compounds, the synthons are H center dot center dot center dot C and F center dot center dot center dot C interactions, respectively. The LSAMs are usually one-dimensional. In this study we show that these 1D LSAMs assemble into 2D quasi-hexagonal close-packed layers. The 3D crystal structure is obtained from the various kinds of close-packing known for these 2D layers. The final stages of this 1D -> 2D -> 3D assembly seem to be more influenced by the packing of LSAMs than by any other factor. In these final stages, there may not be so much influence exerted by the stronger short-range synthons. We discuss the evolution of these fluorobenzene crystal structures in terms of putative LSAMs and the purely geometric relationships between the n and (6 - n) compounds that can thus be expected. Such particle-hole pairs show structural similarities. Our discussion is quantified by the interpretation of intermolecular distances in terms of atomic sizes and with qualitative predictions of magnetic model systems.