Reinforcement Learning With Function Approximation for Traffic Signal Control

We propose, for the first time, a reinforcement learning (RL) algorithm with function approximation for traffic signal control. Our algorithm incorporates state-action features and is easily implementable in high-dimensional settings. Prior work, e. g., the work of Abdulhai et al., on the application of RL to traffic signal control requires full-state representations and cannot be implemented, even in moderate-sized road networks, because the computational complexity exponentially grows in the numbers of lanes and junctions. We tackle this problem of the curse of dimensionality by effectively using feature-based state representations that use a broad characterization of the level of congestion as low, medium, or high. One advantage of our algorithm is that, unlike prior work based on RL, it does not require precise information on queue lengths and elapsed times at each lane but instead works with the aforementioned described features. The number of features that our algorithm requires is linear to the number of signaled lanes, thereby leading to several orders of magnitude reduction in the computational complexity. We perform implementations of our algorithm on various settings and show performance comparisons with other algorithms in the literature, including the works of Abdulhai et al. and Cools et al., as well as the fixed-timing and the longest queue algorithms. For comparison, we also develop an RL algorithm that uses full-state representation and incorporates prioritization of traffic, unlike the work of Abdulhai et al. We observe that our algorithm outperforms all the other algorithms on all the road network settings that we consider.

Acyclic Edge-Coloring of Planar Graphs

A proper edge-coloring with the property that every cycle contains edges of at least three distinct colors is called an acyclic edge-coloring. The acyclic chromatic index of a graph G, denoted. chi'(alpha)(G), is the minimum k such that G admits an acyclic edge-coloring with k colors. We conjecture that if G is planar and Delta(G) is large enough, then chi'(alpha) (G) = Delta (G). We settle this conjecture for planar graphs with girth at least 5. We also show that chi'(alpha) (G) <= Delta (G) + 12 for all planar G, which improves a previous result by Fiedorowicz, Haluszczak, and Narayan Inform. Process. Lett., 108 (2008), pp. 412-417].

Characterization of recombinant diaminopropionate ammonia-lyase from Escherichia coli and Salmonella typhimurium

Diaminopropionate ammonia-lyase gene from Escherichia coli and Salmonella typhimurium was cloned and the overexpressed enzymes were purified to homogeneity. The k(cat) Values, determined for the recombinant enzymes with DL-DAP, D-serine, and L-serine as substrates, showed that the enzyme from S. typhimurium was more active than that from E coli and the K-m values were found to be similar. The purified enzymes had an absorption maximum (lambda(max)) at 412 nm, typical of PLP dependent enzymes. A red shift in lambda(max) was observed immediately after the addition Of 10 MM DL-DAP, which returned to the original lambda(max) of 412 nm in about 4 min. This red shift might reflect the formation of an external aldimine and/or other transient intermediates of the reaction. The apoenzyme of E coli and S. typhimurium prepared by treatment With L-cysteine could be partially (60%) reconstituted by the addition of PLP. The holo, apo, and the reconstituted enzymes were shown to be present as homo dimers by size exclusion chromatography. (C) 2003 Elsevier Science (USA). All rights reserved.

Antigen detection assay with parasite specific monoclonal antibodies for diagnosis of lymphatic filariasis

Background: Lymphatic filariasis is a painful and profoundly disfiguring disease. Infection is usually acquired in childhood but its visible manifestations occur later in life, causing temporary or permanent disability. The importance of developing effective assays to diagnose, monitor and evaluate human lymphatic filariasis has been emphasized by the WHO. Methods: High-affinity monoclonal antibodies (mAbs) specific for recombinant filarial antigen WbSXP-1 were developed. An ELISA based capture assay using monoclonal and polyclonal antibodies for WbSXP-1 was used for detection of circulating filarial antigen. Results: High-affinity monoclonal antibodies (mAbs) were developed that specifically binds both W. bancrofti and B. malayi mf antigens. Two mAbs (1F6H3 and 2E12E3) of subclass IgG2a and IgM showed high affinity, avidity and reactivity to recombinant and mf native antigen. Both the mAbs were used in combination as capture antibodies and polyclonal as detection antibody to develop the assay. The assay showed very high sensitivity towards W. bancrofti mf positive samples compared to endemic normal samples (P<0.0001). Conclusion: A capture assay using high-affinity monoclonal antibodies for WbSXP-1 was developed for the detection of filarial circulating antigen in clinical samples from bancroftian infection. Besides, this would also help in epidemiological studies in endemic areas of filarial infections. (C) 2011 Elsevier B.V. All rights reserved.

Beta-structure of polypeptides in non-aqueous solutions. I. Spectral characteristics of the polypeptide backbone

The optical rotatory features of the beta-structure of the polypeptides in non-aqueous solutions and films cast from these solutions have been investigated. The beta-structure of poly-S-benzyl-L-cysteine, poly-S-carbobenzoxy-L-cysteine and poly-S-benzyl-L-cysteine, poly-S-carbobenzoxy-L-cysteine and poly-O-carbo-bands of their films. The optical rotatory dispersion (ORD) and circular dichroism (CD) spectra of these polypeptides are found to be very similar in both film and solution. In solvents promoting the beta-structure, the polypeptides are characterized by CD troughs in the n-pi* transition region of the peptide chromophore. The ORD spectra are found to be positive in sign throughout the visible and accessible ultraviolet regions and are interpreted in terms of the possible existence of a relatively much larger positive pi-pi* CD bands as compared with the negative n-pi* band. The rotatory data obtained in the non-aqueous solution are compared with those obtained for other poly peptides in aqueous solutions, with respect to the type and extent of beta-structure present.

Unique Utilization of a Phosphoprotein Phosphatase Fold by a Mammalian Phosphodiesterase Associated with WAGR Syndrome

Metallophosphoesterase-domain-containing protein 2 (MPPED2) is a highly evolutionarily conserved protein with orthologs found from worms to humans. The human MPPED2 gene is found in a region of chromosome 11 that is deleted in patients with WAGR (Wilms tumor, aniridia, genitourinary anomalies, and mental retardation) syndrome, and MPPED2 may function as a tumor suppressor. However, the precise cellular roles of MPPED2 are unknown, and its low phosphodiesterase activity suggests that substrate hydrolysis may not be its prime function. We present here the structures of MPPED2 and two mutants, which show that the poor activity of MPPED2 is not only a consequence of the substitution of an active-site histidine residue by glycine but also due to binding of AMP or GMP to the active site. This feature, enhanced by structural elements of the protein, allows MPPED2 to utilize the conserved phosphoprotein-phosphatase-like fold in a unique manner, ensuring that its enzymatic activity can be combined with a possible role as a scaffolding or adaptor protein. (C) 2011 Elsevier Ltd. All rights reserved.

Analysis of light‐induced processes in bacteriorhodopsin and its application for spatial light modulation

A simplified energy‐level scheme is proposed for the photochemical cycle of the bacteriorhodopsin molecule. Rate equations are solved for the detailed light‐induced processes based on this model and the intensity‐induced population densities in various states of the molecule at steady state are computed which are used to obtain an analytic expression for the absorption coefficient of the modulation beam. Modulation of the probe laser‐beam transmission by the modulation‐laser‐beam intensity‐induced population changes is analyzed. It is predicted that for a probe beam at 412 nm up to 82% modulation can be achieved using a laser beam intensity of 3.2 W/cm2 at 570 nm. For temperatures ∼77 K, the transmission at 610 nm can be switched from zero to 81% for modulating laser intensity of 11 W/cm2. Construction of a spatial light modulator based on bacteriorhodopsin molecules is proposed and some of its features are discussed.

A novel free floating accelerometer force balance system for shock tunnel applications

In order to overcome the interference of the model mounting system with the external aerodynamics of the body during shock tunnel testing, a new free floating internally mountable balance system that ensures unrestrained model motion during testing has been designed, fabricated and tested. Minimal friction ball bearings are used for ensuring the free floating condition of the model during tunnel testing. The drag force acting on a blunt leading edge flat plate at hypersonic Mach number has been measured using the new balance system. Finite element model (FEM) and CFD are exhaustively used in the design as well as for calibrating the new balance system. The experimentally measured drag force on the blunt leading edge flat plate at stagnation enthalpy of 0.7 and 1.2 MJ/kg and nominal Mach number of 5.75 matches well with FEM results. The concept can also be extended for measuring all the three fundamental aerodynamic forces in short duration test facilities like free piston driven shock tunnels.

Ribosome-RNA interaction: a potential target for developing antiviral against hepatitis C virus

Hepatitis C virus (HCV), a member of Flaviviridae, encoding a positive-sense single-stranded RNA translates by cap-independent mechanism using the internal ribosome entry site (IRES) present in the 5' UTR of the virus. The IRES has complex stem loop structures and is capable of recruiting the 40S ribosomal subunit in a factor-independent fashion. As the IRES sequence is highly conserved throughout the HCV genotypes and the translation is the first obligatory step of the HCV life cycle, the IRE'S-mediated translation, or more specifically, the ribosome HCV RNA interaction is an attractive target to design effective antivirals. This article will focus on the mechanism of the HCV IRES translation and the various ways in which the interaction of ribosome and IRES has been targeted.

Characterisation of microstructure and evaluation of optical and EPR properties of superhydrophobic copper dodecanoate films

Copper dodecanoate films prepared by emulsion method exhibit superhydrophobic property with water contact angle of 155 degrees and sliding angle of <2 degrees. The films have been characterised by using X-ray diffraction, field emission scanning electron microscopy and Fourier transform infrared spectroscopy techniques. Surface microstructure of copper dodecanoate consists of numerous microscale papillas of about 6-12 mu m in length with a diameter in the range of 360-700 nm. The superhydrophobicity of the films is due to their dual micronano surface morphology. The wetting behaviour of the film surface was studied by a simple water immersion test. The results show that copper dodecanoate film retained superhydrophobic property even after immersing in water for about 140 h. The optical absorption spectrum exhibits two broadbands centred at 388 and 630 nm that have been assigned to B-2(1g) -> E-2(g) and B-2(1g) -> B-2(2g) transitions of Cu2+ ions, respectively. The electron paramagnetic resonance spectrum exhibits two resonance signals with effective g values at g(parallel to)approximate to 2.308 and g(perpendicular to) approximate to 2.071, which suggests that the unpaired electron occupies d(x2-y2) orbital in the ground state. Copyright (C) 2011 John Wiley & Sons, Ltd.

Microstructure and dry sliding wear resistance evaluation of plasma nitrided austenitic stainless steel type AISI 316LN against different sliders

In this work, Plasma Nitriding was carried out at a temperature of 570 degrees C on nuclear grade austenitic stainless steel type AISI 316 LN (316LN SS) in a gas mixture of 20% N-2-80% H-2 to improve the surface hardness and thereby sliding wear resistance. The Plasma Nitride (PN) treated surface has been characterized by Vickers microhardness measurements, Scanning Electron Microscopic (SEM) examination, X-ray Diffraction (XRD) and sliding wear assessment. The average thickness of the PN layer was found to be 70 mu m. Microhardness measurements showed a significant increase in the hardness from 210 HV25g (unnitrided sample) to 1040 HV25g (Plasma Nitrided sample). The XRD reveals that PN layer consists of CrN, Fe4N and Fe3N phases along with austenite phase. The tribological parameters such as the friction coefficient and wear mechanism have been evaluated at ambient conditions for PN treated ring (PN ring) vs. ASTM A453 grade 660 pin (ASTM pin), PN ring vs. Nickel based alloy hard faced pin (Colmonoy pin), PN ring vs. 316LN SS pin and 316LN SS ring vs. 316LN SS pin. The wear tracks have been analyzed by SEM, Energy Dispersive X-ray Analysis (EDX) and Optical Profilometry. The untreated 316LN SS ring vs. 316LN SS pin produced severe wear and was characterized by a combination of delamination and adhesion wear mechanism, whereas wear mechanism of the PN rings reveals mild abrasion and a transfer layer from pin materials. (C) 2012 Elsevier B.V. All rights reserved.

Substrate impact on the growth of InN nanostructures by droplet epitaxy

The substrate effect on InN nanostructures grown by droplet epitaxy has been studied. InN nanostructures were fabricated on Si(111), silicon nitride/Si(111), AlN/Si(111) and Ge(100) substrates by droplet epitaxy using an RF plasma nitrogen source. The morphologies of InN nanostructures were investigated by field emission scanning electron microscopy (FESEM). The chemical bonding configurations of InN nanostructures were examined by x-ray photoelectron spectroscopy (XPS). Photoluminescence spectrum slightly blue shifted compared to the bulk InN, indicating a strong Burstein-Moss effect due to the presence of high electron concentration in the InN dots.

Phylogenetic relationships and classification of thiolases and thiolase-like proteins of Mycobacterium tuberculosis and Mycobacterium smegmatis

Thiolases are enzymes involved in lipid metabolism. Thiolases remove the acetyl-CoA moiety from 3-ketoacyl-CoAs in the degradative reaction. They can also catalyze the reverse Claisen condensation reaction, which is the first step of biosynthetic processes such as the biosynthesis of sterols and ketone bodies. In human, six distinct thiolases have been identified. Each of these thiolases is different from the other with respect to sequence, oligomeric state, substrate specificity and subcellular localization. Four sequence fingerprints, identifying catalytic loops of thiolases, have been described. In this study genome searches of two mycobacterial species (Mycobacterium tuberculosis and Mycobacterium smegmatis), were carried out, using the six human thiolase sequences as queries. Eight and thirteen different thiolase sequences were identified in M. tuberculosis and M. smegmatis, respectively. In addition, thiolase-like proteins (one encoded in the Mtb and two in the Msm genome) were found. The purpose of this study is to classify these mostly uncharacterized thiolases and thiolase-like proteins. Several other sequences obtained by searches of genome databases of bacteria, mammals and the parasitic protist family of the Trypanosomatidae were included in the analysis. Thiolase-like proteins were also found in the trypanosomatid genomes, but not in those of mammals. In order to study the phylogenetic relationships at a high confidence level, additional thiolase sequences were included such that a total of 130 thiolases and thiolase-like protein sequences were used for the multiple sequence alignment. The resulting phylogenetic tree identifies 12 classes of sequences, each possessing a characteristic set of sequence fingerprints for the catalytic loops. From this analysis it is now possible to assign the mycobacterial thiolases to corresponding homologues in other kingdoms of life. The results of this bioinformatics analysis also show interesting differences between the distributions of M. tuberculosis and M. smegmatis thiolases over the 12 different classes. (C) 2014 Elsevier Ltd. All rights reserved.

Dense shallow granular flows

Simplified equations are derived for a granular flow in the `dense' limit where the volume fraction is close to that for dynamical arrest, and the `shallow' limit where the stream-wise length for flow development (L) is large compared with the cross-stream height (h). The mass and diameter of the particles are set equal to 1 in the analysis without loss of generality. In the dense limit, the equations are simplified by taking advantage of the power-law divergence of the pair distribution function chi proportional to (phi(ad) - phi)(-alpha), and a faster divergence of the derivativ rho(d chi/d rho) similar to (d chi/d phi), where rho and phi are the density and volume fraction, and phi(ad) is the volume fraction for arrested dynamics. When the height h is much larger than the conduction length, the energy equation reduces to an algebraic balance between the rates of production and dissipation of energy, and the stress is proportional to the square of the strain rate (Bagnold law). In the shallow limit, the stress reduces to a simplified Bagnold stress, where all components of the stress are proportional to (partial derivative u(x)/partial derivative y)(2), which is the cross-stream (y) derivative of the stream-wise (x) velocity. In the simplified equations for dense shallow flows, the inertial terms are neglected in the y momentum equation in the shallow limit because the are O(h/L) smaller than the divergence of the stress. The resulting model contains two equations, a mass conservation equations which reduces to a solenoidal condition on the velocity in the incompressible limit, and a stream-wise momentum equation which contains just one parameter B which is a combination of the Bagnold coefficients and their derivatives with respect to volume fraction. The leading-order dense shallow flow equations, as well as the first correction due to density variations, are analysed for two representative flows. The first is the development from a plug flow to a fully developed Bagnold profile for the flow down an inclined plane. The analysis shows that the flow development length is ((rho) over barh(3)/B) , where (rho) over bar is the mean density, and this length is numerically estimated from previous simulation results. The second example is the development of the boundary layer at the base of the flow when a plug flow (with a slip condition at the base) encounters a rough base, in the limit where the momentum boundary layer thickness is small compared with the flow height. Analytical solutions can be found only when the stream-wise velocity far from the surface varies as x(F), where x is the stream-wise distance from the start of the rough base and F is an exponent. The boundary layer thickness increases as (l(2)x)(1/3) for all values of F, where the length scale l = root 2B/(rho) over bar. The analysis reveals important differences between granular flows and the flows of Newtonian fluids. The Reynolds number (ratio of inertial and viscous terms) turns out to depend only on the layer height and Bagnold coefficients, and is independent of the flow velocity, because both the inertial terms in the conservation equations and the divergence of the stress depend on the square of the velocity/velocity gradients. The compressibility number (ratio of the variation in volume fraction and mean volume fraction) is independent of the flow velocity and layer height, and depends only on the volume fraction and Bagnold coefficients.