An Online Actor-Critic Algorithm with Function Approximation for Constrained Markov Decision Processes

We develop an online actor-critic reinforcement learning algorithm with function approximation for a problem of control under inequality constraints. We consider the long-run average cost Markov decision process (MDP) framework in which both the objective and the constraint functions are suitable policy-dependent long-run averages of certain sample path functions. The Lagrange multiplier method is used to handle the inequality constraints. We prove the asymptotic almost sure convergence of our algorithm to a locally optimal solution. We also provide the results of numerical experiments on a problem of routing in a multi-stage queueing network with constraints on long-run average queue lengths. We observe that our algorithm exhibits good performance on this setting and converges to a feasible point.

Synthesis and an Evaluation of Molecular Conformation and Crystal Packing in Two Substituted 4-Phenylquinolines

The title compounds, namely Methyl 2-methyl-4 -phenylquinoline-3-carboxylate (I), C18H15NO2, and (2E)-3-(3,4-dimethoxyphenyl)-1-(2-methyl-4 -phenylquinolin-3-yl)prop-2-en-1-one (II), C27H23NO3, comprising of the phenyl ring, exhibit differences in conformational behaviour with respect to the plane of the quinoline fragment. (I) contains the methyl ester moiety whereas (II) contains the chalcone fragment, consisting of a double bond and phenyl group containing dimethoxy groups as substituents. The dihedral angles between the phenyl group and the quinoline ring is 82.77 (7)A degrees in (I), and 79.02 (8)A degrees in (II) respectively. It is the weak C-H center dot center dot center dot O=C H-bond and C-H center dot center dot center dot pi interactions which dictate packing of molecules in (I). In (II), it is C-H center dot center dot center dot N and C-H center dot center dot center dot pi, involving the dimethoxy ring, which controls packing of molecules in the crystal lattice. In addition, pi center dot center dot center dot pi aromatic stacking interactions involving the quinoline fragment is present in all the molecules. The title compounds, namely methyl-2-methyl-4 -phenylquinoline-3-carboxylate (I), C18H15NO2, and (2E)-3-(3,4-dimethoxyphenyl)-1-(2-methyl-4 -phenylquinolin-3-yl)prop-2-en-1-one (II), C27H23NO3, comprising of the phenyl ring, exhibit differences in conformational behaviour with respect to the plane of the quinoline fragment. (I) contains the methyl ester moiety whereas (III) contains the chalcone fragment, consisting of a double bond and phenyl group containing dimethoxy groups as substituents. The dihedral angles between the phenyl group and the quinoline ring is 82.77 (7)A degrees in (I), and 79.02 (8)A degrees in (II) respectively. It is the weak C-H center dot center dot center dot O=C H-bond and C-H center dot center dot center dot pi interactions which dictate packing of molecules in (I). In (II), it is C-H center dot center dot center dot N and C-H center dot center dot center dot pi, involving the dimethoxy ring, which controls packing of molecules in the crystal lattice. In addition, pi center dot center dot center dot pi aromatic stacking interactions involving the quinoline fragment is present in all the molecules.

Electrical Resistance and Seebeck Coefficient in PbTe Nanowires

We address a physics-based simplified analytical formulation of the diffusive electrical resistance ( (Omega)) and Seebeck coefficient () in a PbTe nanowire dominated by acoustic phonon scattering under the presence of a low static longitudinal electric field. The use of a second-order nonparabolic electron energy band structure involving a geometry-dependent band gap has been selected in principle to demonstrate that the electron mean free path (MFP) in such a system can reach as low as about 8 nm at room temperature for a 10-nm-wide PbTe nanowire. This is followed by the formulation of the carrier back-scattering coefficient for determination of (Omega) and as functions of wire dimensions, temperature, and the field, respectively. The present analytical formulation agrees well with the available experimental data and may find extensive use in determination of various electrothermal transport phenomena in PbTe-based one-dimensional electron devices.

Lead ion sensor with electrodes modified by imidazole-functionalized polyaniline

Glassy carbon electrodes (GCE) and carbon paste electrodes (CPE) were modified with imidazole functionalized polyaniline with the aim to develop a sensor for lead (II) in both acidic and basic aqueous solution. The electrodes were characterized by cyclic voltammetry and differential pulse adsorptive stripping voltammetry. The limit of detections obtained with glassy carbon electrode and carbon paste electrode are 20 ng mL(-1) and 2 ng mL(-1) of lead ion, respectively. An interference study was carried out with Cd(II), As(III), Hg(II) and Co(II) ions. Cd(II) ions interfere significantly (peak overlap) and As(III) has a depressing effect on the lead signal. The influence of pH was investigated indicating that bare and modified GCE and CPE show optimum response at pH 4.0 +/- 0.05.

Tight co-degree condition for perfect matchings in 4-graphs

We will give a tight minimum co-degree condition for a 4-uniform hypergraph to contain a perfect matching.

Synthesis, characterization, thermo- and photoluminescence properties of Bi3+ co-doped Gd2O3:Eu3+ nanophosphors

Gd2O3:Eu3+ (4 mol%) co-doped with Bi3+ (Bi = 0, 1, 3, 5, 7, 9 and 11 mol%) ions were synthesized by a low-temperature solution combustion method. The powders were calcined at 800A degrees C and were characterized by powder X-ray diffraction (PXRD), transmission electron microscopy (TEM), Fourier transform infrared and UV-Vis spectroscopy. The PXRD profiles confirm that the calcined products were in monoclinic with little cubic phases. The particle sizes were estimated using Scherrer's method and Williamson-Hall plots and are found to be in the ranges 40-60 nm and 30-80 nm, respectively. The results are in good agreement with TEM results. The photoluminescence spectra of the synthesized phosphors excited with 230 nm show emission peaks at similar to 590, 612 and 625 nm, which are due to the transitions D-5(0)-> F-7(0), D-5(0)-> F-7(2) and D-5(0)-> F-7(3) of Eu3+, respectively. It is observed that a significant quenching of Eu3+ emission was observed under 230 nm excitation when Bi3+ was co-doped. On the other hand, upon 350 nm excitation, the luminescent intensity of Eu3+ ions was enhanced by incorporation of Bi3+ (5 mol%) ions. The introduction of Bi3+ ions broadened the excitation band of Eu3+ of which a new strong band occurred ranging from 320 to 380 nm. This has been attributed to the 6s(2)-> 6s6p transition of Bi3+ ions, implying a very efficient energy transfer from Bi3+ ions to Eu3+ ions. The gamma radiation response of Gd2O3:Eu3+ exhibited a dosimetrically useful glow peak at 380A degrees C. Using thermoluminescence glow peaks, the trap parameters have been evaluated and discussed. The observed emission characteristics and energy transfer indicate that Gd2O3:Eu3+, Bi3+ phosphors have promising applications in solid-state lighting.

Synthesis of BiFeO by carbonate precipitation

Magnetoelectric multiferroic BiFeO3 (BFO) was synthesized by a simple carbonate precipitation technique of metal nitrate solutions. X-ray powder diffraction and thermo-gravimetric analysis (TGA) revealed that the precipitate consists of an intimate mixture of crystalline bismuth carbonate and an amorphous hydroxide of iron. The precipitate yielded BiFeO3 at an optimal calcination temperature of similar to 560A degrees C. Energy dispersive X-ray (EDX) analysis showed 1:1 ratio between Bi and Fe in the oxide. X-ray photoelectron spectroscopy (XPS) studies confirmed that Fe to be in +3 oxidation states both in the precipitated powder and BiFeO3. The synthesized BFO exhibits a very weak ferromagnetic correlation at room temperature and the degree of which increases slightly on cooling down to 10 K suggesting alteration in the long range spatial modulation of the spins arrangement as compared to the bulk BiFeO3.

Effect of Multiwall Carbon Nanotubes on Electrical and Structural Properties of Polyaniline

Polyaniline (PANI) and PANI/CNT (multiwall carbon nanotubes, CNT) composites were prepared using an oxidative chemical polymerization method with ammonium persulfate and dodecyl benzene sulfonic acid as the oxidizing agent and surfactant, respectively. Fourier-transform infrared spectroscopy spectra illustrate the presence of PANI in the composite and show that some interaction exists between PANI and CNT. Embedding of CNT in the PANI matrix is confirmed by scanning electron micrography. Conductivity of the PANI/CNT composites was higher than that of pure PANI, and the maximum conductivity obtained was 4.44 S/cm at 20 wt.% CNT.

Fabrication of Transparent BaNaB9O15 Glass-Microcrystal Composites

Transparent glasses in the BaO-Na2O-B2O3 (BNBO) system were fabricated via the conventional melt-quenching technique. The amorphous and the glassy nature of the as-quenched samples were confirmed by x-ray powder diffraction (XRD) and differential thermal analysis (DTA), respectively. Cyclic heat treatment of the as-quenched glasses yielded transparent glass-microcrystal composites. The volume fraction of the crystallites and their sizes could be easily controlled by this process. Heat-treated samples were highly transparent owing to the minimum mismatch between the refractive indices of the crystallites and the glass residual matrix. BNBO samples that were heat treated at 540A degrees C for 4 h for 10 cycles were found to be 60% to 70% transparent in the 500 nm to 900 nm wavelength range.

Study of Fluid Flow and Mixing Behaviour of a Vacuum Degasser

In recent times the demand of ultra-low carbon steel (ULCS) with improved mechanical properties such as good ductility and good workability has been increased as it is used to produce cold-rolled steel sheets for automobiles. For producing ULCS efficiently, it is necessary to improve the productivity of the vacuum degassers such as RH, DH and tank degasser. Recently, it has been claimed that using a new process, called REDA (revolutionary degassing activator), one can achieve the carbon content below 10 ppm in less time. As such, REDA process has not been studied thoroughly in terms of fluid flow and mass transfer which is a necessary precursor to understand and design this process. Therefore, momentum and mass transfer of the process has been studied by solving momentum and species balance equations along with k-epsilon turbulent model in two-dimension (2D) for REDA process. Similarly, computational fluid dynamic studies have been made in 2D for tank and RH degassers to compare them with REDA process. Computational results have been validated with published experimental and theoretical data. It is found that REDA process is the most efficient among all these processes in terms of mixing efficiency. Fluid flow phenomena have been studied in details for REDA process by varying gas flow rate, depth of immersed snorkel in the steel, diameter of the snorkel and change in vacuum pressure. It is found that design of snorkel affects the melt circulation in the bath significantly.

A study on seismicity and seismic hazard for Karnataka State

This paper presents a detailed study on the seismic pattern of the state of Karnataka and also quantifies the seismic hazard for the entire state. In the present work, historical and instrumental seismicity data for Karnataka (within 300 km from Karnataka political boundary) were compiled and hazard analysis was done based on this data. Geographically, Karnataka forms a part of peninsular India which is tectonically identified as an intraplate region of Indian plate. Due to the convergent movement of the Indian plate with the Eurasian plate, movements are occurring along major intraplate faults resulting in seismic activity of the region and hence the hazard assessment of this region is very important. Apart from referring to seismotectonic atlas for identifying faults and fractures, major lineaments in the study area were also mapped using satellite data. The earthquake events reported by various national and international agencies were collected until 2009. Declustering of earthquake events was done to remove foreshocks and aftershocks. Seismic hazard analysis was done for the state of Karnataka using both deterministic and probabilistic approaches incorporating logic tree methodology. The peak ground acceleration (PGA) at rock level was evaluated for the entire state considering a grid size of 0.05A degrees x 0.05A degrees. The attenuation relations proposed for stable continental shield region were used in evaluating the seismic hazard with appropriate weightage factors. Response spectra at rock level for important Tier II cities and Bangalore were evaluated. The contour maps showing the spatial variation of PGA values at bedrock are presented in this work.

Microstructure and texture evolution during accumulative roll bonding of aluminium alloys AA2219/AA5086 composite laminates

Accumulative roll bonding of two aluminium alloys, AA2219 and AA5086 was carried out up to 8 passes. During the course of ARB, the deformation inhomogeneity between the two alloy layers results in interfacial instability after the 4th pass, necking of the AA5086 layers after the 6th pass and fracture along the necked regions after the 7th and 8th pass. The EBSD analysis shows deformation bands along the interfaces after 8 passes of ARB. The ARB-processed materials predominantly show characteristic deformation texture components. The weak texture after the 2nd pass results from the combination of a weakly-textured starting AA2219 layer and a strongly-textured starting AA5086 layer. A strong deformation texture forms due to the high imposed strain after a higher number of ARB passes. Subgrain formation and related shear banding induces copper/S components in the case of the small elongated grains, while planar slip leads to the formation of brass component in the large elongated grains.

Reduction of aromatic nitro compounds to amines using zinc and aqueous chelating ethers: Mild and efficient method for zinc activation

A mild, environmentally friendly method for reduction of aromatic nitro group to amine is reported, using zinc powder in aqueous solutions of chelating ethers. The donor ether acts as a ligand and also serves as a co-solvent. Water is the proton source. This procedure is also a new method for the activation of zinc for electron transfer reduction of aromatic nitro compounds. The reduction is accomplished in a neutral medium and other reducing groups remained unaffected. The ethers used are dioxolane, 1,4-dioxane, ethoxymethoxyethane, dimethoxymethane, 1,2-dimethoxyethane, and diglyme.

Geothermal reservoirs - A brief review

A brief discussion and review of the geothermal reservoir systems, geothermal energy and modeling and simulation of the geothermal reservoirs has been presented here. Different types of geothermal reservoirs and their governing equations have been discussed first. The conceptual and numerical modeling along with the representation of flow though fractured media, some issues related to non isothermal flow through fractured media, the efficiency of the geothermal reservoir, structure of the numerical models, boundary conditions and calibration procedures have been illustrated. A brief picture of the Indian scenario and some barriers related with geothermal power are discussed and presented thereafter. Finally some gaps of the existing knowledge and recent focuses of research are discussed.