New algorithms of the Q-learning type

We propose two algorithms for Q-learning that use the two-timescale stochastic approximation methodology. The first of these updates Q-values of all feasible state–action pairs at each instant while the second updates Q-values of states with actions chosen according to the ‘current’ randomized policy updates. A proof of convergence of the algorithms is shown. Finally, numerical experiments using the proposed algorithms on an application of routing in communication networks are presented on a few different settings.

Synthesis, structure and magnetic behavior of a new three-dimensional Manganese phosphite-oxalate: [C2N2H10][Mn-2(II)(OH2)(2)(HPO3)(2)(C2O4)]

A novel manganese phosphite-oxalate, [C2N2H10][Mn-2(II)(OH2)(2)(HPO3)(2)(C2O4)] has been hydothermally synthesized and its structure determined by single-crystal X-ray diffraction. The structure consists of neutral manganese phosphite layers, [Mn(HPO3)](infinity), formed by MnO6 octahedra and HPO3 units, cross-linked by the oxalate moieties. The organic cations occupy the middle of the 8-membered one dimensional channels. Magnetic studies indicate weak antiferromagnetic interactions between the Mn2+ ions. (C) 2009 Elsevier Inc. All rights reserved.

Quadratic Nonlinearity of One- and Two-Electron Oxidized Metalloporphyrins and Their Switching in Solution

We report the quadratic nonlinearity of one- and two-electron oxidation products of the first series of transition metal complexes of meso-tetraphenylporphyrin (TPP). Among many MTPP complexes, only CuTPP and ZnTPP show reversible oxidation/reduction cycles as seen from cyclic voltammetry experiments. While centrosymmetric neutral metalloporphyrins have zero first hyperpolarizability, β, as expected, the cation radicals and dications of CuTPP and ZnTPP have very high β values. The one- and two-electron oxidation of the MTPPs leads to symmetry-breaking of the metal−porphyrin core, resulting in a large β value that is perhaps aided in part by contributions from the two-photon resonance enhancement. The calculated static first hyperpolarizabilities, β0, which are evaluated in the framework of density functional theory by a coupled perturbed Hartree−Fock method, support the experimental trend. The switching of optical nonlinearity has been achieved between the neutral and the one-electron oxidation products but not between the one- and the two-electron oxidation products since dications that are electrochemically reversible are unstable due to the formation of stable isoporphyrins in the presence of nucleophiles such as halides.

Surface spin glass behavior in sol–gel derived La0.7Ca0.3MnO3 nanotubes

We report the fabrication of La0.7Ca0.3MnO3 nanotubes (LCMONTs) with a diameter of about 200 nm, by a modified sol-gel method utilizing nanochannel alumina templates. High resolution transmission electron microscopy confirmed that the obtained LCMONTs are made up of nanoparticles (8-12 nm), which are randomly aligned in the wall of the nanotubes. The strong irreversibility between zero field cooling (ZFC) and field cooling (FC) magnetization curves as well as a cusplike peak in the ZFC curve gives strong support for surface spin glass behavior.

Overview No.144 - Mechanical behavior of amorphous alloys

The mechanical properties of amorphous alloys have proven both scientifically unique and of potential practical interest, although the underlying deformation physics of these materials remain less firmly established as compared with crystalline alloys. In this article, we review recent advances in understanding the mechanical behavior of metallic glasses, with particular emphasis on the deformation and fracture mechanisms. Atomistic as well as continuum modeling and experimental work on elasticity, plastic flow and localization, fracture and fatigue are all discussed, and theoretical developments are connected, where possible, with macroscopic experimental responses. The role of glass structure on mechanical properties, and conversely, the effect of deformation upon glass structure, are also described. The mechanical properties of metallic glass-derivative materials – including in situ and ex situ composites, foams and nanocrystal-reinforced glasses – are reviewed as well. Finally, we identify a number of important unresolved issues for the field.

Dielectric, Ferroelectric and Relaxor Behavior of BaLaxBi4-xTi4O15 Ceramics

Monophasic BaLaxBi4-xTi4O15 (x = 0, 0.2, 0.4, 0.6 and 0.8) ceramics, fabricated from the powders synthesized via the solid-state reaction route exhibited relaxor behavior. Dielectric properties of the well sintered ceramics were measured in a wide frequency range (1 kHz-1 MHz) at different temperatures (300-750 K). The temperature of dielectri maximum (T-m) was found to decrease significantly from 696 K for an undoped sample (x = 0) to 395 K for the sample corresponding to the composition x = 0.8 accompanied by a decrease in the magnitude ofdielectric maximum (epsilon(m)). The temperature variation of the dielectric constant on the high temperature slope of the peak (T > T-m) was analyzed by using the Lorentz-ype quadratic law and the diffuseness of the peak was found to increase with increasing x. Vogel-Fulcher modelling of dielectric relaxation showed a decrease in freezing temperature (T-VF) (from 678 to 340 K) and an increase in the activation energy (5 to 24 meV) for the frequency dispersion with increase in x (La-3 divided by content). Strength of frequency dispersion of the phase transition increased with lanthanum content. Polarization (P)-electric field (E) hysteresis loops recorded at 373 showed a transition from a nearly squarish to slim loop hysteresis behavior with increasing lanthanum content.

Space-Vector-Based Hybrid Pulsewidth Modulation Techniques for Reduced Harmonic Distortion and Switching Loss

Novel switching sequences can be employed in spacevector-based pulsewidth modulation (PWM) of voltage source inverters. Differentswitching sequences are evaluated and compared in terms of inverter switching loss. A hybrid PWM technique named minimum switching loss PWM is proposed, which reduces the inverter switching loss compared to conventional space vector PWM (CSVPWM) and discontinuous PWM techniques at a given average switching frequency. Further, four space-vector-based hybrid PWM techniques are proposed that reduce line current distortion as well as switching loss in motor drives, compared to CSVPWM. Theoretical and experimental results are presented.

Phase behavior of concentrated aqueous solutions of cetyltrimethylammonium bromide (CTAB) and sodium hydroxy naphthoate (SHN)

We have characterized the phase behavior of mixtures of the cationic surfactant cetyltrimethylammonium bromide (CTAB) and the organic salt 3-sodium-2-hydroxy naphthoate (SHN) over a wide range of surfactant concentrations using polarizing optical microscopy and X-ray diffraction. A variety of liquid crystalline phases, such as hexagonal, lamellar with and without curvature defects, and nematic, are observed in these mixtures. At high temperatures the curvature defects in the lamellar phase are annealed gradually on decreasing the water content. However, at lower temperatures these two lamellar structures are separated by an intermediate phase, where the bilayer defects appear to order into a lattice. The ternary phase diagram shows a high degree of symmetry about the line corresponding to equimolar CTAB/SHN composition, as in the case of mixtures of cationic and anionic surfactants.

Support vector machine approach for the switching transient peak overvoltages during line energization

At the time of restoration transmission line switching is one of the major causes, which creates transient overvoltages. Though detailed Electro Magnetic Transient studies are carried out extensively for the planning and design of transmission systems, such studies are not common in a day-today operation of power systems. However it is important for the operator to ensure during restoration of supply that peak overvoltages resulting from the switching operations are well within safe limits. This paper presents a support vector machine approach to classify the various cases of line energization in the category of safe or unsafe based upon the peak value of overvoltage at the receiving end of line. Operator can define the threshold value of voltage to assign the data pattern in either of the class. For illustration of proposed approach the power system used for switching transient peak overvoltages tests is a 400 kV equivalent system of an Indian southern gri

Improved switching frequency variation control of hysteresis controlled voltage source inverter-fed IM drives using current error space vector

A constant switching frequency current error space vector-based hysteresis controller for two-level voltage source inverter-fed induction motor (IM) drives is proposed in this study. The proposed controller is capable of driving the IM in the entire speed range extending to the six-step mode. The proposed controller uses the parabolic boundary, reported earlier, for vector selection in a sector, but uses simple, fast and self-adaptive sector identification logic for sector change detection in the entire modulation range. This new scheme detects the sector change using the change in direction of current error along the axes jA, jB and jC. Most of the previous schemes use an outer boundary for sector change detection. So the current error goes outside the boundary six times during sector change, in one cycle,, introducing additional fifth and seventh harmonic components in phase current. This may cause sixth harmonic torque pulsations in the motor and spread in the harmonic spectrum of phase voltage. The proposed new scheme detects the sector change fast and accurately eliminating the chance of introducing additional fifth and seventh harmonic components in phase current and provides harmonic spectrum of phase voltage, which exactly matches with that of constant switching frequency voltage-controlled space vector pulse width modulation (VC-SVPWM)-based two-level inverter-fed drives.

Crystal structure of dimeric FabZ of Plasmodium falciparum reveals conformational switching to active hexamers by peptide flips

The crystal structure of beta-hydroxyacyl acyl carrier protein dehydratase of Plasmodium falciparum (PfFabZ) has been determined at a resolution of 2.4 angstrom. PfFabZ has been found to exist as a homodimer (d-PfFabZ) in the crystals of the present study in contrast to the reported hexameric form (h-PfFabZ) which is a trimer of dimers crystallized in a different condition. The catalytic sites of this enzyme are located in deep narrow tunnel-shaped pockets formed at the dimer interface. A histidine residue from one subunit of the dimer and a glutamate residue from the other subunit lining the tunnel form the catalytic dyad in the reported crystal structures. While the position of glutamate remains unaltered in the crystal structure of d-PffabZ compared to that in b-PfFabZ, the histidine residue takes up an entirely different conformation and moves away from the tunnel leading to a His-Phe cis-trans peptide flip at the histidine residue. In addition, a loop in the vicinity has been observed to undergo a similar flip at a Tyr-Pro peptide bond. These alterations not only prevent the formation of a hexamer but also distort the active site geometry resulting in a dimeric form of FabZ that is incapable of substrate binding. The dimeric state and an altered catalytic site architecture make d-PfFabZ distinctly different from the FabZ structures described so far. Dynamic light scattering and size exclusion chromatographic studies clearly indicate a pH-related switching of the dimers to active hexamers. (c) 2006 Federation of European Biochemical Societies. Published by Elsevier B.V. All rights reserv.

Suppression of spinel formation to induce reversible thermal behavior in the layered double hydroxides (LDHs) of Co with Al, Fe, Ga, and In

The layered double hydroxides (LDHs) of Co with trivalent cations decompose irreversibly to yield oxides with the spinel structure. Spinel formation is aided by the oxidation of Co(II) to Co(III) in the ambient atmosphere. When the decomposition is carried out under N-2, the oxidation of Co(II) is suppressed, and the resulting oxide has the rock salt structure. Thus, the Co-Al-CO32-/Cl- LDHs yield oxides of the type Co1- Al-x(2x/3)rectangle O-x/3, which are highly metastable, given the large defect concentration. This defect oxide rapidly reverts back to the original hydroxide on soaking in a Na2CO3 solution. Interlayer NO3- anions, on the other hand, decompose generating a highly oxidizing atmosphere, whereby the Co-Al-NO3- LDH decomposes to form the spinel phase even in a N-2 atmosphere. The oxide with the defect rock salt structure formed by the thermal decomposition of the Co-Fe-CO32- LDH under N2, on soaking in a Na2CO3 solution, follows a different kinetic pathway and undergoes a solution transformation into the inverse spinel Co(Co, Fe)(2)O-4. Fe3+ has a low octahedral crystal field stabilization energy and therefore prefers the tetrahedral coordination offered by the structure of the inverse spinel rather than the octahedral coordination of the parent LDH. Similar considerations do not hold in the case of Ga- and In-containing LDHs, given the considerable barriers to the diffusion of M3+ (M=Ga, In) from octahedral to tetrahedral sites owing to their large size. Consequently, the In-containing oxide residue reverts back to the parent hydroxide, whereas this reconstruction is partial in the case of the Ga-containing oxide. These studies show that the reversible thermal behavior offers a competing kinetic pathway to spinel formation. Suppression of the latter induces the reversible behavior in an LDH that otherwise decomposes irreversibly to the spinel.

Applicability of partition ratios, mercuric chloride complexes, and chromatographic behavior for the identification of carotenoids

Partition ratios and M50 values of different carotenoids in hexaneaqueous methanol were determined. Mercuric chloride complexes of 14 epoxy carotenoids were prepared and their absorption maxima in acetone were estimated. The difference in chromatographic behavior of carotenoid epoxides on alumina and magnesium oxide-Celite columns is discussed. It is shown that the magnesium oxide-Celite column behaves as a reverse-phase chromatographic column to alumina column.

Biosynthesis of coenzyme Q in microorganisms

Incorporation of mevalonate-2-C14, acetate-1-C14, and formate-C14 into the lipids of microorganisms was studied. In the case of four bacteria tested—Agrobacterium tumefaciens, Azotobacter vinelandii, Escherichia coli, and a Pseudomonas species—the various homologues of coenzyme Q present were not labeled with any of the tracers used, although significant amounts of radioactivity were present in the lipids. Both acetate and mevalonate were incorporated into coenzyme Q and sterol of the moulds, Aspergillus niger, Neurospora crassa, Penicillium chrysogenum, and Gibberella fujickuroi, and a yeast, Torulopsis utilis. Mevalonate was incorporated into the side chain but not the ring, whereas acetate was incorporated into both. It appears that the mevalonate pathway for the synthesis of coenzyme Q is operative only in those organisms which also contain other isoprene compounds such as sterol and carotene.