Values and actions in aversion

Model-based and model-free controllers can, in principle, learn arbitrary actions to optimize their behavior, at least those actions that can be expressed and explored. Indeed, these are often referred to as instrumental controllers because their choices are learned to be instrumental for the delivery of desired outcomes. Although this flexibility is very powerful, it comes with an attendant cost of learning. Evolution appears to have endowed everything from the simplest organisms to us with powerful, pre-specified, but inflexible alternatives. These responses are termed Pavlovian, after the famous Russian physiologist and psychologist Pavlov. The responses of the Pavlovian controller are determined by evolutionary (phylogenetic) considerations rather than (ontogenetic) aspects of the contingent development or learning of an individual. These responses directly interact with instrumental choices arising from goal-directed and habitual controllers. This interaction has been studied in a wealth of animal paradigms, and can be helpful, neutral, or harmful, according to circumstance. Although there has been less careful or analytical study of it in humans, it can be interpreted as underpinning a wealth of behavioral aberrations. © 2009 Elsevier Inc. All rights reserved.

Tests of an adaptive QM/MM calculation on free energy profiles of chemical reactions in solution.

We present reaction free energy calculations using the adaptive buffered force mixing quantum mechanics/molecular mechanics (bf-QM/MM) method. The bf-QM/MM method combines nonadaptive electrostatic embedding QM/MM calculations with extended and reduced QM regions to calculate accurate forces on all atoms, which can be used in free energy calculation methods that require only the forces and not the energy. We calculate the free energy profiles of two reactions in aqueous solution: the nucleophilic substitution reaction of methyl chloride with a chloride anion and the deprotonation reaction of the tyrosine side chain. We validate the bf-QM/MM method against a full QM simulation, and show that it correctly reproduces both geometrical properties and free energy profiles of the QM model, while the electrostatic embedding QM/MM method using a static QM region comprising only the solute is unable to do so. The bf-QM/MM method is not explicitly dependent on the details of the QM and MM methods, so long as it is possible to compute QM forces in a small region and MM forces in the rest of the system, as in a conventional QM/MM calculation. It is simple, with only a few parameters needed to control the QM calculation sizes, and allows (but does not require) a varying and adapting QM region which is necessary for simulating solutions.

Free energy surface reconstruction from umbrella samples using Gaussian process regression

We demonstrate how the Gaussian process regression approach can be used to efficiently reconstruct free energy surfaces from umbrella sampling simulations. By making a prior assumption of smoothness and taking account of the sampling noise in a consistent fashion, we achieve a significant improvement in accuracy over the state of the art in two or more dimensions or, equivalently, a significant cost reduction to obtain the free energy surface within a prescribed tolerance in both regimes of spatially sparse data and short sampling trajectories. Stemming from its Bayesian interpretation the method provides meaningful error bars without significant additional computation. A software implementation is made available on www.libatoms.org.

Free energy surface reconstruction from umbrella samples using Gaussian process regression II: Multiple collective variables

We demonstrate how a prior assumption of smoothness can be used to enhance the reconstruction of free energy profiles from multiple umbrella sampling simulations using the Bayesian Gaussian process regression approach. The method we derive allows the concurrent use of histograms and free energy gradients and can easily be extended to include further data. In Part I we review the necessary theory and test the method for one collective variable. We demonstrate improved performance with respect to the weighted histogram analysis method and obtain meaningful error bars without any significant additional computation. In Part II we consider the case of multiple collective variables and compare to a reconstruction using least squares fitting of radial basis functions. We find substantial improvements in the regimes of spatially sparse data or short sampling trajectories. A software implementation is made available on www.libatoms.org.

Binder free three-dimensional sulphur/few-layer graphene foam cathode with enhanced high-rate capability for rechargeable lithium sulphur batteries.

A novel ultra-lightweight three-dimensional (3-D) cathode system for lithium sulphur (Li-S) batteries has been synthesised by loading sulphur on to an interconnected 3-D network of few-layered graphene (FLG) via a sulphur solution infiltration method. A free-standing FLG monolithic network foam was formed as a negative of a Ni metallic foam template by CVD followed by etching away of Ni. The FLG foam offers excellent electrical conductivity, an appropriate hierarchical pore structure for containing the electro-active sulphur and facilitates rapid electron/ion transport. This cathode system does not require any additional binding agents, conductive additives or a separate metallic current collector thus decreasing the weight of the cathode by typically ∼20-30 wt%. A Li-S battery with the sulphur-FLG foam cathode shows good electrochemical stability and high rate discharge capacity retention for up to 400 discharge/charge cycles at a high current density of 3200 mA g(-1). Even after 400 cycles the capacity decay is only ∼0.064% per cycle relative to the early (e.g. the 5th cycle) discharge capacity, while yielding an average columbic efficiency of ∼96.2%. Our results indicate the potential suitability of graphene foam for efficient, ultra-light and high-performance batteries.

Studies on the biology of Chaoborus flavicans (Meigen) (Diptera : Chaoboridae) in a fish-free eutrophic pond, Japan

Population dynamics of Chaoborus flavicans larvae of various instars was studied from November 1986 to December 1987 in a eutrophic, fish-free pond, Japan. First and 2nd instar larvae were observed from late April to late October, indicating a reproductive period of about half a year. C. flavicans overwintered in the 4th instar larvae. In water column samples, total density of all instars was 680-23 680 m(-2), and pupal density 0-2 600 m(-2); larvae of the Ist, 2nd, and 3rd instars showed 5-6 density peaks in 1987, suggesting that 5-6 generations occur during a year (peaks of the 4th instar larvae were not clear, probably due to their longer development than those of younger instars). In sediment samples, no Ist and 2nd instar larvae were found, 3rd instar larvae were found occasionally but density of the 4th instar larvae was 280-18 600 m(-2), and pupal density varied between 0-502 m(-2). Fouth instar larvae accumulated in sediment in the cold season and in the water column in the warm season; high temperature and low oxygen concentration were the most important factors limiting the distribution of larvae in the sediment in summer in the NIES pond. The dry weight of total C. flavicans larvae was 0.08-4.2 g m(-2) in sediment samples and 24-599 mu g l(-1) (0.10-2.40 g m(-2)) in water column samples. Comparisons of maximum densities in the NIES pond in different years and in waters of different trophic status show that density is generally higher in eutrophic than in oligotrophic habitats.

Effects of external magnetic field on the effective g factor of (Ga,Mn)As

With the help of time resolved magneto-optic Kerr rotation measurements, the optically induced spin precession in heavily doped diluted magnetic semiconductor Ga0.937Mn0.063 As was observed. It was found that the effective g factor increases with increasing magnetic field, which is attributed to the magnetic-field-induced increase of the density of the non-localized holes. Those free holes will couple with the localized magnetic ions by p-d interactions, leading to the formation of spontaneous magnetization in Ga0.937Mn0.063As, which in turn to the enhancement of the effective g factor.

Weak epitaxy growth of metal-free phthalocyanine on p-sexiphenyl monolayer and double-layer films

Weak epitaxy growth (WEG) can afford high-mobility thin films of disk-like organic semiconductor of which mobility is up to the level of the corresponding single crystals. We investigated the WEG behavior and mechanism of planar phthalocyanine in the model system of metal-free phthalocyanine (H2Pc) grown on p-sexiphenyl (p-6P) ultrathin films (monolayers and double layers). Highly oriented H2Pc films with molecules standing up exhibited two kinds of different in-plane orientations, i.e., three sets of in-plane orientations and only one set of in-plane orientation, on p-6P monolayer and double-layer films, respectively.

Phosphine-Free Synthesis of High-Quality CdSe Nanocrystals in Noncoordination Solvents: "Activating Agent" and "Nucleating Agent" Controlled Nucleation and Growth

CdSe nanocrystals (NCs) are prepared in noncoordination solvents (1-octadecene (ODE) and paraffin liquid) with Ion g-chain primary alkylamine as the sole ligand, ODE-Se, and cadmium fatty acid salt as precursors. The obtained NCs meet the four fundamental parameters for high-quality NCs: high crystallinity, narrow size distribution, moderate photoluminescence quantum yield, and broad range size tunableness. Further, by simply regulating the relative molar ratio of alkylamine to cadmium precursor, the regular sized "nuclei" and final obtained NCs can be produced predictably within a certain size range.

G-quadruplex-based DNAzyme for sensitive mercury detection with the naked eye

Hg2+ is able to inhibit the peroxidase-like DNAzyme function of a T-containing G-quadruplex DNA via Hg2+-mediated T-T base pairs, which enables the visual detection of Hg2+ in the TMB-H2O2 reaction system with high selectivity and sensitivity.

Facile Surfactant- and Template-Free Synthesis and Luminescent Properties of One-Dimensional Lu2O3:Eu3+ Phosphors

Uniform Lu2O3:Eu3+ nanorods and nanowires have been successfully prepared through a simple solution-based hydrothermal process followed by a subsequent calcination process without using any surfactant, catalyst, or template. On the basis of X-ray diffraction, thermogravimetric analysis and differential scanning calorimetry, and Fourier transform infrared spectroscopy results, it can be assumed that the as-obtained precursors have the structure formula of Lu4O(OH)(9)(NO3), which is a new phase and has not been reported. The morphology of the precursors could be modulated from nanorods to nanowires with the increase of pH value using ammonia solution. The as-formed precursors could transform to cubic Lu2O3:Eu3+ with the same morphology and a slight shrinkage in size after an annealing process, Both the Lu2O3:Eu3+ nanorods and nanowires exhibit the strong red emission corresponding to the D-5(0)-F-7(2) transition of the Eu3+ ions under UV light excitation or low-voltage electron beam excitation.

G-Quadruplex Aptamers with Peroxidase-Like DNAzyme Functions: Which Is the Best and How Does it Work?

Some G-quadruplex DNA aptamers have been found to strongly bind hemin to form DNAzymes with peroxidase-like activity. To help determine the most suitable DNAzymes and to understand how they work, five previously reported G-quadruplex aptamers were compared for their binding affinity and then the potential catalytic mechanism of their corresponding hemin-G-quadruplex DNAzymes was explored. Among these aptamers, a G-quadruplex named AGRO100 was shown to possess the highest hemin-binding affinity and the best DNAzyme function. This means that AGRO100 is the most ideal candidate for DNAzyme-based analysis. Furthermore, we found the peroxidase-like activity of DNAzyme to be primarily dependent on the concentration of H2O2 and independent of that of the peroxidase substrate (that is, 2,2-azino-bis(3-ethytbenzothiazoline-6-sulfonic acid)diammonium salt). Accordingly, a reaction mechanism for DNAzyme-catalyzed peroxidation is proposed. This study provides new insights into the G-quadruplex-based DNAzymes and will help us to further extend their applications in the analytical field.

Enhanced catalytic DNAzyme for label-free colorimetric detection of DNA

A DNAzyme-based label-free method for the colorimetric detection of DNA is introduced, with a supramolecular hemin G-quartet complex as the sensing element and a 36-mer single-strand DNA as the analyte that is detected at 10 nM.