Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Stability and ergodicity of piecewise deterministic Markov processes

The main goal of this paper is to establish some equivalence results on stability, recurrence, and ergodicity between a piecewise deterministic Markov process ( PDMP) {X( t)} and an embedded discrete-time Markov chain {Theta(n)} generated by a Markov kernel G that can be explicitly characterized in terms of the three local characteristics of the PDMP, leading to tractable criterion results. First we establish some important results characterizing {Theta(n)} as a sampling of the PDMP {X( t)} and deriving a connection between the probability of the first return time to a set for the discrete-time Markov chains generated by G and the resolvent kernel R of the PDMP. From these results we obtain equivalence results regarding irreducibility, existence of sigma-finite invariant measures, and ( positive) recurrence and ( positive) Harris recurrence between {X( t)} and {Theta(n)}, generalizing the results of [ F. Dufour and O. L. V. Costa, SIAM J. Control Optim., 37 ( 1999), pp. 1483-1502] in several directions. Sufficient conditions in terms of a modified Foster-Lyapunov criterion are also presented to ensure positive Harris recurrence and ergodicity of the PDMP. We illustrate the use of these conditions by showing the ergodicity of a capacity expansion model.

AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs) taking values in a general Borel space and with compact action space depending on the state variable. The control variable acts on the jump rate and transition measure of the PDMP, and the running and boundary costs are assumed to be positive but not necessarily bounded. Our first main result is to obtain an optimality equation for the long run average cost in terms of a discrete-time optimality equation related to the embedded Markov chain given by the postjump location of the PDMP. Our second main result guarantees the existence of a feedback measurable selector for the discrete-time optimality equation by establishing a connection between this equation and an integro-differential equation. Our final main result is to obtain some sufficient conditions for the existence of a solution for a discrete-time optimality inequality and an ordinary optimal feedback control for the long run average cost using the so-called vanishing discount approach. Two examples are presented illustrating the possible applications of the results developed in the paper.

An overview of the Amazonian Aerosol Characterization Experiment 2008 (AMAZE-08)

The Amazon Basin provides an excellent environment for studying the sources, transformations, and properties of natural aerosol particles and the resulting links between biological processes and climate. With this framework in mind, the Amazonian Aerosol Characterization Experiment (AMAZE-08), carried out from 7 February to 14 March 2008 during the wet season in the central Amazon Basin, sought to understand the formation, transformations, and cloud-forming properties of fine-and coarse-mode biogenic aerosol particles, especially as related to their effects on cloud activation and regional climate. Special foci included (1) the production mechanisms of secondary organic components at a pristine continental site, including the factors regulating their temporal variability, and (2) predicting and understanding the cloud-forming properties of biogenic particles at such a site. In this overview paper, the field site and the instrumentation employed during the campaign are introduced. Observations and findings are reported, including the large-scale context for the campaign, especially as provided by satellite observations. New findings presented include: (i) a particle number-diameter distribution from 10 nm to 10 mu m that is representative of the pristine tropical rain forest and recommended for model use; (ii) the absence of substantial quantities of primary biological particles in the submicron mode as evidenced by mass spectral characterization; (iii) the large-scale production of secondary organic material; (iv) insights into the chemical and physical properties of the particles as revealed by thermodenuder-induced changes in the particle number-diameter distributions and mass spectra; and (v) comparisons of ground-based predictions and satellite-based observations of hydrometeor phase in clouds. A main finding of AMAZE-08 is the dominance of secondary organic material as particle components. The results presented here provide mechanistic insight and quantitative parameters that can serve to increase the accuracy of models of the formation, transformations, and cloud-forming properties of biogenic natural aerosol particles, especially as related to their effects on cloud activation and regional climate.

A comparison of dry and wet season aerosol number fluxes over the Amazon rain forest

Vertical number fluxes of aerosol particles and vertical fluxes of CO(2) were measured with the eddy covariance method at the top of a 53 m high tower in the Amazon rain forest as part of the LBA (The Large Scale Biosphere Atmosphere Experiment in Amazonia) experiment. The observed aerosol number fluxes included particles with sizes down to 10 nm in diameter. The measurements were carried out during the wet and dry season in 2008. In this study focus is on the dry season aerosol fluxes, with significant influence from biomass burning, and these are compared with aerosol fluxes measured during the wet season. Net particle deposition fluxes dominated in daytime in both seasons and the deposition flux was considerably larger in the dry season due to the much higher dry season particle concentration. The particle transfer velocity increased linearly with increasing friction velocity in both seasons. The difference in transfer velocity between the two seasons was small, indicating that the seasonal change in aerosol number size distribution is not enough for causing any significant change in deposition velocity. In general, particle transfer velocities in this study are low compared to studies over boreal forests. The reasons are probably the high percentage of accumulation mode particles and the low percentage of nucleation mode particles in the Amazon boundary layer, both in the dry and wet season, and low wind speeds in the tropics compared to the midlatitudes. In the dry season, nocturnal particle fluxes behaved very similar to the nocturnal CO(2) fluxes. Throughout the night, the measured particle flux at the top of the tower was close to zero, but early in the morning there was an upward particle flux peak that is not likely a result of entrainment or local pollution. It is possible that these morning upward particle fluxes are associated with emission of primary biogenic particles from the rain forest. Emitted particles may be stored within the canopy during stable conditions at nighttime, similarly to CO(2), and being released from the canopy when conditions become more turbulent in the morning.

Aerosol number fluxes over the Amazon rain forest during the wet season

Number fluxes of particles with diameter larger than 10 nm were measured with the eddy covariance method over the Amazon rain forest during the wet season as part of the LBA (The Large Scale Biosphere Atmosphere Experiment in Amazonia) campaign 2008. The primary goal was to investigate whether sources or sinks dominate the aerosol number flux in the tropical rain forest-atmosphere system. During the measurement campaign, from 12 March to 18 May, 60% of the particle fluxes pointed downward, which is a similar fraction to what has been observed over boreal forests. The net deposition flux prevailed even in the absolute cleanest atmospheric conditions during the campaign and therefore cannot be explained only by deposition of anthropogenic particles. The particle transfer velocity v(t) increased with increasing friction velocity and the relation is described by the equation v(t) = 2.4x10(-3)xu(*) where u(*) is the friction velocity. Upward particle fluxes often appeared in the morning hours and seem to a large extent to be an effect of entrainment fluxes into a growing mixed layer rather than primary aerosol emission. In general, the number source of primary aerosol particles within the footprint area of the measurements was small, possibly because the measured particle number fluxes reflect mostly particles less than approximately 200 nm. This is an indication that the contribution of primary biogenic aerosol particles to the aerosol population in the Amazon boundary layer may be low in terms of number concentrations. However, the possibility of horizontal variations in primary aerosol emission over the Amazon rain forest cannot be ruled out.

Spectral dependence of aerosol light absorption over the Amazon Basin

In this study, we examine the spectral dependence of aerosol absorption at different sites and seasons in the Amazon Basin. The analysis is based on measurements performed during three intensive field experiments at a pasture site (Fazenda Nossa Senhora, Rondonia) and at a primary forest site (Cuieiras Reserve, Amazonas), from 1999 to 2004. Aerosol absorption spectra were measured using two Aethalometers: a 7-wavelength Aethalometer (AE30) that covers the visible (VIS) to near-infrared (NIR) spectral range, and a 2-wavelength Aethalometer (AE20) that measures absorption in the UV and in the NIR. As a consequence of biomass burning emissions, about 10 times greater absorption values were observed in the dry season in comparison to the wet season. Power law expressions were fitted to the measurements in order to derive the absorption Angstrom exponent, defined as the negative slope of absorption versus wavelength in a log-log plot. At the pasture site, about 70% of the absorption Angstrom exponents fell between 1.5 and 2.5 during the dry season, indicating that biomass burning aerosols have a stronger spectral dependence than soot carbon particles. Angstrom exponents decreased from the dry to the wet season, in agreement with the shift from biomass burning aerosols, predominant in the fine mode, to biogenic and dust aerosols, predominant in the coarse mode. The lowest absorption Angstrom exponents (90% of data below 1.5) were observed at the forest site during the dry season. Also, results indicate that low absorption coefficients were associated with low Angstrom exponents. This finding suggests that biogenic aerosols from Amazonia have a weaker spectral dependence for absorption than biomass burning aerosols, contradicting our expectations of biogenic particles behaving as brown carbon. In a first order assessment, results indicate a small (<1 %) effect of variations in absorption Angstrom exponents on 24-h aerosol forcings, at least in the spectral range of 450-880 nm. Further studies should be taken to assess the corresponding impact in the UV spectral range. The assumption that soot spectral properties represent all ambient light absorbing particles may cause a misjudgment of absorption towards the UV, especially in remote areas. Therefore, it is recommended to measure aerosol absorption at several wavelengths to accurately assess the impact of non-soot aerosols on climate and on photochemical atmospheric processes.

Sources of carbonaceous aerosol in the Amazon basin

The quantification of sources of carbonaceous aerosol is important to understand their atmospheric concentrations and regulating processes and to study possible effects on climate and air quality, in addition to develop mitigation strategies. In the framework of the European Integrated Project on Aerosol Cloud Climate Interactions (EUCAARI) fine (D(p) < 2.5 mu m) and coarse (2.5 mu m < Dp < 10 mu m) aerosol particles were sampled from February to June (wet season) and from August to September (dry season) 2008 in the central Amazon basin. The mass of fine particles averaged 2.4 mu g m(-3) during the wet season and 4.2 mu g m(-3) during the dry season. The average coarse aerosol mass concentration during wet and dry periods was 7.9 and 7.6 mu g m(-3), respectively. The overall chemical composition of fine and coarse mass did not show any seasonality with the largest fraction of fine and coarse aerosol mass explained by organic carbon (OC); the average OC to mass ratio was 0.4 and 0.6 in fine and coarse aerosol modes, respectively. The mass absorbing cross section of soot was determined by comparison of elemental carbon and light absorption coefficient measurements and it was equal to 4.7 m(2) g(-1) at 637 nm. Carbon aerosol sources were identified by Positive Matrix Factorization (PMF) analysis of thermograms: 44% of fine total carbon mass was assigned to biomass burning, 43% to secondary organic aerosol (SOA), and 13% to volatile species that are difficult to apportion. In the coarse mode, primary biogenic aerosol particles (PBAP) dominated the carbonaceous aerosol mass. The results confirmed the importance of PBAP in forested areas. The source apportionment results were employed to evaluate the ability of global chemistry transport models to simulate carbonaceous aerosol sources in a regional tropical background site. The comparison showed an overestimation of elemental carbon (EC) by the TM5 model during the dry season and OC both during the dry and wet periods. The overestimation was likely due to the overestimation of biomass burning emission inventories and SOA production over tropical areas.

Shared information in stationary states of stochastic processes

We present four estimators of the shared information (or interdepency) in ground states given that the coefficients appearing in the wave function are all real non-negative numbers and therefore can be interpreted as probabilities of configurations. Such ground states of Hermitian and non-Hermitian Hamiltonians can be given, for example, by superpositions of valence bond states which can describe equilibrium but also stationary states of stochastic models. We consider in detail the last case, the system being a classical not a quantum one. Using analytical and numerical methods we compare the values of the estimators in the directed polymer and the raise and peel models which have massive, conformal invariant and nonconformal invariant massless phases. We show that like in the case of the quantum problem, the estimators verify the area law with logarithmic corrections when phase transitions take place.

Collision probabilities in the rarefaction fan of asymmetric exclusion processes

We consider the one-dimensional asymmetric simple exclusion process (ASEP) in which particles jump to the right at rate p is an element of (1/2, 1.] and to the left at rate 1 - p, interacting by exclusion. In the initial state there is a finite region such that to the left of this region all sites are occupied and to the right of it all sites are empty. Under this initial state, the hydrodynamical limit of the process converges to the rarefaction fan of the associated Burgers equation. In particular suppose that the initial state has first-class particles to the left of the origin, second-class particles at sites 0 and I, and holes to the right of site I. We show that the probability that the two second-class particles eventually collide is (1 + p)/(3p), where a collision occurs when one of the particles attempts to jump over the other. This also corresponds to the probability that two ASEP processes. started from appropriate initial states and coupled using the so-called ""basic coupling,"" eventually reach the same state. We give various other results about the behaviour of second-class particles in the ASEP. In the totally asymmetric case (p = 1) we explain a further representation in terms of a multi-type particle system, and also use the collision result to derive the probability of coexistence of both clusters in a two-type version of the corner growth model.

Random perturbations of stochastic processes with unbounded variable length memory

We consider binary infinite order stochastic chains perturbed by a random noise. This means that at each time step, the value assumed by the chain can be randomly and independently flipped with a small fixed probability. We show that the transition probabilities of the perturbed chain are uniformly close to the corresponding transition probabilities of the original chain. As a consequence, in the case of stochastic chains with unbounded but otherwise finite variable length memory, we show that it is possible to recover the context tree of the original chain, using a suitable version of the algorithm Context, provided that the noise is small enough.

Hitting and returning to rare events for all alpha-mixing processes

We prove that for any a-mixing stationary process the hitting time of any n-string A(n) converges, when suitably normalized, to an exponential law. We identify the normalization constant lambda(A(n)). A similar statement holds also for the return time. To establish this result we prove two other results of independent interest. First, we show a relation between the rescaled hitting time and the rescaled return time, generalizing a theorem of Haydn, Lacroix and Vaienti. Second, we show that for positive entropy systems, the probability of observing any n-string in n consecutive observations goes to zero as n goes to infinity. (c) 2010 Elsevier B.V. All rights reserved.

Gibbs random graphs on point processes

Consider a discrete locally finite subset Gamma of R(d) and the cornplete graph (Gamma, E), with vertices Gamma and edges E. We consider Gibbs measures on the set of sub-graphs with vertices Gamma and edges E` subset of E. The Gibbs interaction acts between open edges having a vertex in common. We study percolation properties of the Gibbs distribution of the graph ensemble. The main results concern percolation properties of the open edges in two cases: (a) when Gamma is sampled from a homogeneous Poisson process; and (b) for a fixed Gamma with sufficiently sparse points. (c) 2010 American Institute of Physics. [doi:10.1063/1.3514605]

Do plant species influence soil CO(2) and N(2)O fluxes in a diverse tropical forest?

To test whether plant species influence greenhouse gas production in diverse ecosystems, we measured wet season soil CO(2) and N(2)O fluxes close to similar to 300 large (>35 cm in diameter at breast height (DBH)) trees of 15 species at three clay-rich forest sites in central Amazonia. We found that soil CO(2) fluxes were 38% higher near large trees than at control sites >10 m away from any tree (P < 0.0001). After adjusting for large tree presence, a multiple linear regression of soil temperature, bulk density, and liana DBH explained 19% of remaining CO(2) flux variability. Soil N(2)O fluxes adjacent to Caryocar villosum, Lecythis lurida, Schefflera morototoni, and Manilkara huberi were 84%-196% greater than Erisma uncinatum and Vochysia maxima, both Vochysiaceae. Tree species identity was the most important explanatory factor for N(2)O fluxes, accounting for more than twice the N(2)O flux variability as all other factors combined. Two observations suggest a mechanism for this finding: (1) sugar addition increased N(2)O fluxes near C. villosum twice as much (P < 0.05) as near Vochysiaceae and (2) species mean N(2)O fluxes were strongly negatively correlated with tree growth rate (P = 0.002). These observations imply that through enhanced belowground carbon allocation liana and tree species can stimulate soil CO(2) and N(2)O fluxes (by enhancing denitrification when carbon limits microbial metabolism). Alternatively, low N(2)O fluxes potentially result from strong competition of tree species with microbes for nutrients. Species-specific patterns in CO(2) and N(2)O fluxes demonstrate that plant species can influence soil biogeochemical processes in a diverse tropical forest.

Influence of land-use change on near-surface hydrological processes: Undisturbed forest to pasture

Soil compaction that follows the clearing of tropical forest for cattle pasture is associated with lower soil hydraulic conductivity and increased frequency and volume of overland flow. We investigated the frequency of perched water tables, overland flow and stormflow in an Amazon forest and in an adjacent 25-year-old pasture cleared from the same forest. We compared the results with the frequencies of these phenomena estimated from comparisons of rainfall intensity and soil hydraulic conductivity. The frequency of perched water tables based on rainfall intensity and soil hydraulic conductivity was expected to double in pasture compared with forest. This corresponded closely with an approximate doubling of the frequency of stormflow and overland flow in pasture. In contrast, the stormflow volume in pasture increased 17-fold. This disproportional increase of stormflow resulted from overland flow generation over large areas of pasture, while overland flow generation in the forest was spatially limited and was observed only very near the stream channel. In both catchments, stormflow was generated by saturation excess because of perched water tables and near-surface groundwater levels. Stormflow was occasionally generated in the forest by rapid return flow from macropores, while slow return flow from a continuous perched water table was more common in the pasture. These results suggest that deforestation for pasture alters fundamental mechanisms of stormflow generation and may increase runoff volumes over wide regions of Amazonia. (C) 2009 Elsevier B.V. All rights reserved.