Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum.

Food preferences are acquired through experience and can exert strong influence on choice behavior. In order to choose which food to consume, it is necessary to maintain a predictive representation of the subjective value of the associated food stimulus. Here, we explore the neural mechanisms by which such predictive representations are learned through classical conditioning. Human subjects were scanned using fMRI while learning associations between arbitrary visual stimuli and subsequent delivery of one of five different food flavors. Using a temporal difference algorithm to model learning, we found predictive responses in the ventral midbrain and a part of ventral striatum (ventral putamen) that were related directly to subjects' actual behavioral preferences. These brain structures demonstrated divergent response profiles, with the ventral midbrain showing a linear response profile with preference, and the ventral striatum a bivalent response. These results provide insight into the neural mechanisms underlying human preference behavior.

Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

The temporal evolution of feedback gains rapidly update to task demands.

Recent theoretical frameworks such as optimal feedback control suggest that feedback gains should modulate throughout a movement and be tuned to task demands. Here we measured the visuomotor feedback gain throughout the course of movements made to "near" or "far" targets in human subjects. The visuomotor gain showed a systematic modulation over the time course of the reach, with the gain peaking at the middle of the movement and dropping rapidly as the target is approached. This modulation depends primarily on the proportion of the movement remaining, rather than hand position, suggesting that the modulation is sensitive to task demands. Model-predictive control suggests that the gains should be continuously recomputed throughout a movement. To test this, we investigated whether feedback gains update when the task goal is altered during a movement, that is when the target of the reach jumped. We measured the visuomotor gain either simultaneously with the jump or 100 ms after the jump. The visuomotor gain nonspecifically reduced for all target jumps when measured synchronously with the jump. However, the visuomotor gain 100 ms later showed an appropriate modulation for the revised task goal by increasing for jumps that increased the distance to the target and reducing for jumps that decreased the distance. We conclude that visuomotor feedback gain shows a temporal evolution related to task demands and that this evolution can be flexibly recomputed within 100 ms to accommodate online modifications to task goals.

Temporal Coherence of Chlorophyll a during a Spring Phytoplankton Bloom in Xiangxi Bay of Three-Gorges Reservoir, China

Algal bloom phenomenon was defined as "the rapid growth of one or more phytoplankton species which leads to a rapid increase in the biomass of phytoplankton", yet most estimates of temporal coherence are based on yearly or monthly sampling frequencies and little is known of how synchrony varies among phytoplankton or of the causes of temporal coherence during spring algal bloom. In this study, data of chlorophyll a and related environmental parameters were weekly gathered at 15 sampling sites in Xiangxi Bay of Three-Gorges Reservoir (TGR, China) to evaluate patterns of temporal coherence for phytoplankton during spring bloom and test if spatial heterogeneity of nutrient and inorganic suspended particles within a single ecosystem influences synchrony of spring phytoplankton dynamics. There is a clear spatial and temporal variation in chlorophyll a across Xiangxi Bay. The degree of temporal coherence for chlorophyll a between pairs of sites located in Xiangxi Bay ranged from -0.367 to 0.952 with mean and median values of 0.349 and 0.321, respectively. Low levels of temporal coherence were often detected among the three stretches of the bay (Down reach, middle reach and upper reach), while high levels of temporal coherence were often found within the same reach of the bay. The relative difference of DIN between pair sites was the strong predictor of temporal coherence for chlorophyll a in down and middle reach of the bay, while the relative difference in Anorganic Suspended Solids was the important factor regulating temporal coherence in middle and upper reach. Contrary to many studies, these results illustrate that, in a small geographic area (a single reservoir bay of approximately 25 km), spatial heterogeneity influence synchrony of phytoplankton dynamics during spring bloom and local processes may override the effects of regional processes or dispersal.

Temporal and Spatial Distributions of Rotifers in Xiangxi Bay of the Three Gorges Reservoir, China

From July 2003 to June 2005, investigations of rotifer temporal and spatial distributions were carried out in a bay of the Three Gorges Reservoir, Xiangxi Bay, which is the downstream segment of the Xiangxi River and the nearest bay to the Three Gorges Reservoir dam in Hubei Province, China. Thirteen sampling sites were selected. The results revealed a high species diversity, with 76 species, and 14 dominant species; i.e., Polyarthra vulgaris, Keratella cochlearis, Keratella valga, Synchaeta tremula, Synchaeta stylata, Trichocerca lophoessa, Trichocerca pusilla, Brachionus angularis, Brachionus calyciflorus, Brachionus forficula forficula, Ascomorpha ovalis, Conochilus unicornis, Ploesoma truncatum and Anuraeopsis fissa. After the first year of the reservoir impoundment, the rotifer community was dominated by ten species; one year later it was dominated by eight species. The community in 2003/2004 was dissimilar to that in 2004/2005, which resulted from the succession of the dominant species. The rotifer community exhibited a patchy distribution, with significant heterogeneity observed along the longitudinal axis. All rotifer communities could be divided into three groups, corresponding to the riverine, the transition and the lacustrine zone, respectively.

Hydroacoustic study of spatial and temporal distribution of Gymnocypris przewalskii (Kessler, 1876) in Qinghai Lake, China

Gymnocypris przewalskii (Kessler 1876) is an endangered and state-protected rare fish species in Qinghai Lake, China. To further understand the life history and distribution of this fish, five surveys were carried out in Qinghai Lake between 2002-2006. Results of these surveys indicate that fishes were predominantly distributed about 2 m under the surface. In July, significant differences in fish density were found between surface and bottom layers (P = 0.001), and/or between middle and bottom layers (P = 0.025). Fish density was the greatest in the surface layer. In August and October, no significant differences were found between the different layers, but the bottom layer had a greater fish density. Furthermore, there were very large differences among different zones in fish distribution density. Differences in horizontal distribution were not significantly correlated to factors such as water depth and inshore distance, possibly because of very low and uniform fish density. Feeding, changes in water temperature, over-wintering and spawning appeared to influence fish distribution. Hydroacoustic estimates of G. przewalskii biomass in Qinghai Lake increased significantly between 2002 and 2006. We attribute this increase to the management measures put in place to protect this species.

Spatial and temporal variations of microcystins in hepatopancreas of a freshwater snail from Lake Taihu

In this paper, spatial and temporal variations of three common microcystins (MC-RR, MC-YR, and MC-LR) in the hepatopancreas of a freshwater snail (Bellamya aeruginosa) were studied monthly in two bays of Lake Taihu. Microcystins (MCs) concentration in hepatopancreas was quantified by liquid chromatography-mass spectrometry (LC-MS). The MCs concentrations in hepatopancreas were higher at Site 1 than those at other sites, which was in agreement with the changes of intracellular MCs concentrations in the water column. There was a significant correlation between MCs concentrations in the hepatopancreas and that in the seston, suggesting that spatial variances of MCs; concentrations in hepatopancreas among the five sites were due to spatial changes of toxic Microcystis cells in the water column. PCCA indicates that in addition to Microcystis, other factors (e.g., water temperature) also substantially affected the accumulation of MCs in hepatopancreas of the snail. (C) 2008 Published by Elsevier Inc.

A trichordal temporal approach to digital coordination: the sociomaterial mangling of the CERN grid

This paper develops a sociomaterial perspective on digital coordination. It extends Pickering’s mangle of practice by using a trichordal approach to temporal emergence. We provide new understanding as to how the nonhuman and human agencies involved in coordination are embedded in the past, present, and future. We draw on an in-depth field study conducted between 2006 and 2010 of the development, introduction, and use of a computing grid infrastructure by the CERN particle physics community. Three coordination tensions are identified at different temporal dimensions, namelyobtaining adequate transparency in the present, modeling a future infrastructure, and the historical disciplining of social and material inertias. We propose and develop the concept of digital coordination, and contribute a trichordal temporal approach to understanding the development and use of digital infrastructure as being orientated to the past and future while emerging in the present.

Temporal and spatial variations in the species composition, distribution, and abundance of protozoa in East Dongting lake, China

Investigations of protozoa were carried out during four surveys of East Dongting Lake, China. A total of 160 protozoan species belonging to 71 genera was identified, of which 53 were flagellates, 37 sarcodines, and 70 ciliates. Among them, Peritrichida (32.6% of frequency), Arcellinida (16.2%), Volvocales (13.61/6), Peridiniales (13.1%), and Chrysomonadales (9.1%) were the main groups and contributed to 84.5% of the overall species. Ciliates were mainly composed of sessile species and small species. The total protozoan abundance varied from 2,400 cells L-1 to 20,250 cells L-1. The highest protozoan abundance occurred in spring; the lowest number was in autumn. The highest abundance of ciliates occurred in spring and winter, whereas flagellates developed the highest abundance in,summer and autumn. Pearson correlation analysis and linear regressions indicated that chlorophyll a and water velocity were the main factors affecting ternporal and spatial variations of the protozoan abundance.

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.

Food composition and dietary overlap of macroinvertebrates in a shallow eutrophic lake in China: spatial and temporal variations

The present study was conducted in Lake Donghu, a suburban eutrophic lake arising from the middle reaches of the Yangtze River, China. Food composition of 32 taxa of zoobenthos was analyzed from 1251 gut samples. Macroinvertebrate primary consumers ingested mainly detritus, sand grains and diatoms. The predators primarily preyed on rotifers, crustaceans, oligochaetes and chironomid larvae. The dietary overlap was relatively high among collector taxa but low among other macroinvertebrates. Food composition and dietary overlap of macroinvertebrates changed considerably, both spatially and temporally. Food web structure differed between inshore and offshore regions of Lake Donghu. The inshore web was relatively complex and dynamic whereas the offshore web was simple and stable. Taxon-specific changes of diet seem to have little effect on the benthic food web structure in offshore waters of a eutrophic lake.

Studies on temporal and spatial variations of phytoplankton in Lake Chaohu

Temporal and spatial variations of the phytoplankton assemblage in Lake Chaohu, a large shallow eutrophic lake in China, were studied from September 2002 to August 2003. A total of 191 phytoplankton species was identified, among which Chlorophytes (101) ranked the first, followed by Cyanophytes (46) and Bacillariophytes (28). On average over the entire lake, the maximum total algal biomass appeared in June (19.70 mg/L) with a minimum (5.05 mg/ L) in November. In terms of annual mean biomass, cyanobacteria contributed 45.43% to total algal biomass, followed by Chlorophytes (27.14%), and Bacillariophytes (20.6%). When nitrate (NO3-N) and ammonium (NH4-N) concentrations dropped in spring, fixing-nitrogen cyanobacterium (Anabaena) developed quickly and ranked the first in terms of biomass in summer. It is likely that dominance of zooplanktivorous fish and small crustacean zooplankton favored the development of the inedible filamentous or colony forming cyanobacteria. The persistent dominance of cyanobacteria throughout all seasons may indicate a new tendency of the response of phytoplankton to eutrophication in Lake Chaohu.

The co-evolutionary relationship between bitterling fishes and freshwater mussels: insights from interspecific comparisons

Hypothesis: In parasites that use hosts for offspring development, adults may base oviposition decisions on a range of host traits related either to host quality or the co-evolutionary relationship between parasite and host. We examined whether host quality or co-evolutionary dynamics drive the use of hosts in the bitterling-mussel relationship. Organisms: Six species of bitterling fish (Acheilognathinae) and eight species of freshwater mussels (Unionidae, Corbiculidae) that are used by bitterling for oviposition. Site of experiments: Experimental tanks in Wuhan, China, at the site of the natural distribution of the studied species. Methods: Three experiments that controlled for host accessibility and interspecific interactions were conducted to identify host preferences among bitterling fishes and their mussel hosts. We started with a broad interspecific comparison. We then tested bitterling behavioural choices, their temporal stability, and mussel host ejection behaviour of the eggs of generalist and specialist bitterling species. Finally, we measured host mussel quality based on respiration rate and used published studies on mussel gill structure to infer mussel suitability as hosts for bitterling eggs. Results: We found significant interspecific differences among bitterling species in their use of mussel hosts. Bitterling species varied in their level of host specificity and identity of preferred hosts. Host preferences were flexible even among apparently specialized species and fishes switched their preferences adaptively when the quality of individuals of preferred host species declined. Mussels varied considerably in their response to oviposition through egg ejections. Host preference by a generalist bitterling species correlated positively with host quality measured as the efficiency of the mussel gills to extract oxygen from inhaled water. Host ability to eject bitterling eggs correlated positively with their relative respiration rate, probably due to a higher velocity of water circulating in the mussel gill chamber.

The temporal and spatial distribution, composition and abundance of Protozoa in Chaohu Lake, China: Relationship with eutrophication

Systematic investigations into the temporal and spatial distribution, composition and abundance of protozoa in two regions with different trophic levels in Chaohu Lake, a large, shallow and highly eutrophic freshwater lake in China, were conducted during 2002-2003. A total of 114 species of protozoa, including phytomastigophorans, zoomastigophorans, amoebae and ciliates, were identified from 120 polyurethane foam unit (PFU) samples exposed at four stations and from various types of natural substrates. Of the 114 taxa, 36 core species were found on PFU substrates and 23 of these were found on natural ones. Protozoan abundance and chemical physical parameters at nine sampling stations, four in the western lake and five in the eastern part, indicate trophic gradient changes along the lake. Seasonal variations in the species composition of major groups at littoral PFU sampling stations illustrate the effect of a severe algal bloom on the protozoan community structure. Temporal and spatial distributions of individual abundance as functions of water temperature and trophic status were revealed. This study demonstrates again that the PFU artificial substrate method samples protozoan communities more effectively than routine natural substrate methods. (c) 2005 Elsevier GmbH. All rights reserved.

Temporal and spatial variations in kinetics of alkaline phosphatase in sediments of a shallow Chinese eutrophic lake (Lake Donghu)

Monthly sediment and interstitial water samples were collected in a shallow Chinese freshwater lake (Lake Donghu) from three areas to determine if alkaline phosphatase activity (APA) plays an important role in phosphorus cycling in sediment. The seasonal variability in the kinetics of APA and other relevant parameters were investigated from 1995-1996. The phosphatase hydrolyzable phosphorus (PHP) fluctuated seasonally in interstitial water, peaking in the spring. A synchronous pattern was observed in chlorophyll a contents in surface water in general. The orthophosphate (o-P) concentrations in the interstitial water increased during the spring. An expected negative relationship between PHP and V-max of APA is not evident in interstitial water. The most striking feature of the two variables is their co-occurring, which can be explained in terms of an induction mechanism. It is argued that phosphatase activity mainly contributes to the driving force of o-P regeneration from PHP in interstitial water, supporting the development of phytoplankton biomass in spring. The V-max values in sediment increased during the summer, in Conjunction with lower K-m values in interstitial water that suggest a higher affinity for the substrate. The accumulation of organic matter in the sediment could be traced back to the breakdown of the algal spring bloom, which may stimulate APA with higher kinetic efficiency, by a combination of the higher V-max in sediments plus lower K-m values in interstitial water, in Summer. In summary, a focus On phosphatase and its substrate in annual scale may provide a useful framework for the development of novel P cycling, possible explanations for the absence of a clear relationship between PHP and APA were PHP released from the sediment which induced APA, and the presence of kinetically higher APA both in sediment and interstitial water which permitted summer mineralization of organic matter derived from the spring bloom to occur. The study highlighted the need for distinguishing functionally distinct extracellular enzymes between the sediment and interstitial water of lakes. (C) 2002 Elsevier Science Ltd. All rights reserved.