Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

Transducer and base compliance alter the in situ 6 dof force measured from muscle during an isometric contraction in a multi-joint limb.

Although musculoskeletal models are commonly used, validating the muscle actions predicted by such models is often difficult. In situ isometric measurements are a possible solution. The base of the skeleton is immobilized and the endpoint of the limb is rigidly attached to a 6-axis force transducer. Individual muscles are stimulated and the resulting forces and moments recorded. Such analyses generally assume idealized conditions. In this study we have developed an analysis taking into account the compliances due to imperfect fixation of the skeleton, imperfect attachment of the force transducer, and extra degrees of freedom (dof) in the joints that sometimes become necessary in fixed end contractions. We use simulations of the rat hindlimb to illustrate the consequences of such compliances. We show that when the limb is overconstrained, i.e., when there are fewer dof within the limb than are restrained by the skeletal fixation, the compliances of the skeletal fixation and of the transducer attachment can significantly affect measured forces and moments. When the limb dofs and restrained dofs are matched, however, the measured forces and moments are independent of these compliances. We also show that this framework can be used to model limb dofs, so that rather than simply omitting dofs in which a limb does not move (e.g., abduction at the knee), the limited motion of the limb in these dofs can be more realistically modeled as a very low compliance. Finally, we discuss the practical implications of these results to experimental measurements of muscle actions.

Is titin a 'winding filament'? A new twist on muscle contraction.

Recent studies have demonstrated a role for the elastic protein titin in active muscle, but the mechanisms by which titin plays this role remain to be elucidated. In active muscle, Ca(2+)-binding has been shown to increase titin stiffness, but the observed increase is too small to explain the increased stiffness of parallel elastic elements upon muscle activation. We propose a 'winding filament' mechanism for titin's role in active muscle. First, we hypothesize that Ca(2+)-dependent binding of titin's N2A region to thin filaments increases titin stiffness by preventing low-force straightening of proximal immunoglobulin domains that occurs during passive stretch. This mechanism explains the difference in length dependence of force between skeletal myofibrils and cardiac myocytes. Second, we hypothesize that cross-bridges serve not only as motors that pull thin filaments towards the M-line, but also as rotors that wind titin on the thin filaments, storing elastic potential energy in PEVK during force development and active stretch. Energy stored during force development can be recovered during active shortening. The winding filament hypothesis accounts for force enhancement during stretch and force depression during shortening, and provides testable predictions that will encourage new directions for research on mechanisms of muscle contraction.

The temporal evolution of feedback gains rapidly update to task demands.

Recent theoretical frameworks such as optimal feedback control suggest that feedback gains should modulate throughout a movement and be tuned to task demands. Here we measured the visuomotor feedback gain throughout the course of movements made to "near" or "far" targets in human subjects. The visuomotor gain showed a systematic modulation over the time course of the reach, with the gain peaking at the middle of the movement and dropping rapidly as the target is approached. This modulation depends primarily on the proportion of the movement remaining, rather than hand position, suggesting that the modulation is sensitive to task demands. Model-predictive control suggests that the gains should be continuously recomputed throughout a movement. To test this, we investigated whether feedback gains update when the task goal is altered during a movement, that is when the target of the reach jumped. We measured the visuomotor gain either simultaneously with the jump or 100 ms after the jump. The visuomotor gain nonspecifically reduced for all target jumps when measured synchronously with the jump. However, the visuomotor gain 100 ms later showed an appropriate modulation for the revised task goal by increasing for jumps that increased the distance to the target and reducing for jumps that decreased the distance. We conclude that visuomotor feedback gain shows a temporal evolution related to task demands and that this evolution can be flexibly recomputed within 100 ms to accommodate online modifications to task goals.

Temporal Coherence of Chlorophyll a during a Spring Phytoplankton Bloom in Xiangxi Bay of Three-Gorges Reservoir, China

Algal bloom phenomenon was defined as "the rapid growth of one or more phytoplankton species which leads to a rapid increase in the biomass of phytoplankton", yet most estimates of temporal coherence are based on yearly or monthly sampling frequencies and little is known of how synchrony varies among phytoplankton or of the causes of temporal coherence during spring algal bloom. In this study, data of chlorophyll a and related environmental parameters were weekly gathered at 15 sampling sites in Xiangxi Bay of Three-Gorges Reservoir (TGR, China) to evaluate patterns of temporal coherence for phytoplankton during spring bloom and test if spatial heterogeneity of nutrient and inorganic suspended particles within a single ecosystem influences synchrony of spring phytoplankton dynamics. There is a clear spatial and temporal variation in chlorophyll a across Xiangxi Bay. The degree of temporal coherence for chlorophyll a between pairs of sites located in Xiangxi Bay ranged from -0.367 to 0.952 with mean and median values of 0.349 and 0.321, respectively. Low levels of temporal coherence were often detected among the three stretches of the bay (Down reach, middle reach and upper reach), while high levels of temporal coherence were often found within the same reach of the bay. The relative difference of DIN between pair sites was the strong predictor of temporal coherence for chlorophyll a in down and middle reach of the bay, while the relative difference in Anorganic Suspended Solids was the important factor regulating temporal coherence in middle and upper reach. Contrary to many studies, these results illustrate that, in a small geographic area (a single reservoir bay of approximately 25 km), spatial heterogeneity influence synchrony of phytoplankton dynamics during spring bloom and local processes may override the effects of regional processes or dispersal.

Cooperation of Mtmr8 with PI3K Regulates Actin Filament Modeling and Muscle Development in Zebrafish

Background: It has been shown that mutations in at least four myotubularin family genes (MTM1, MTMR1, 2 and 13) are causative for human neuromuscular disorders. However, the pathway and regulative mechanism remain unknown. Methodology/Principal Findings: Here, we reported a new role for Mtmr8 in neuromuscular development of zebrafish. Firstly, we cloned and characterized zebrafish Mtmr8, and revealed the expression pattern predominantly in the eye field and somites during early somitogenesis. Using morpholino knockdown, then, we observed that loss-of-function of Mtmr8 led to defects in somitogenesis. Subsequently, the possible underlying mechanism and signal pathway were examined. We first checked the Akt phosphorylation, and observed an increase of Akt phosphorylation in the morphant embryos. Furthermore, we studied the PH/G domain function within Mtmr8. Although the PH/G domain deletion by itself did not result in embryonic defect, addition of PI3K inhibitor LY294002 did give a defective phenotype in the PH/G deletion morphants, indicating that the PH/G domain was essential for Mtmr8's function. Moreover, we investigated the cooperation of Mtmr8 with PI3K in actin filament modeling and muscle development, and found that both Mtmr8-MO1 and Mtmr8-MO2+LY294002 led to the disorganization of the actin cytoskeleton. In addition, we revealed a possible participation of Mtmr8 in the Hedgehog pathway, and cell transplantation experiments showed that Mtmr8 worked in a non-cell autonomous manner in actin modeling. Conclusion/Significance: The above data indicate that a conserved functional cooperation of Mtmr8 with PI3K regulates actin filament modeling and muscle development in zebrafish, and reveal a possible participation of Mtmr8 in the Hedgehog pathway. Therefore, this work provides a new clue to study the physiological function of MTM family members.

Seasonal variations in stable isotope ratios of two biomanipulation fishes and seston in a large pen culture in hypereutrophic Meiliang Bay, Lake Taihu

This paper reports on seasonal changes in stable carbon and nitrogen isotope ratios of seston and muscle tissue of silver carp and bighead carp during 2004 and 2005, focusing primarily on the carbon sources and trophic relationships among phytoplankton, zooplankton and silver carp and bighead carp in a large fish pen of Meiliang Bay (Lake Taihu, China). delta C-13 showed a minimal value in March 2005 and a maximal value in August 2005 in seston both inside and outside the pen, whereas delta N-15 of seston showed the minimum in winter and the maximum during algal blooms. A positive correlation between delta C-13 of silver carp and that of seston suggested that temporal variation Of delta C-13 in seston was preserved in fish via the food chain. The differences of delta C-13 among seston, zooplankton and muscle tissue of silver carp and bighead carp ranged only 0.2-1.7%, indicating that plankton production was the primary food source of filter-feeding fishes. According to a mass balance model, we estimated that the contributions of zooplankton to the diets of silver carp and bighead carp were 45.7% and 54.3%, respectively, based on the delta N-15 values of zooplankton and planktivorous fishes. (C) 2007 Elsevier B.V. All rights reserved

Temporal and Spatial Distributions of Rotifers in Xiangxi Bay of the Three Gorges Reservoir, China

From July 2003 to June 2005, investigations of rotifer temporal and spatial distributions were carried out in a bay of the Three Gorges Reservoir, Xiangxi Bay, which is the downstream segment of the Xiangxi River and the nearest bay to the Three Gorges Reservoir dam in Hubei Province, China. Thirteen sampling sites were selected. The results revealed a high species diversity, with 76 species, and 14 dominant species; i.e., Polyarthra vulgaris, Keratella cochlearis, Keratella valga, Synchaeta tremula, Synchaeta stylata, Trichocerca lophoessa, Trichocerca pusilla, Brachionus angularis, Brachionus calyciflorus, Brachionus forficula forficula, Ascomorpha ovalis, Conochilus unicornis, Ploesoma truncatum and Anuraeopsis fissa. After the first year of the reservoir impoundment, the rotifer community was dominated by ten species; one year later it was dominated by eight species. The community in 2003/2004 was dissimilar to that in 2004/2005, which resulted from the succession of the dominant species. The rotifer community exhibited a patchy distribution, with significant heterogeneity observed along the longitudinal axis. All rotifer communities could be divided into three groups, corresponding to the riverine, the transition and the lacustrine zone, respectively.

Characterization of the porcine differentially expressed PDK4 gene and association with meat quality

To investigate the differential expression of genes in the skeletal muscle between Yorkshire and Chinese indigenous breed Meishan pigs, suppression subtractive hybridization was carried out and many genes were proved to be expressed significantly different in the two breeds. One gene highly expressed in Meishan but lowly expressed in Yorkshire specific library, shared strong homology with human pyruvate dehydrogenase kinase 4 (PDK4). Using semi-quantity and quantity PCR, We confirmed its differential expression between the two breeds. Temporal and spatial expression analysis indicated that porcine PDK4 gene is highly expressed in skeletal muscle and the highest in neonatal pigs. Complete cDNA cloning and sequence analysis revealed that porcine PDK4 gene contains an open reading frame of 1,221 bp. The deduced amino acid sequence showed conservation in evolution. A G/A mutation in intron 9 was identified and association analysis showed that it was significantly associated with intramuscular fat, muscle water content.

Hydroacoustic study of spatial and temporal distribution of Gymnocypris przewalskii (Kessler, 1876) in Qinghai Lake, China

Gymnocypris przewalskii (Kessler 1876) is an endangered and state-protected rare fish species in Qinghai Lake, China. To further understand the life history and distribution of this fish, five surveys were carried out in Qinghai Lake between 2002-2006. Results of these surveys indicate that fishes were predominantly distributed about 2 m under the surface. In July, significant differences in fish density were found between surface and bottom layers (P = 0.001), and/or between middle and bottom layers (P = 0.025). Fish density was the greatest in the surface layer. In August and October, no significant differences were found between the different layers, but the bottom layer had a greater fish density. Furthermore, there were very large differences among different zones in fish distribution density. Differences in horizontal distribution were not significantly correlated to factors such as water depth and inshore distance, possibly because of very low and uniform fish density. Feeding, changes in water temperature, over-wintering and spawning appeared to influence fish distribution. Hydroacoustic estimates of G. przewalskii biomass in Qinghai Lake increased significantly between 2002 and 2006. We attribute this increase to the management measures put in place to protect this species.

Spatial and temporal variations of microcystins in hepatopancreas of a freshwater snail from Lake Taihu

In this paper, spatial and temporal variations of three common microcystins (MC-RR, MC-YR, and MC-LR) in the hepatopancreas of a freshwater snail (Bellamya aeruginosa) were studied monthly in two bays of Lake Taihu. Microcystins (MCs) concentration in hepatopancreas was quantified by liquid chromatography-mass spectrometry (LC-MS). The MCs concentrations in hepatopancreas were higher at Site 1 than those at other sites, which was in agreement with the changes of intracellular MCs concentrations in the water column. There was a significant correlation between MCs concentrations in the hepatopancreas and that in the seston, suggesting that spatial variances of MCs; concentrations in hepatopancreas among the five sites were due to spatial changes of toxic Microcystis cells in the water column. PCCA indicates that in addition to Microcystis, other factors (e.g., water temperature) also substantially affected the accumulation of MCs in hepatopancreas of the snail. (C) 2008 Published by Elsevier Inc.

A trichordal temporal approach to digital coordination: the sociomaterial mangling of the CERN grid

This paper develops a sociomaterial perspective on digital coordination. It extends Pickering’s mangle of practice by using a trichordal approach to temporal emergence. We provide new understanding as to how the nonhuman and human agencies involved in coordination are embedded in the past, present, and future. We draw on an in-depth field study conducted between 2006 and 2010 of the development, introduction, and use of a computing grid infrastructure by the CERN particle physics community. Three coordination tensions are identified at different temporal dimensions, namelyobtaining adequate transparency in the present, modeling a future infrastructure, and the historical disciplining of social and material inertias. We propose and develop the concept of digital coordination, and contribute a trichordal temporal approach to understanding the development and use of digital infrastructure as being orientated to the past and future while emerging in the present.

Analysis of heavy metals of muscle and intestine tissue in fish - in Banan section of Chongqing from Three Gorges Reservoir, China

The present study was carried out to investigate contamination of heavy metals in 19 fish species from the Banan section of Chongqing in the Three Gorges, Yangtze River. The results showed that the mean concentrations of heavy metals were higher in intestine than muscle, except zinc in upper strata. In the fish inhabiting the upper strata, there were significant differences between mean concentrations of As, Cr, Cu and Hg in muscle and intestine (P <0.05). There were also significant differences between mean concentrations of Cr and Cu in muscle and intestine in the fish inhabiting middle strata. However, significant differences between mean concentrations of As, Cd, Hg, Pb and Zn were measured in fish inhabiting bottom strata in both intestine and muscle tissues (P <0.05). For the fish inhabiting different strata, the concentrations of As, Cd, Cr, Cu, Hg and Ph in muscle and intestine of the fish from bottom strata (BS) were higher than those in both upper strata (US) and middle strata (MS); whereas a higher concentration of Zn was measured in muscle and intestine from fish inhabiting upper strata. Mean metal concentrations were found to be higher in age 11 than those in age I in Coreius heterodon (2- and 1-year odl fish respectively). The overall results indicated that fish muscle in the Banan section were slightly contaminated by heavy metals, but did not exceed Chinese food standards.

Temporal and spatial variations in the species composition, distribution, and abundance of protozoa in East Dongting lake, China

Investigations of protozoa were carried out during four surveys of East Dongting Lake, China. A total of 160 protozoan species belonging to 71 genera was identified, of which 53 were flagellates, 37 sarcodines, and 70 ciliates. Among them, Peritrichida (32.6% of frequency), Arcellinida (16.2%), Volvocales (13.61/6), Peridiniales (13.1%), and Chrysomonadales (9.1%) were the main groups and contributed to 84.5% of the overall species. Ciliates were mainly composed of sessile species and small species. The total protozoan abundance varied from 2,400 cells L-1 to 20,250 cells L-1. The highest protozoan abundance occurred in spring; the lowest number was in autumn. The highest abundance of ciliates occurred in spring and winter, whereas flagellates developed the highest abundance in,summer and autumn. Pearson correlation analysis and linear regressions indicated that chlorophyll a and water velocity were the main factors affecting ternporal and spatial variations of the protozoan abundance.

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.