Temporal difference models describe higher-order learning in humans.

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.

Positive Correlations in Tunneling through coupled Quantum Dots

Due to the Fermi-Dirac statistics of electrons the temporal correlations of tunneling events in a double barrier setup are typically negative. Here, we investigate the shot noise behavior of a system of two capacitively coupled quantum dot states by means of a Master equation model. In an asymmetric setup positive correlations in the tunneling current can arise due to the bunching of tunneling events. The underlying mechanism will be discussed in detail in terms of the current-current correlation function and the frequency-dependent Fano factor.

The temporal evolution of feedback gains rapidly update to task demands.

Recent theoretical frameworks such as optimal feedback control suggest that feedback gains should modulate throughout a movement and be tuned to task demands. Here we measured the visuomotor feedback gain throughout the course of movements made to "near" or "far" targets in human subjects. The visuomotor gain showed a systematic modulation over the time course of the reach, with the gain peaking at the middle of the movement and dropping rapidly as the target is approached. This modulation depends primarily on the proportion of the movement remaining, rather than hand position, suggesting that the modulation is sensitive to task demands. Model-predictive control suggests that the gains should be continuously recomputed throughout a movement. To test this, we investigated whether feedback gains update when the task goal is altered during a movement, that is when the target of the reach jumped. We measured the visuomotor gain either simultaneously with the jump or 100 ms after the jump. The visuomotor gain nonspecifically reduced for all target jumps when measured synchronously with the jump. However, the visuomotor gain 100 ms later showed an appropriate modulation for the revised task goal by increasing for jumps that increased the distance to the target and reducing for jumps that decreased the distance. We conclude that visuomotor feedback gain shows a temporal evolution related to task demands and that this evolution can be flexibly recomputed within 100 ms to accommodate online modifications to task goals.

Updated correlation between aircraft smoke number and black carbon concentration

Aircraft emissions of black carbon (BC) contribute to anthropogenic climate forcing and degrade air quality. The smoke number (SN) is the current regulatory measure of aircraft particulate matter emissions and quantifies exhaust plume visibility. Several correlations between SN and the exhaust mass concentration of BC (CBC) have been developed, based on measurements relevant to older aircraft engines. These form the basis of the current standard method used to estimate aircraft BC emissions (First Order Approximation version 3 [FOA3]) for the purposes of environmental impact analyses. In this study, BC with a geometric mean diameter (GMD) of 20, 30, and 60 nm and filter diameters of 19 and 35 mm are used to investigate the effect of particle size and sampling variability on SN measurements. For BC with 20 and 30 nm GMD, corresponding to BC emitted by modern aircraft engines, a smaller SN results from a given CBC than is the case for BC with 60 nm GMD, which is more typical of older engines. An updated correlation between CBC and SNthat accounts for typical size of BC emitted by modern aircraft is proposed. An uncertainty of ±25% accounts for variation in GMD in the range 20-30 nm and for the range of filter diameters. The SN-CBC correlation currently used in FOA3 underestimates by a factor of 2.5-3 for SN <15, implying that current estimates of aircraft BC emissions derived from SN are underestimated by the same factor. Copyright © American Association for Aerosol Research.

MRI features of cellular angiomyofibroma with pathologic correlation.

Within the spectrum of extratesticular mesenchymal tumors in the scrotum and perineum lies cellular angiofibroma, also known as angiomyofibroblastoma-like tumor, a rare lesion originally described to almost exclusively occur in the vulva, perineum, and pelvis of women. We report a case of this tumor, with an adjacent scrotal lipoma, occurring in a 60-year-old male who presented to our department with a firm palpable scrotal mass. To our knowledge, the MRI findings of this entity have yet to be described in the radiological literature. We present the MRI features of cellular angiofibroma that are consistent with the pathological characteristics of this entity-a benign cellular and fibrous tumor with prominent vascularity.

A trichordal temporal approach to digital coordination: the sociomaterial mangling of the CERN grid

This paper develops a sociomaterial perspective on digital coordination. It extends Pickering’s mangle of practice by using a trichordal approach to temporal emergence. We provide new understanding as to how the nonhuman and human agencies involved in coordination are embedded in the past, present, and future. We draw on an in-depth field study conducted between 2006 and 2010 of the development, introduction, and use of a computing grid infrastructure by the CERN particle physics community. Three coordination tensions are identified at different temporal dimensions, namelyobtaining adequate transparency in the present, modeling a future infrastructure, and the historical disciplining of social and material inertias. We propose and develop the concept of digital coordination, and contribute a trichordal temporal approach to understanding the development and use of digital infrastructure as being orientated to the past and future while emerging in the present.

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.