Differentiable neural substrates for learned and described value and risk.

Studies of human decision making emerge from two dominant traditions: learning theorists [1-3] study choices in which options are evaluated on the basis of experience, whereas behavioral economists and financial decision theorists study choices in which the key decision variables are explicitly stated. Growing behavioral evidence suggests that valuation based on these different classes of information involves separable mechanisms [4-8], but the relevant neuronal substrates are unknown. This is important for understanding the all-too-common situation in which choices must be made between alternatives that involve one or another kind of information. We studied behavior and brain activity while subjects made decisions between risky financial options, in which the associated utilities were either learned or explicitly described. We show a characteristic effect in subjects' behavior when comparing information acquired from experience with that acquired from description, suggesting that these kinds of information are treated differently. This behavioral effect was reflected neurally, and we show differential sensitivity to learned and described value and risk in brain regions commonly associated with reward processing. Our data indicate that, during decision making under risk, both behavior and the neural encoding of key decision variables are strongly influenced by the manner in which value information is presented.

The misbehavior of value and the discipline of the will.

Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

Kinetic modelling of growth and storage molecule production in microalgae under mixotrophic and autotrophic conditions.

In order to improve algal biofuel production on a commercial-scale, an understanding of algal growth and fuel molecule accumulation is essential. A mathematical model is presented that describes biomass growth and storage molecule (TAG lipid and starch) accumulation in the freshwater microalga Chlorella vulgaris, under mixotrophic and autotrophic conditions. Biomass growth was formulated based on the Droop model, while the storage molecule production was calculated based on the carbon balance within the algal cells incorporating carbon fixation via photosynthesis, organic carbon uptake and functional biomass growth. The model was validated with experimental growth data of C. vulgaris and was found to fit the data well. Sensitivity analysis showed that the model performance was highly sensitive to variations in parameters associated with nutrient factors, photosynthesis and light intensity. The maximum productivity and biomass concentration were achieved under mixotrophic nitrogen sufficient conditions, while the maximum storage content was obtained under mixotrophic nitrogen deficient conditions.

Kinetic modelling of growth and storage molecule production in microalgae under mixotrophic and autotrophic conditions

In order to improve algal biofuel production on a commercial-scale, an understanding of algal growth and fuel molecule accumulation is essential. A mathematical model is presented that describes biomass growth and storage molecule (TAG lipid and starch) accumulation in the freshwater microalga Chlorella vulgaris, under mixotrophic and autotrophic conditions. Biomass growth was formulated based on the Droop model, while the storage molecule production was calculated based on the carbon balance within the algal cells incorporating carbon fixation via photosynthesis, organic carbon uptake and functional biomass growth. The model was validated with experimental growth data of C. vulgaris and was found to fit the data well. Sensitivity analysis showed that the model performance was highly sensitive to variations in parameters associated with nutrient factors, photosynthesis and light intensity. The maximum productivity and biomass concentration were achieved under mixotrophic nitrogen sufficient conditions, while the maximum storage content was obtained under mixotrophic nitrogen deficient conditions. © 2014 Elsevier Ltd.