Model-based influences on humans' choices and striatal prediction errors.

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making.

Analysis of amorphous indium-gallium-zinc-oxide thin-film transistor contact metal using Pilling-Bedworth theory and a variable capacitance diode model

It is widely reported that threshold voltage and on-state current of amorphous indium-gallium-zinc-oxide bottom-gate thin-film transistors are strongly influenced by the choice of source/drain contact metal. Electrical characterisation of thin-film transistors indicates that the electrical properties depend on the type and thickness of the metal(s) used. Electron transport mechanisms and possibilities for control of the defect state density are discussed. Pilling-Bedworth theory for metal oxidation explains the interaction between contact metal and amorphous indium-gallium-zinc-oxide, which leads to significant trap formation. Charge trapping within these states leads to variable capacitance diode-like behavior and is shown to explain the thin-film transistor operation. © 2013 AIP Publishing LLC.

Bayesian updating of a unified soil compression model

Some amount of differential settlement occurs even in the most uniform soil deposit, but it is extremely difficult to estimate because of the natural heterogeneity of the soil. The compression response of the soil and its variability must be characterised in order to estimate the probability of the differential settlement exceeding a certain threshold value. The work presented in this paper introduces a probabilistic framework to address this issue in a rigorous manner, while preserving the format of a typical geotechnical settlement analysis. In order to avoid dealing with different approaches for each category of soil, a simplified unified compression model is used to characterise the nonlinear compression behavior of soils of varying gradation through a single constitutive law. The Bayesian updating rule is used to incorporate information from three different laboratory datasets in the computation of the statistics (estimates of the means and covariance matrix) of the compression model parameters, as well as of the uncertainty inherent in the model.

Modeling cyclic behavior of lightly overconsolidated clays in simple shear

Assessment of seismic performance and estimation of permanent displacements for submerged slopes require the accurate description of the soil's stress-strain-strength relationship under irregular cyclic loading. The geological profile of submerged slopes on the continental shelf typically consists of normally to lightly overconsolidated clays with depths ranging from a few meters to a few hundred meters and very low slope angles. This paper describes the formulation of a simplified effective-stress-based model, which is able to capture the key aspects of the cyclic behavior of normally consolidated clays. The proposed constitutive law incorporates anisotropic hardening and bounding surface principles to allow the user to simulate different shear strain and stress reversal histories as well as provide realistic descriptions of the accumulation of plastic shear strains and excess pore pressure during successive loading cycles. (C) 2000 Published by Elsevier Science Ltd. | Assessment of seismic performance and estimation of permanent displacements for submerged slopes require the accurate description of the soil's stress-strain-strength relationship under irregular cyclic loading. The geological profile of submerged slopes on the continental shelf typically consists of normally to lightly overconsolidated clays with depths ranging from a few meters to a few hundred meters and very low slope angles. This paper describes the formulation of a simplified effective-stress-based model, which is able to capture the key aspects of the cyclic behavior of normally consolidated clays. The proposed constitutive law incorporates anisotropic hardening and bounding surface principles to allow the user to simulate different shear strain and stress reversal histories as well as provide realistic descriptions of the accumulation of plastic shear strains and excess pore pressures during successive loading cycles.

Delayed control of a Moore-Greitzer axial compressor model

Several feedback control laws have appeared in the literature concerning the stabilization of the nonlinear Moore-Greitzer axial compression model. Motivated by magnitude and rate limitations imposed by the physical implementation of the control law, Larsen et al. studied a dynamic implementation of the S-controller suggested by Sepulchre and Kokotović. They showed the potential benefit of implementing the S-controller through a first-order lag: while the location of the closed-loop equilibrium achieved with the static control law was sensitive to poorly known parameters, the dynamic implementation resulted in a small limit cycle at a very desirable location, insensitive to parameter variations. In this paper, we investigate the more general case when the control is applied with a time delay. This can be seen as an extension of the model with a first-order lag. The delay can either be a result of system constraints or be deliberately implemented to achieve better system behavior. The resulting closed-loop system is a set of parameter-dependent delay differential equations. Numerical bifurcation analysis is used to study this model and investigate whether the positive results obtained for the first-order model persist, even for larger values of the delay.

Statistics anxiety, trait anxiety, learning behavior, and academic performance

The present study investigated the relationship between statistics anxiety, individual characteristics (e.g., trait anxiety and learning strategies), and academic performance. Students enrolled in a statistics course in psychology (N=147) filled in a questionnaire on statistics anxiety, trait anxiety, interest in statistics, mathematical selfconcept, learning strategies, and procrastination. Additionally, their performance in the examination was recorded. The structural equation model showed that statistics anxiety held a crucial role as the strongest direct predictor of performance. Students with higher statistics anxiety achieved less in the examination and showed higher procrastination scores. Statistics anxiety was related indirectly to spending less effort and time on learning. Trait anxiety was related positively to statistics anxiety and, counterintuitively, to academic performance. This result can be explained by the heterogeneity of the measure of trait anxiety. The part of trait anxiety that is unrelated to the specific part of statistics anxiety correlated positively with performance.

Generalized phenomenological model for the viscoelasticity of idealized asphalts

A generalized theory for the viscoelastic behavior of idealized bituminous mixtures (asphalts) is presented. The mathematical model incorporates strain rate and temperature dependency as well as nonmonotonic loading and unloading with shape recovery. The stiffening effect of the aggregate is included. The model is of phenomenological nature. It can be calibrated using a relatively limited set of experimental parameters, obtainable by uniaxial tests. It is shown that the mathematical model can be represented as a special nonlinear form of the Burgers model. This facilitates the derivation of numerical algorithms for solving the constitutive equations. A numerical scheme is implemented in a user material subroutine (UMAT) in the finite-element analysis (FEA) code ABAQUS. Simulation results are compared with uniaxial and indentation tests on an idealized asphalt mix. © 2014 American Society of Civil Engineers.

Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.

Behavior learning of a face robot based on the characteristics of human instruction

Computer simulation experiments were performed to examine the effectiveness of OR- and comparative-reinforcement learning algorithms. In the simulation, human rewards were given as +1 and -1. Two models of human instruction that determine which reward is to be given in every step of a human instruction were used. Results show that human instruction may have a possibility of including both model-A and model-B characteristics, and it can be expected that the comparative-reinforcement learning algorithm is more effective for learning by human instructions.