Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.

Breathers and thermal relaxation as a temporal process: A possible way to detect breathers in experimental situations

Breather stability and longevity in thermally relaxing nonlinear arrays is investigated under the scrutiny of the analysis and tools employed for time series and state reconstruction of a dynamical system. We briefly review the methods used in the analysis and characterize a breather in terms of the results obtained with such methods. Our present work focuses on spontaneously appearing breathers in thermal Fermi-Pasta-Ulam arrays but we believe that the conclusions are general enough to describe many other related situations; the particular case described in detail is presented as another example of systems where three incommensurable frequencies dominate their chaotic dynamics (reminiscent of the Ruelle-Takens scenario for the appearance of chaotic behavior in nonlinear systems). This characterization may also be of great help for the discovery of breathers in experimental situations where the temporal evolution of a local variable (like the site energy) is the only available/measured data. © 2005 American Institute of Physics.

Internal representations of temporal statistics and feedback calibrate motor-sensory interval timing.

Humans have been shown to adapt to the temporal statistics of timing tasks so as to optimize the accuracy of their responses, in agreement with the predictions of Bayesian integration. This suggests that they build an internal representation of both the experimentally imposed distribution of time intervals (the prior) and of the error (the loss function). The responses of a Bayesian ideal observer depend crucially on these internal representations, which have only been previously studied for simple distributions. To study the nature of these representations we asked subjects to reproduce time intervals drawn from underlying temporal distributions of varying complexity, from uniform to highly skewed or bimodal while also varying the error mapping that determined the performance feedback. Interval reproduction times were affected by both the distribution and feedback, in good agreement with a performance-optimizing Bayesian observer and actor model. Bayesian model comparison highlighted that subjects were integrating the provided feedback and represented the experimental distribution with a smoothed approximation. A nonparametric reconstruction of the subjective priors from the data shows that they are generally in agreement with the true distributions up to third-order moments, but with systematically heavier tails. In particular, higher-order statistical features (kurtosis, multimodality) seem much harder to acquire. Our findings suggest that humans have only minor constraints on learning lower-order statistical properties of unimodal (including peaked and skewed) distributions of time intervals under the guidance of corrective feedback, and that their behavior is well explained by Bayesian decision theory.

Density control of ZnO nanowires grown using Au-PMMA nanoparticles and their growth behavior.

Au nanoparticles stabilized by poly(methyl methacrylate) (PMMA) were used as a catalyst to grow vertically aligned ZnO nanowires (NWs). The density of ZnO NWs with very uniform diameter was controlled by changing the concentration of Au-PMMA nanoparticles (NPs). The density was in direct proportion to the concentration of Au-PMMA NPs. Furthermore, the growth process of ZnO NWs using Au-PMMA NPs was systematically investigated through comparison with that using Au thin film as a catalyst. Au-PMMA NPs induced polyhedral-shaped bases of ZnO NWs separated from each other, while Au thin film formed a continuous network of bases of ZnO NWs. This approach provides a facile and cost-effective catalyst density control method, allowing us to grow high-quality vertically aligned ZnO NWs suitable for many viable applications.

Simulating dynamic covariance structures for testing the adaptive behavior of variable selection algorithms (Invited Paper)

Variable selection for regression is a classical statistical problem, motivated by concerns that too large a number of covariates may bring about overfitting and unnecessarily high measurement costs. Novel difficulties arise in streaming contexts, where the correlation structure of the process may be drifting, in which case it must be constantly tracked so that selections may be revised accordingly. A particularly interesting phenomenon is that non-selected covariates become missing variables, inducing bias on subsequent decisions. This raises an intricate exploration-exploitation tradeoff, whose dependence on the covariance tracking algorithm and the choice of variable selection scheme is too complex to be dealt with analytically. We hence capitalise on the strength of simulations to explore this problem, taking the opportunity to tackle the difficult task of simulating dynamic correlation structures. © 2008 IEEE.

Strong flexoelectric behavior in bimesogenic liquid crystals

In this paper, we demonstrate strong flexoelectric coupling in bimesogenic liquid crystals. This strong coupling is determined via the flexoelectro-optic effect in chiral nematic liquid crystals based on bimesogenic mixtures that are doped with low concentrations of high twisting power chiral additive. Two mixtures were examined: one had a pitch length of p∼300nm, the other had a pitch length of p∼600nm. These mixtures exhibit enantiotropic chiral nematic phases close to room temperature. We found that full-intensity modulation, that is, a rotation of the optic axis of 45° between crossed polarizers, could be achieved at significantly lower applied electric fields (E<5Vμm -1) than previously reported. In fact, for the condition of full-intensity modulation, the lowest electric-field strength recorded was E=2Vμm-1. As a result of a combination of the strong flexoelectric coupling and a divergence in the pitch, tilt angles of the optic axis up to 87°, i.e., a rotation of the optic axis through 174°, were observed. Furthermore, the flexoelastic ratios, which may be considered as a figure-of-merit parameter, were calculated from the results and found to be large, ranging from 1.3to2C/Nm for a temperature range of up to 40°C. © 2006 American Institute of Physics.

Instability in threshold voltage and subthreshold behavior in Hf-In-Zn-O thin film transistors induced by bias-and light-stress

Electrical bias and light stressing followed by natural recovery of amorphous hafnium-indium-zinc-oxide (HIZO) thin film transistors with a silicon oxide/nitride dielectric stack reveals defect density changes, charge trapping and persistent photoconductivity (PPC). In the absence of light, the polarity of bias stress controls the magnitude and direction of the threshold voltage shift (Δ VT), while under light stress, VT consistently shifts negatively. In all cases, there was no significant change in field-effect mobility. Light stress gives rise to a PPC with wavelength-dependent recovery on time scale of days. We observe that the PPC becomes more pronounced at shorter wavelengths. © 2010 American Institute of Physics.