Effects of the user model on simulation-based learning of dialogue strategies

Over the past decade, a variety of user models have been proposed for user simulation-based reinforcement-learning of dialogue strategies. However, the strategies learned with these models are rarely evaluated in actual user trials and it remains unclear how the choice of user model affects the quality of the learned strategy. In particular, the degree to which strategies learned with a user model generalise to real user populations has not be investigated. This paper presents a series of experiments that qualitatively and quantitatively examine the effect of the user model on the learned strategy. Our results show that the performance and characteristics of the strategy are in fact highly dependent on the user model. Furthermore, a policy trained with a poor user model may appear to perform well when tested with the same model, but fail when tested with a more sophisticated user model. This raises significant doubts about the current practice of learning and evaluating strategies with the same user model. The paper further investigates a new technique for testing and comparing strategies directly on real human-machine dialogues, thereby avoiding any evaluation bias introduced by the user model. © 2005 IEEE.

Deficits in sensory prediction are related to delusional ideation in healthy individuals.

Motor control strongly relies on neural processes that predict the sensory consequences of self-generated actions. Previous research has demonstrated deficits in such sensory-predictive processes in schizophrenic patients and these low-level deficits are thought to contribute to the emergence of delusions of control. Here, we examined the extent to which individual differences in sensory prediction are associated with a tendency towards delusional ideation in healthy participants. We used a force-matching task to quantify sensory-predictive processes, and administered questionnaires to assess schizotypy and delusion-like thinking. Individuals with higher levels of delusional ideation showed more accurate force matching suggesting that such thinking is associated with a reduced tendency to predict and attenuate the sensory consequences of self-generated actions. These results suggest that deficits in sensory prediction in schizophrenia are not simply consequences of the deluded state and are not related to neuroleptic medication. Rather they appear to be stable, trait-like characteristics of an individual, a finding that has important implications for our understanding of the neurocognitive basis of delusions.

Instability in threshold voltage and subthreshold behavior in Hf-In-Zn-O thin film transistors induced by bias-and light-stress

Electrical bias and light stressing followed by natural recovery of amorphous hafnium-indium-zinc-oxide (HIZO) thin film transistors with a silicon oxide/nitride dielectric stack reveals defect density changes, charge trapping and persistent photoconductivity (PPC). In the absence of light, the polarity of bias stress controls the magnitude and direction of the threshold voltage shift (Δ VT), while under light stress, VT consistently shifts negatively. In all cases, there was no significant change in field-effect mobility. Light stress gives rise to a PPC with wavelength-dependent recovery on time scale of days. We observe that the PPC becomes more pronounced at shorter wavelengths. © 2010 American Institute of Physics.