Effective handling of dialogue state in the hidden information state POMDP-based dialogue manager

Effective dialogue management is critically dependent on the information that is encoded in the dialogue state. In order to deploy reinforcement learning for policy optimization, dialogue must be modeled as a Markov Decision Process. This requires that the dialogue statemust encode all relevent information obtained during the dialogue prior to that state. This can be achieved by combining the user goal, the dialogue history, and the last user action to form the dialogue state. In addition, to gain robustness to input errors, dialogue must be modeled as a Partially Observable Markov Decision Process (POMDP) and hence, a distribution over all possible states must be maintained at every dialogue turn. This poses a potential computational limitation since there can be a very large number of dialogue states. The Hidden Information State model provides a principled way of ensuring tractability in a POMDP-based dialogue model. The key feature of this model is the grouping of user goals into partitions that are dynamically built during the dialogue. In this article, we extend this model further to incorporate the notion of complements. This allows for a more complex user goal to be represented, and it enables an effective pruning technique to be implemented that preserves the overall system performance within a limited computational resource more effectively than existing approaches. © 2011 ACM.

A cost-effective atomic force microscope for undergraduate control laboratories

This paper presents a simple, cost-effective and robust atomic force microscope (AFM), which has been purposely designed and built for use as a teaching aid in undergraduate controls labs. The guiding design principle is to have all components be open and visible to the students, so the inner functioning of the microscope has been made clear to see. All of the parts but one are off the shelf, and assembly time is generally less than two days, which makes the microscope a robust instrument that is readily handled by the students with little chance of damage. While the scanning resolution is nowhere near that of a commercial instrument, it is more than sufficient to take interesting scans of micrometer-scale objects. A survey of students after their having used the AFM resulted in a generally good response, with 80% agreeing that they had a positive learning experience. © 2009 IEEE.

Permeability and stiffness of sands at very low effective stresses

Loose saturated sandy soils may undergo liquefaction under cyclic loading, generating positive excess pore pressures due to their contractile nature and inability to dissipate pore pressures rapidly during earthquake loading. These liquefied soils have a near-zero effective stress state, and hence have very low strength and stiffness, causing severe damage to structures founded upon them. The duration for which this near-zero effective stress state persists is a function of the rate of reconsolidation of the liquefied soil, which in turn is a function of the permeability and stiffness of the soil at this very low effective stress. Existing literature based on observation of physical model tests suggests that the consolidation coefficient C v associated with this reconsolidation of liquefied sand is significantly lower than that of the same soil at moderate stress levels. In this paper, the results of a series of novel fluidisation tests in which permeability k and coefficient of consolidation C v were independently measured will be presented. These results allow calculation of the variation of stiffness E 0 and permeability k with effective stress. It is shown that while permeability increases markedly at very low effective stresses, the simultaneous drop in stiffness measured results in a decrease in consolidation coefficient and hence an increase in the duration for which the soil remains liquefied.