Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task. Copyright © 2011 ISCA.

A novel heavily doped drift-auxiliary cathode lateral insulated gate transistor structure

A novel CMOS-compatible, heavily doped drift auxiliary cathode lateral insulated gate transistor (HDD-ACLIGT) structure is analyzed using two-dimensional device simulation techniques. Simulation results indicate that low on-resistance and a fast turn-off time of less than 50 ns can be achieved by incorporating an additional n+ region which is self-aligned to the gate between the p+ auxiliary cathode and the p well, together with an extended p buried layer in an anode-shorted modified lateral insulated gate transistor (MLIGT) structure. The on-state and its transient performance are analyzed in detail. The on-state performances of the HDD-ACLIGT and the MLIGT are compared and discussed. The results indicate that the HDD-ACLIGT structure is well suited for HVICs. The device is also well suited for integration with self-aligned digital CMOS.

A novel method for rapid comparative quantitative analysis of nuclear fuel cycles

One of the greatest obstacles facing the nuclear industry is that of sustainability, both in terms of the finite reserves of uranium ore and the production of highly radiotoxic spent fuel which presents proliferation and environmental hazards. Alternative nuclear technologies have been suggested as a means of delivering enhanced sustainability with proposals including fast reactors, the use of thorium fuel and tiered fuel cycles. The debate as to which is the most appropriate technology continues, with each fuel system and reactor type delivering specific advantages and disadvantages which can be difficult to compare fairly. This paper demonstrates a framework of performance metrics which, coupled with a first-order lumped reactor model to determine nuclide population balances, can be used to quantify the aforementioned pros and cons for a range of different fuel and reactor combinations. The framework includes metrics such as fuel efficiency, spent fuel toxicity and proliferation resistance, and relative cycle performance is analysed through parallel coordinate plots, yielding a quantitative comparison of disparate cycles. © 2011 Elsevier Ltd. All rights reserved.

The effect of remodelling and contractility of the actin cytoskeleton on the shear resistance of single cells: a computational and experimental investigation.

The biomechanisms that govern the response of chondrocytes to mechanical stimuli are poorly understood. In this study, a series of in vitro tests are performed, in which single chondrocytes are subjected to shear deformation by a horizontally moving probe. Dramatically different probe force-indentation curves are obtained for untreated cells and for cells in which the actin cytoskeleton has been disrupted. Untreated cells exhibit a rapid increase in force upon probe contact followed by yielding behaviour. Cells in which the contractile actin cytoskeleton was removed exhibit a linear force-indentation response. In order to investigate the mechanisms underlying this behaviour, a three-dimensional active modelling framework incorporating stress fibre (SF) remodelling and contractility is used to simulate the in vitro tests. Simulations reveal that the characteristic force-indentation curve observed for untreated chondrocytes occurs as a result of two factors: (i) yielding of SFs due to stretching of the cytoplasm near the probe and (ii) dissociation of SFs due to reduced cytoplasm tension at the front of the cell. In contrast, a passive hyperelastic model predicts a linear force-indentation curve similar to that observed for cells in which the actin cytoskeleton has been disrupted. This combined modelling-experimental study offers a novel insight into the role of the active contractility and remodelling of the actin cytoskeleton in the response of chondrocytes to mechanical loading.

Long term peripheral nerve regeneration using a novel PCL nerve conduit.

The gold standard in surgical management of a peripheral nerve gap is currently autologous nerve grafting. This confers patient morbidity and increases surgical time therefore innovative experimental strategies towards engineering a synthetic nerve conduit are welcome. We have developed a novel synthetic conduit made of poly ε-caprolactone (PCL) that has demonstrated promising peripheral nerve regeneration in short-term studies. This material has been engineered to permit translation into clinical practice and here we demonstrate that histological outcomes in a long-term in vivo experiment are comparable with that of autologous nerve grafting. A 1cm nerve gap in a rat sciatic nerve injury model was repaired with a PCL nerve conduit or an autologous nerve graft. At 18 weeks post surgical repair, there was a similar volume of regenerating axons within the nerve autograft and PCL conduit repair groups, and similar numbers of myelinated axons in the distal stump of both groups. Furthermore, there was evidence of comparable re-innervation of end organ muscle and skin with the only significant difference the lower wet weight of the muscle from the PCL conduit nerve repair group. This study stimulates further work on the potential use of this synthetic biodegradable PCL nerve conduit in a clinical setting.

Novel nanostructured carbon nanotube electron sources

In this chapter, we present a review of our continuing efforts toward the development of discrete, low-dimensional nanostructured carbon-based electron emitters. Carbon nanotubes and nanofibers, herein referred to simply as CNTs, are one-dimensional carbon allotropes formed from cylindrically rolled and nested graphene sheets, have diameters between 1 and 500 nm and lengths of up to several millimeters, and are perfect candidates for field emission (FE) applications. By virtue of their extremely strong sp2 C-C bonding, intrinsic to the graphene hexagonal lattice, CNTs have demonstrated impressive chemical inertness, unprecedented thermal stabilities, significant resistance to electromigration, and exceptionally high axial current carrying capacities, even at elevated temperatures. These near ideal cold cathode electron emitters have incredibly high electric field enhancing aspect ratios combined with virtual point sources of the order of a few nanometers in size. The correct integration and judicious development of suitable FE platforms based on these extraordinary molecules is critical and will ultimately enable enhanced technologies. This chapter will review some of the more recent platforms, devices and structures developed by our group, as well as our contributions towards the development of industry-scalable technologies for ultra-high-resolution electron microscopy, portable x-ray sources, and flexible environmental lighting technologies. © 2012 by Pan Stanford Publishing Pte. Ltd. All rights reserved.