On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

Characterisation and fluidisation of synthetic pit latrine sludge

Half of the world’s urban population will live in informal settlements or “slums” by 2030. Affordable urban sanitation presents a unique set of challenges as the lack of space and resources to construct new latrines makes the de-sludging of existing pits necessary and is something that is currently done manually with significant associated health risks. Therefore various mechanised technologies have been developed to facilitate pit emptying, with the majority using a vacuum system to remove material from the top of the pit. However, this results in the gradual accumulation of unpumpable sludge in the pit, which eventually fills the latrine and forces it to be abandoned. This study has developed a method for fluidising unpumpable pit latrine sludge, based on laboratory experiments using a harmless synthetic sludge. Such a sludge consisting of clay and compost was developed to replicate the physical characteristics of pit latrine sludges characterised in Botswana during the 1980s. Undrained shear strength and density are identified as the critical parameters in controlling pumpability and a method of sludge characterisation based on these parameters is reported. In a series of fluidisation tests using a one fifth scale pit emptying device the reduction in sludge shear strength was found to be caused by i) dilution, which increases water content, and ii) remoulding, which involves mechanical agitation to break down the structure of the material. The tests demonstrated that even the strongest of sludges could be rendered “pumpable” by sufficient dilution. Additionally, air injection alone produced a three-fold decrease in strength of consolidated samples as a result of remoulding at constant water content. The implications for sludge treatment and disposal are discussed, and the classification of sludges according to the equipment required to remove them from the latrine is proposed. Possible field tests to estimate sludge density and shear strength are suggested. The feasibility of using low cost vacuum cleaners to replace expensive vane pumps is demonstrated. This offers great potential for the development of affordable pit emptying technologies that can remove significantly stronger sludges than current devices through fluidising the wastes at the bottom of the pit before emptying

Spoken Dialog Challenge 2010: Comparison of live and control test results

The Spoken Dialog Challenge 2010 was an exercise to investigate how different spoken dialog systems perform on the same task. The existing Let's Go Pittsburgh Bus Information System was used as a task and four teams provided systems that were first tested in controlled conditions with speech researchers as users. The three most stable systems were then deployed to real callers. This paper presents the results of the live tests, and compares them with the control test results. Results show considerable variation both between systems and between the control and live tests. Interestingly, relatively high task completion for controlled tests did not always predict relatively high task completion for live tests. Moreover, even though the systems were quite different in their designs, we saw very similar correlations between word error rate and task completion for all the systems. The dialog data collected is available to the research community. © 2011 Association for Computational Linguistics.

Improvements to Concrete Column Detection in Live Video

The automated detection of structural elements (e.g. concrete columns) in visual data is useful in many construction and maintenance applications. The research in this area is under initial investigation. The authors previously presented a concrete column detection method that utilized boundary and color information as detection cues. However, the method is sensitive to parameter selection, which reduces its ability to robustly detect concrete columns in live videos. Compared against the previous method, the new method presented in this paper reduces the reliance of parameter settings mainly in three aspects. First, edges are located using color information. Secondly, the orientation information of edge points is considered in constructing column boundaries. Thirdly, an artificial neural network for concrete material classification is developed to replace concrete sample matching. The method is tested using live videos, and results are compared with the results obtained with the previous method to demonstrate the new method improvements.

Live Attenuated S. Typhimurium Vaccine with Improved Safety in Immuno-Compromised Mice

Live attenuated vaccines are of great value for preventing infectious diseases. They represent a delicate compromise between sufficient colonization-mediated adaptive immunity and minimizing the risk for infection by the vaccine strain itself. Immune defects can predispose to vaccine strain infections. It has remained unclear whether vaccine safety could be improved via mutations attenuating a vaccine in immune-deficient individuals without compromising the vaccine's performance in the normal host. We have addressed this hypothesis using a mouse model for Salmonella diarrhea and a live attenuated Salmonella Typhimurium strain (ssaV). Vaccination with this strain elicited protective immunity in wild type mice, but a fatal systemic infection in immune-deficient cybb-/-nos2-/- animals lacking NADPH oxidase and inducible NO synthase. In cybb-/-nos2-/- mice, we analyzed the attenuation of 35 ssaV strains carrying one additional mutation each. One strain, Z234 (ssaV SL1344_3093), was >1000-fold attenuated in cybb-/-nos2-/- mice and ≈100 fold attenuated in tnfr1-/- animals. However, in wt mice, Z234 was as efficient as ssaV with respect to host colonization and the elicitation of a protective, O-antigen specific mucosal secretory IgA (sIgA) response. These data suggest that it is possible to engineer live attenuated vaccines which are specifically attenuated in immuno-compromised hosts. This might help to improve vaccine safety. © 2012 Periaswamy et al.

Half-bridge SIC inverter for hybrid electric vehicles: Design, development and testing at higher operating temperature

In recent years, Silicon Carbide (SiC) semiconductor devices have shown promise for high density power electronic applications, due to their electrical and thermal properties. In this paper, the performance of SiC JFETs for hybrid electric vehicle (HEV) applications is investigated at heatsink temperatures of 100 °C. The thermal runaway characteristics, maximum current density and packaging temperature limitations of the devices are considered and the efficiency implications discussed. To quantify the power density capabilities of power transistors, a novel 'expression of rating' (EoR) is proposed. A prototype single phase, half-bridge voltage source inverter using SiC JFETs is also tested and its performance at 25 °C and 100 °C investigated.

Characterisation and fluidisation of synthetic pit latrine sludge

Half of the world's urban population will live in informal settlements or ‘slums’ by 2030. Affordable urban sanitation presents a unique set of challenges as the lack of space and resources to construct new latrines makes the de-sludging of existing pits necessary and is something that is currently done manually with significant associated health risks. Various mechanised technologies have therefore been developed to facilitate pit emptying, with the majority using a vacuum system to remove material from the top of the pit. However, this results in the gradual accumulation of unpumpable sludge at the bottom of the pit, which eventually fills the latrine and forces it to be abandoned. This study has developed a method for fluidising unpumpable pit latrine sludge, based on laboratory experiments using a harmless synthetic sludge. The implications for sludge treatment and disposal are discussed, and the classification of sludges according to the equipment required to remove them from the latrine is proposed. Finally, further work is suggested, including the ongoing development of a device to physically characterise latrine sludge in-situ within the pit.

Shrinkage of Gobiocypris rarus, Procypris rabaudi, and Sinilabeo rendahli preserved in formalin

Length measurements of preserved fishes are necessary in many types of fish surveys because logistics often do not allow for fish measurement immediately after catch. If the fixative causes significant shrinkage, then the preserved lengths cannot be directly used to indicate accurate live lengths. The objective of this study was to determine how preservation in formalin affects standard length of Gobiocypris rarus larvae (24-day-old and newly hatched), larval Procypris rabaudi (4-day-old), and larval Sinilabeo rendahli (12-day-old). Fishes were measured (to nearest 0.01 mm) and individually fixed in the appropriate formalin solution (2.5% or 5.0% formalin), then re-measured at 0.5, 1, 3, 7, 14, 30, 45 and 75 days after preservation to follow the time course of shrinkage. Most of the shrinkage occurred within the first half day after preservation. The 5.0% formalin caused a higher relative shrinkage rate than did the 2.5% solution; however, the difference was not statistically significant. In G. rarus, initial shrinkage of newly hatched larvae was higher than that of 24-day-old larvae.

Effects of live food and formulated diets on survival, growth and protein content of first-feeding larvae of Plelteobagrus fulvidraco

In recent years, much progress has been made in the rearing of fish larvae fed only artificial diets. A preliminary study was made in an attempt to evaluate the effects of live food and formulated diets on survival, growth and body protein content of first-feeding larvae of Plelteobagrus fulvidraco. Three test diets varying in protein level were formulated: Feed 1 containing 45% protein, Feed 2 with 50% protein and Feed 3 with 55% protein. Larvae fed live food (newly hatched Artemia, unenriched) were the control. The experiment started 3 days post-hatch and lasted for 23 days. At the end of the 23-day trial, survival was best in the control group (65.6%) whereby the final body weight and specific growth rate (SGR) were significantly lower than those in the test feed groups. At the same time, coefficients of variation for SGR and final body weight in the test groups were significantly higher than those in the control. Whole body protein content in all treatments showed a similar tendency during development: significantly higher 3 days post-hatch, then decreasing significantly, and then increasing unstatistically 10 days post-hatch. All results suggest that live food is still better for first-feeding larvae of P. fulvidraco, since live food leads to healthier larvae growth.

Growth of juvenile Chinese sturgeon Acipenser sinensis fed live and formulated diets

Triplicate groups of 3.8-g juvenile Chinese sturgeon Acipenser sinensis were reared for 8 weeks in indoor flow-through systems on one of four diets: a natural diet consisting solely of live tubificid worms, a semimoist practical diet, a dry practical diet, and a purified diet. The formulated diets were prepared in the laboratory and had protein contents of 47-50%. Except for the group fed the purified diet, fish showed high survival (94-96%) and growth (final weight, 41-45 g). Survival and specific growth rate did not differ significantly between groups fed the natural, semimoist, and dry practical diets, but were significantly (P < 0.05) lower in fish fed the purified diet. Proximate analysis showed that fish fed purified diet had lower protein and lipid levels but a higher moisture content than fish fed other diets. Our results demonstrated that growth and survival of cultured juvenile Chinese sturgeon fed practical diets were comparable with those fed live tubificid worms. However, Chinese sturgeon fed a purified diet showed inferior growth and survival.

DISORDER POINT FOR 2D ELECTRONS IN A HALF-FILLED LANDAU-LEVEL

Short-range correlations of two-dimensional electrons in a strong magnetic field are shown to be triangular in nature well below half-filling, but honeycomb well above half-filling. The half-filling point is thus proposed, and qualitatively confirmed by three-body correlation calculations, to be a new type of disorder point where short-range correlations change character. A wavefunction study also suggests that nodes become unbound at half-filling. Evidence for incompressibility but deformability of the half-filling state earlier suggested by Fano, Ortolani and Tosatti, is also presented and found to be in agreement with recent experiments.