On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

Spoken Dialog Challenge 2010: Comparison of live and control test results

The Spoken Dialog Challenge 2010 was an exercise to investigate how different spoken dialog systems perform on the same task. The existing Let's Go Pittsburgh Bus Information System was used as a task and four teams provided systems that were first tested in controlled conditions with speech researchers as users. The three most stable systems were then deployed to real callers. This paper presents the results of the live tests, and compares them with the control test results. Results show considerable variation both between systems and between the control and live tests. Interestingly, relatively high task completion for controlled tests did not always predict relatively high task completion for live tests. Moreover, even though the systems were quite different in their designs, we saw very similar correlations between word error rate and task completion for all the systems. The dialog data collected is available to the research community. © 2011 Association for Computational Linguistics.

Improvements to Concrete Column Detection in Live Video

The automated detection of structural elements (e.g. concrete columns) in visual data is useful in many construction and maintenance applications. The research in this area is under initial investigation. The authors previously presented a concrete column detection method that utilized boundary and color information as detection cues. However, the method is sensitive to parameter selection, which reduces its ability to robustly detect concrete columns in live videos. Compared against the previous method, the new method presented in this paper reduces the reliance of parameter settings mainly in three aspects. First, edges are located using color information. Secondly, the orientation information of edge points is considered in constructing column boundaries. Thirdly, an artificial neural network for concrete material classification is developed to replace concrete sample matching. The method is tested using live videos, and results are compared with the results obtained with the previous method to demonstrate the new method improvements.

Live Attenuated S. Typhimurium Vaccine with Improved Safety in Immuno-Compromised Mice

Live attenuated vaccines are of great value for preventing infectious diseases. They represent a delicate compromise between sufficient colonization-mediated adaptive immunity and minimizing the risk for infection by the vaccine strain itself. Immune defects can predispose to vaccine strain infections. It has remained unclear whether vaccine safety could be improved via mutations attenuating a vaccine in immune-deficient individuals without compromising the vaccine's performance in the normal host. We have addressed this hypothesis using a mouse model for Salmonella diarrhea and a live attenuated Salmonella Typhimurium strain (ssaV). Vaccination with this strain elicited protective immunity in wild type mice, but a fatal systemic infection in immune-deficient cybb-/-nos2-/- animals lacking NADPH oxidase and inducible NO synthase. In cybb-/-nos2-/- mice, we analyzed the attenuation of 35 ssaV strains carrying one additional mutation each. One strain, Z234 (ssaV SL1344_3093), was >1000-fold attenuated in cybb-/-nos2-/- mice and ≈100 fold attenuated in tnfr1-/- animals. However, in wt mice, Z234 was as efficient as ssaV with respect to host colonization and the elicitation of a protective, O-antigen specific mucosal secretory IgA (sIgA) response. These data suggest that it is possible to engineer live attenuated vaccines which are specifically attenuated in immuno-compromised hosts. This might help to improve vaccine safety. © 2012 Periaswamy et al.

Polymer film packaging for food: An environmental assessment

Plastics packaging is ubiquitous in the food industry, fulfilling a range of functions including a significant role in reducing food waste. The public perception of packaging, however, is dominated by end-of-life aspects, when the packaging becomes waste often found littering urban, rural and marine environments. A balanced analysis of the role of packaging demands that the whole lifecycle is examined, looking not only at the packaging itself but also at the product being packaged. This paper focuses on packaging in the meat and cheese industry, analysing the impact of films and bags. The functions of packaging are defined and the environmental impact of delivering these functions is assessed. The influence of packaging on levels of waste and energy consumption elsewhere in the system is examined, including the contentious issue of end-of-life for packaging. Strategies for minimizing the environmental impact of the packaging itself involve reduction in the amount of material used (thinner packaging), rather than emphasizing end-of-life issues. Currently, with polymer recycling not at a high level, evidence suggests that this strategy is justifiable. Biodegradable polymers may have some potential for improving environmental performance, but are still problematic. The conclusion is that although current packaging is in some ways wasteful and inefficient, the alternatives are even less desirable. © 2013 Elsevier B.V. All rights reserved.

Elevated ability to compete for limited food resources by 'all-fish' growth hormone transgenic common carp Cyprinus carpio

Food consumption, number of movements and feeding hierarchy of juvenile transgenic common carp Cyprinus carpio and their size-matched non-transgenic conspecifics were measured under conditions of limited food supply. Transgenic fish exhibited 73 center dot 3% more movements as well as a higher feeding order, and consumed 1 center dot 86 times as many food pellets as their non-transgenic counterparts. After the 10 day experiment, transgenic C. carpio had still not realized their higher growth potential, which may be partly explained by the higher frequency of movements of transgenics and the 'sneaky' feeding strategy used by the non-transgenics. The results indicate that these transgenic fish possess an elevated ability to compete for limited food resources, which could be advantageous after an escape into the wild. It may be that other factors in the natural environment (i.e. predation risk and food distribution), however, would offset this advantage. Thus, these results need to be assessed with caution.

Growth and food availability of silver and bighead carps: evidence from stable isotope and gut content analysis

A 2-year investigation of growth and food availability of silver carp and bighead was carried out using stable isotope and gut content analysis in a large pen in Meiliang Bay of Lake Taihu, China. Both silver carp and bighead exhibited significantly higher delta 13C in 2005 than in 2004, which can probably be attributed to two factors: (i) the difference between isotopic compositions at the base of the pelagic food web and (ii) the difference between the compositions of prey items and stable isotopes. The significantly positive correlations between body length, body weight and stable isotope ratios indicated that isotopic changes in silver carp and bighead resulted from the accumulation of biomass concomitant with rapid growth. Because of the drastic decrease in zooplankton in the diet in 2005, silver carp and bighead grew faster in 2004 than in 2005. Bighead carp showed a lower trophic level than silver carp in 2005 as indicated by stable nitrogen isotope ratios, which was possibly explained by the interspecific difference between the prey species and the food quality of silver carp and bighead.

Transfer, distribution and bioaccumulation of microcystins in the aquatic food web in Lake Taihu, China, with potential risks to human health

In this paper, accumulation and distribution of microcystins (MCs) was examined monthly in six species of fish with different trophic levels in Meiliang Bay, Lake Taihu, China, from June to November 2005, Microcystins were analyzed by liquid chromatography electrospray ionization mass spectrometry (LC-ESI-MS). Average recoveries of spiked fish samples were 67.7% for MC-RR, 85.3% for MC-YR, and 88.6% for MC-LR. The MCs (MC-RR+MC-YR+MC-LR) concentration in liver and gut content was highest in phytoplanktivorous fish, followed by omnivorous fish, and was lowest in carnivorous fish; while MCs concentration in muscle was highest in omnivorous fish, followed by phytoplanktivorous fish, and was lowest in carnivorous fish. This is the first study reporting MCs accumulation in the gonad of fish in field. The main uptake of MC-YR in fish seems to be through the gills from the dissolved MCs. The WHO limit for tolerable daily intake was exceeded only in common carp muscle. (C) 2008 Elsevier B.V. All rights reserved.

Distribution and depuration of the potentially carcinogenic malachite green in tissues of three freshwater farmed Chinese fish with different food habits

The use of malachite green (MG) in fish farming is prohibited in China due to its potentially toxicological and carcinogenic nature, but it is still illegally used in some places. Uptake, accumulation and deputation of MG in various tissues were studied under laboratory conditions in three common freshwater fish, Parabramis pekinensis (plant-eating fish), Carassius auratus (omnivorous fish) and Ophiocephalus argus (carnivorous fish). The concentrations of MG and its primary metabolite, the reduced and colorless leucomalachite green (LMG), were analyzed by liquid chromatography-mass spectrometry (LC-MS2). Absorption of MG occurred during the waterborne exposure and the MG concentrations in gills of the three fish species all showed a maximum at 0 h after an acute water exposure (6 mg l(-1) MG for 20 min). Afterwards, both MG and LMG declined very rapidly in the blood of the fish. Levels of MG and LMG were still above 0.002 mu g g(-1) in fresh weight muscle at 240 h and may persist for as long as 10 days. Most MG was converted rapidly to LMG in the fish and deputation of LMG was very slow in fat tissue. skin and gonads of the fish. Distribution of LMG was strongly dependent on the fat content in the tissues of the fish, but not related to their different feeding habits. Therefore, it appears that fat tissue, skin and gonads of the fish contaminated by MG and LMG pose the greatest risk for human consumption. (C) 2008 Published by Elsevier B.V.

Food Consumption by In Situ Pen-Cultured Planktivorous Fishes and Effects on an Algal Bloom in Lake Taihu, China

Silver carp (Hypophthalmichthys molitrix) and bighead carp (Aristichthys nobilis) were used as a new pen-cultureed biomanipulation technique to control algal blooms in Meiliang Bay of Lake Taihu. In order to evaluate the capacity of these two fishes to decrease algal blooms, diel feeding samplings were carried out in May (without algal blooms) and September (with algal blooms) in 2005. Based on estimated food consumption by the Elliott-Persson model, silver carp increased daily food consumption from 2.07 g dry weight per 100 g wet body weight in May before the outbreak of algal blooms to 4.98 g dry weight per 100 g wet body weight in September during algal blooms outbreak. However, no obvious variation of food consumption was observed in bighead carp during the study period. This species 1.88 and 1.54 g dry weight of plankton per 100 g wet body weight in May and September, respectively. Silver carp had a higher feeding capacity for plankton than bighead carp. Biotic factors (i.e., fish size and conspecific competition with natural species in the lake) may affect the feeding behaviors of both carps as well as seasonal variation of plankton communities in the pen.

Food web of benthic macro invertebrates in a large Yangtze River-connected lake: the role of flood disturbance

This Study was conducted in Lake Dongtinghu, a large river-connected lake on the Yangtze River flood-plain, China. Our goal was to determine trophic relationships among benthic macroinvertebrates, as well as the effects of flood disturbance on the benthic food web of a river-connected lake. Macroinvertebrates in the lake fed mainly on detritus and plankton (both zooplankton and phytoplankton). Food web Structure in Lake Dongtinghu was characterized by molluscs as the dominant group, low connectance, high level of omnivory. based oil detritus and primary production, and most ingestion concentrating on a few links. Our analyses showed that flood disturbance is an important factor affecting the benthic food web in Lake Dongtinghu. The numbers of species and functional feeding groups (FFGs), and the density and biomass of macroinvertebrates decreased significantly during flooding. Connectance was higher during the flood season than in other seasons, indicating that floods have a strong effect on connectance in this Yangtze River-connected lake. Flood effects on the benthic web were also evident in the decrease of niche overlaps within and anion, FFGs. Our results provide useful information regarding biodiversity conservation on the Yangtze floodplain. Reconstructing and maintaining natural and regular flow regimes between Yangtze lakes and the river is essential for restoration of macroinvertebrates on the floodplain.

Detection of the hepatotoxic microcystins in 36 kinds of cyanobacteria Spirulina food products in China

Gel filtration chromatography, ultra-filtration, and solid-phase extraction silica gel clean-up were evaluated for their ability to remove microcystins selectively from extracts of cyanobacteria Spirulina samples after using the reversed-phase octadecylsilyl ODS cartridge for subsequent analysis by liquid chromatography coupled to tandem mass spectrometry (LC-MS/MS). The reversed-phase ODS cartridge/silica gel combination were effective and the optimal wash and elution conditions were: H2O (wash), 20% methanol in water (wash), and 90% methanol in water (elution) for the reversed-phase ODS cartridge, followed by 80% methanol in water elution in the silica gel cartridge. The presence of microcystins in 36 kinds of cyanobacteria Spirulina health food samples obtained from various retail outlets in China were detected by LC-MS/MS, and 34 samples (94%) contained microcystins ranging from 2 to 163 ng g(-1) (mean=1427 ng g(-1)), which were significantly lower than microcystins present in blue green alga products previously reported. MC-RR-which contains two molecules of arginine (R)-(in 94.4% samples) was the predominant microcystin, followed by MC-LR-where L is leucine-(30.6%) and MC-YR-where Y is tyrose-(27.8%). The possible potential health risks from chronic exposure to microcystins from contaminated cyanobacteria Spirulina health food should not be ignored, even if the toxin concentrations were low. The method presented herein is proposed to detect microcystins present in commercial cyanobacteria Spirulina samples.

In situ study on effect of food competition on diet shifts and growth of silver and bighead carps in large biomanipulation fish pens in Meiliang Bay, Lake Taihu

Silver and bighead carps were cultured in large fish pens to reduce the risks of cyanobacterial bloom outbreaks in Meiliang Bay, Lake Tauhu in 2004 and 2005. Diet compositions and growth rates of the carps were studied from April to November each year. Both carp species fed mainly on zooplankton (> 50% in diet) in 2004 when competition was low, but selected more phytoplankton in 2005 when competition was high. Silver carp had a broader diet breadth than did bighead carp. Higher densities and fewer food resources increased diet breadths but decreased the diet overlap in both types of carps. It can be predicted that silver and bighead carps would be released from diet competition and shift to feed mainly on zooplankton at low densities, decreasing the efficiency of controlling cyanobacterial blooms. Conclusively, when silver and bighead carps are used to control cyanobacterial blooms, a sufficiently high stocking density is very important for a successful practice.

Fast-growing transgenic common carp mounfing compensatory growth

Compensatory growth is a phase of accelerated growth apparent when favourable conditions are restored after a period of growth depression. To investigate if F-2 common 'all-fish' growth hormone gene transgenic common carp (Cyprinus carpio) could mount compensatory growth, a 9 week study at 29 degrees C was performed. The control group was fed to satiation twice a day throughout the experiment. The other two groups were deprived of feed for 1 or 2 weeks, respectively, and then fed to satiation during the re-feeding period. At the end of the experiment, the live masses of fish in the deprived groups were still significantly lower than those of the controls. During the re-feeding period, size-adjusted mean specific growth rates and mean feed intakes were significantly higher in the deprived fish than in the controls, indicating a partial compensatory growth response in these fish. No significant differences were found in food conversion efficiency between the deprived and control fish during re-feeding, suggesting that hyperphagia was the mechanism responsible for increased growth rates. The proximate composition of the deprived fish at the end of the experiment was similar to that of the control fish. This study is, to our knowledge, the first to report that fast-growing transgenic fish can achieve partial compensation of growth following starvation. (c) 2007 The Authors Journal compilation (c) 2007 The Fisheries Society of the British Isles.