On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

Spoken Dialog Challenge 2010: Comparison of live and control test results

The Spoken Dialog Challenge 2010 was an exercise to investigate how different spoken dialog systems perform on the same task. The existing Let's Go Pittsburgh Bus Information System was used as a task and four teams provided systems that were first tested in controlled conditions with speech researchers as users. The three most stable systems were then deployed to real callers. This paper presents the results of the live tests, and compares them with the control test results. Results show considerable variation both between systems and between the control and live tests. Interestingly, relatively high task completion for controlled tests did not always predict relatively high task completion for live tests. Moreover, even though the systems were quite different in their designs, we saw very similar correlations between word error rate and task completion for all the systems. The dialog data collected is available to the research community. © 2011 Association for Computational Linguistics.

Improvements to Concrete Column Detection in Live Video

The automated detection of structural elements (e.g. concrete columns) in visual data is useful in many construction and maintenance applications. The research in this area is under initial investigation. The authors previously presented a concrete column detection method that utilized boundary and color information as detection cues. However, the method is sensitive to parameter selection, which reduces its ability to robustly detect concrete columns in live videos. Compared against the previous method, the new method presented in this paper reduces the reliance of parameter settings mainly in three aspects. First, edges are located using color information. Secondly, the orientation information of edge points is considered in constructing column boundaries. Thirdly, an artificial neural network for concrete material classification is developed to replace concrete sample matching. The method is tested using live videos, and results are compared with the results obtained with the previous method to demonstrate the new method improvements.

Optimization by orthogonal array design and humoral immunity of the bivalent vaccine against Aeromonas hydrophila and Vibrio fluvialis infection in crucian carp (Carassius auratus L.)

Aeromonas hydrophila and Vibrio fluvialis are the causative agents of a serious haemorrhagic septicaemia that affects a wide range of freshwater fish in China. In order to develop a bivalent anti-A. hydrophila and anti-V. fluvialis formalin-killed vaccine to prevent this disease, an orthogonal array design (OAD) method was used to optimize the production conditions, using three factors, each having three levels. The effects of these factors and levels on the relative per cent survival for crucian carp were quantitatively evaluated by analysis of variance. The final optimized formulation was established. The data showed that inactivation temperature had a significant effect on the potency of vaccine, but formalin concentration did not. The bivalent vaccine could elicit a strong humoral response in crucian carp (Carassius auratus L.) against both A. hydrophila and V. fluvialis simultaneously, which peaked at 3 or 5 weeks respectively. Antibody titres remained high until week 12, the end of the experiment, after a single intraperitoneal injection. The verification experiment confirmed that an optimized preparation could provide protection for fish at least against A. hydrophila infection, and did perform better than the non-optimized vaccine judged by the antibody levels and protection rate, suggesting that OAD is of value in the development of improved vaccine formulations.

Effects of live food and formulated diets on survival, growth and protein content of first-feeding larvae of Plelteobagrus fulvidraco

In recent years, much progress has been made in the rearing of fish larvae fed only artificial diets. A preliminary study was made in an attempt to evaluate the effects of live food and formulated diets on survival, growth and body protein content of first-feeding larvae of Plelteobagrus fulvidraco. Three test diets varying in protein level were formulated: Feed 1 containing 45% protein, Feed 2 with 50% protein and Feed 3 with 55% protein. Larvae fed live food (newly hatched Artemia, unenriched) were the control. The experiment started 3 days post-hatch and lasted for 23 days. At the end of the 23-day trial, survival was best in the control group (65.6%) whereby the final body weight and specific growth rate (SGR) were significantly lower than those in the test feed groups. At the same time, coefficients of variation for SGR and final body weight in the test groups were significantly higher than those in the control. Whole body protein content in all treatments showed a similar tendency during development: significantly higher 3 days post-hatch, then decreasing significantly, and then increasing unstatistically 10 days post-hatch. All results suggest that live food is still better for first-feeding larvae of P. fulvidraco, since live food leads to healthier larvae growth.

Growth of juvenile Chinese sturgeon Acipenser sinensis fed live and formulated diets

Triplicate groups of 3.8-g juvenile Chinese sturgeon Acipenser sinensis were reared for 8 weeks in indoor flow-through systems on one of four diets: a natural diet consisting solely of live tubificid worms, a semimoist practical diet, a dry practical diet, and a purified diet. The formulated diets were prepared in the laboratory and had protein contents of 47-50%. Except for the group fed the purified diet, fish showed high survival (94-96%) and growth (final weight, 41-45 g). Survival and specific growth rate did not differ significantly between groups fed the natural, semimoist, and dry practical diets, but were significantly (P < 0.05) lower in fish fed the purified diet. Proximate analysis showed that fish fed purified diet had lower protein and lipid levels but a higher moisture content than fish fed other diets. Our results demonstrated that growth and survival of cultured juvenile Chinese sturgeon fed practical diets were comparable with those fed live tubificid worms. However, Chinese sturgeon fed a purified diet showed inferior growth and survival.

Identification and immunoprotective analysis of an in vivo-induced Edwardsiella tarda antigen

Edwardsiella tarda is a severe aquaculture pathogen that can infect many important fish species cultured worldwide. The aim of this study was to evaluate the vaccine potential of an E. tarda antigen, Eta21, which was identified from a pathogenic E. tarda strain via the method of in vivo-induced antigen technology (IVIAT). Eta21 is 510-amino acid in length and shares similar to 58% sequence identity with a putative peptidase of several bacterial species. eta21 was subcloned into Escherichia colt, and recombinant Eta21 was purified as a histidine-tagged protein. When used as a subunit vaccine, purified recombinant Eta21 was effective against lethal E. tarda challenge in a Japanese flounder model. In order to improve the immunoprotective efficacy of Eta21, the chimera AgaV-Eta21 was constructed, which consists of Eta21 fused in-frame to the secretion domain of AgaV, an extracellular beta-agarase. E. coli DH5 alpha harboring plasmid pTAET21, which constitutively expresses agaV-eta21, was able to produce and secret AgaV-Eta21 into the extracellular milieu. Vaccination of Japanese flounder with live DH5 alpha/pTAET21 elicited immunoprotection that is significantly higher in level than that induced by vaccination with purified recombinant Eta21. Vaccination with DH5 alpha/pTAET21 and recombinant Eta21 both induced the production of specific serum antibodies at four to eight weeks post-vaccination. Taken together, these results demonstrate that Eta21, especially that delivered by DH5 alpha/pTAET21, is an effective vaccine candidate against E. tarda infection. (C) 2009 Elsevier Ltd. All rights reserved.

Identification of an Edwardsiella tarda surface antigen and analysis of its immunoprotective potential as a purified recombinant subunit vaccine and a surface-anchored subunit vaccine expressed by a fish commensal strain

Edwardsiella tarda is the etiological agent of edwardsiellosis, a systematic disease that affects a wide range of marine and freshwater fish cultured worldwide. In order to identify E. tarda antigens with vaccine potential, we in this study conducted a systematic search for E. tarda proteins with secretion capacity. One of the proteins thus identified was Esa1, which contains 795 amino acid residues and shares extensive overall sequence identities with the D15-like surface antigens of several bacterial species. In silico analyses indicated that Esa1 localizes to outer membrane and possesses domain structures that are conserved among bacterial surface antigens. The vaccine potential of purified recombinant Esa1 was examined in a Japanese flounder (Paralichthys olivaceus) model, which showed that fish vaccinated with Esa1 exhibited a high level of survival and produced specific serum antibodies. Passive immunization of naive fish with antisera raised against Esa1 resulted in significant protection against E. tarda challenge. Taking advantage of the secretion capacity of Esa1 and the natural gut-colonization ability of a fish commensal strain, we constructed an Esa1-expressing recombinant strain, FP3/pJsa1. Western immunoblot and agglutination analyses showed that FP3/pJsa1 produces outer membrane-localized Esa1 and forms aggregates in the presence of anti-Esa1 antibodies. Vaccination analyses showed that FP3/pJsa1 as an intraperitoneal injection vaccine and an oral vaccine embedded in alginate microspheres produced relative percent survival rates of 79% and 52%, respectively, under severe challenging conditions that resulted in 92-96% mortality in control fish. Further analyses showed that following oral vaccination, FP3/pJsa1 was able to colonize in the gut but unable to disseminate into other tissues. Together these results indicate that Esa1 is a protective immunogen and an effective oral vaccine when delivered by FP3/pJsa1 as a surface-anchored antigen. (c) 2010 Elsevier Ltd. All rights reserved.

Identification and analysis of a CpG motif that protects turbot (Scophthalmus maximus) against bacterial challenge and enhances vaccine-induced specific immunity

Oligodeoxynucleotides (ODNs) containing unmethylated CpG motifs in certain contexts are known to be immunostimulatory in vertebrate systems. CpG ODNs with immune effects have been identified for many fish species but, to our knowledge, not for turbot. In this study, a turbot-effective CpG ODN, ODN 205, was identified and a plasmid, pCN5, was constructed which contains the CpG motif of ODN 205. When administered into turbot via intraperitoneal (i.p.) injection, both ODN 205 and pCN5 could (i) inhibit bacterial dissemination in blood in dose and time dependent manners, and (ii) protect against lethal bacterial challenge. Immunological analyses showed that in vitro treatment with ODN 205 stimulated peripheral blood leukocyte proliferation, while i.p. injection with ODN 205 enhanced the respiratory burst activity, chemiluminescence response, and acid phosphatase activity of turbot head kidney macrophages. pCN5 treatment-induced immune responses similar to those induced by ODN 205 treatment except that pCN5 could also enhance serum bactericidal activity in a calcium-independent manner. To examine whether ODN 205 and pCN5 had any effect on specific immunity, ODN 205 and pCN5 were co-administered into turbot with a Vibrio harveyi subunit vaccine, DegQ. The results showed that pCN5, but not ODN 205, significantly increased the immunoprotective efficacy of DegQ and enhanced the production of specific serum antibodies in the vaccinated fish. Further analysis indicated that vaccination with DegQ in the presence of pCN5 upregulated the expression of the genes encoding MHC class II alpha, IgM, Mx, and IL-8 receptor. Taken together, these results demonstrate that ODN 205 and pCN5 can stimulate the immune system of turbot and induce protection against bacterial challenge. In addition, pCN5 also possesses adjuvant property and can potentiate vaccine-induced specific immunity. (C) 2010 Elsevier Ltd. All rights reserved.

Construction and analysis of an experimental Streptococcus iniae DNA vaccine

Streptococcus iniae is a severe aquaculture pathogen that can also infect humans and animal. A putative secretory antigen, Slat 0, was identified from a pathogenic S. iniae strain by in vivo-induced antigen technology. Using turbot as an animal model, the immunoprotective effect of Sia10 was examined as a DNA vaccine in the form of plasmid pSia10, which expresses sia10 under the cytomegalovirus immediate-early promoter. In fish vaccinated with pSia10, transcription of sia10 was detected in muscle, liver, spleen, and kidney at 7, 14, 21, 28, 35, 42, and 49 days post-vaccination. In addition, production of Sia10 protein was also detected in the muscle tissues of pSia10-vaccinated fish. Fish vaccinated with pSia10 exhibited a relative percent survival (RPS) of 73.9% and 92.3%, respectively, when challenged with high and low doses (producing a cumulative mortality of 92% and 52%, respectively, in the control groups) of S. iniae. Immunological and transcriptional analyses showed that vaccination with pSia10(i) induced much stronger chemiluminescence response and significantly higher levels of nitric oxide production and acid phosphatase activity in head kidney macrophages; (ii) caused the production of specific serum antibodies, which afforded apparent immunoprotection when transferred passively into naive fish; and (iii) upregulated the expression of the genes encoding proteins that are possibly involved in both innate and adaptive immune responses. Taken together, these results indicated that pSia10 is an effective vaccine candidate and may be used in the control of S. iniae infection in aquaculture. (C) 2010 Elsevier Ltd. All rights reserved.

Live-weight gain, apparent digestibility, and economic benefits of yaks fed different diets during winter on the Tibetan plateau

Our goal was to determine the effect of diets with different crude protein (CP) contents and metabolizable energy (W) levels on daily live-weight gain, apparent digestibility, and economic benefit of feedlot yaks on the Tibetan plateau during winter. Yaks were either 2- or 3-years old and randomly selected from the same herd. The 3-year-olds were placed into one of two experimental groups (A and B) and a control (CK1), and the two-year-olds were placed into one of three experimental groups (C, D and E) and a control (CK2) (N per group = 5). Yak in the control groups were allow graze freely, while those in the experimental groups yaks were fed diets higher in contains crude protein and metabolizable energy through a winter period inside a warming shed. Results indicated that live-weight gain of treatment groups was higher than their respective controls during experiment, and that daily live-weight gain of every 10 days among different treatments was significant difference (P < 0.05). In addition, apparent digestibility of different diets was linearly and positively related to feedlotting time, and feed conversion efficiency for A, C, D and E groups was quadratically related to feedlotting time (P < 0.01), however, feed conversion efficiency for B group was linearly and positively related to feedlotting time (P < 0.05). The economic benefit was 1.15 for A, 1.89 for B, 1.16 for C, 1.54 for D, and 4,52 for E. (c) 2005 Elsevier B.V. All rights reserved.

Bacteremic pneumonia before and after withdrawal of 13-valent pneumococcal conjugate vaccine from a public vaccination program in Spain: a case-control study

The objective of this study is to compare the incidence and epidemiology of bacteremic community-acquired pneumonia (CAP) in the setting of changes in 13-valent pneumococcal conjugate vaccine (PCV13) coverage. In the region of Madrid, universal immunization with the PCV13 started in May 2010. In July 2012, public funding ceased. Vaccination coverage decreased from >95% to 82% in 2013 and to 67% in 2014. We performed a multicenter surveillance and case-control study from 2009-2014. Cases were hospitalized children with bacteremic CAP. Controls were children selected 1:1 from next-admitted with negative blood cultures and typical, presumed bacterial CAP. Annual incidence of bacteremic CAP declined from 7.9/100 000 children (95% CI 5.1-11.1) in 2009 to 2.1/100 000 children (95% CI 1.1-4.1) in 2012. In 2014, 2 years after PCV13 was withdrawn from the universal vaccination program, the incidence of bacteremic CAP increased to 5.4/100 000 children (95% CI 3.5-8.4). We enrolled 113 cases and 113 controls. Streptococcus pneumoniae caused most of bloodstream infections (78%). Empyema was associated with bacteremia (P = .003, OR 3.6; 95% CI 1.4-8.9). Simple parapneumonic effusion was not associated with bacteremia. Incomplete PCV immunization was not a risk factor for bacteremic pneumonia.