On-line policy optimisation of Bayesian spoken dialogue systems via human interaction

A partially observable Markov decision process has been proposed as a dialogue model that enables robustness to speech recognition errors and automatic policy optimisation using reinforcement learning (RL). However, conventional RL algorithms require a very large number of dialogues, necessitating a user simulator. Recently, Gaussian processes have been shown to substantially speed up the optimisation, making it possible to learn directly from interaction with human users. However, early studies have been limited to very low dimensional spaces and the learning has exhibited convergence problems. Here we investigate learning from human interaction using the Bayesian Update of Dialogue State system. This dynamic Bayesian network based system has an optimisation space covering more than one hundred features, allowing a wide range of behaviours to be learned. Using an improved policy model and a more robust reward function, we show that stable learning can be achieved that significantly outperforms a simulator trained policy. © 2013 IEEE.

Assessment of dry weight by monitoring changes in blood volume during hemodialysis using Crit-Line.

BACKGROUND: Routine assessment of dry weight in chronic hemodialysis patients relies primarily on clinical evaluation of patient fluid status. We evaluated whether measurement of postdialytic vascular refill could assist in the assessment of dry weight. METHODS: Twenty-eight chronic, stable hemodialysis patients were studied during routine treatment sessions using constant dialysate temperature and dialysate sodium concentration, and relative changes in blood volume were monitored using Crit-Line III monitors throughout this study. The study was divided into three phases. Phase 1 studies evaluated the time-dependence of vascular compartment refill after completion of hemodialysis. Phase 2 studies evaluated the relationships in patient subgroups between intradialytic changes in blood volume and the presence of postdialytic vascular compartment refill during that last 10 minutes of hemodialysis after stopping ultrafiltration. Phase 3 studies evaluated the extent of dry weight changes following the application of a protocol for blood volume reduction, postdialytic vascular compartment refill, and correlation with clinical evidence of intradialytic hypovolemia and/or postdialytic fatigue. Phase 3 included anywhere from three to five treatments. RESULTS: Phase 1 studies demonstrated that despite interpatient variability in the magnitude of postdialytic vascular compartment refill, when significant refill was evident, it always continued for at least 30 minutes. However, the majority of refill took place within 10 minutes postdialysis. Phase 2 studies identified 3 groups of patients: those who exhibited intradialytic reductions in blood volume but not postdialytic vascular compartment refill (group 1), those who exhibited intradialytic reductions in blood volume and postdialytic vascular compartment refill (group 2), and those whose blood volume did not change substantially during hemodialysis treatment (group 3). In phase 3 studies, use of an ultrafiltration protocol for blood volume reduction and monitoring of postdialytic vascular compartment refill combined with clinical assessment of hypovolemia and postdialytic fatigue demonstrated that patients often had a clinical dry weight assessment which was too low or too high. In all 28 patients studied, dry weight was either increased or decreased following use of this protocol. CONCLUSION: Determination of the extent of both intradialytic decreases in blood volume and postdialytic vascular compartment refill, combined with clinical assessment of intradialytic hypovolemia and postdialytic fatigue, can help assess patient dry weight and optimize volume status while reducing dialysis associated morbidity. The number of hospital admissions due to fluid overload may be reduced.

Bead-probe complex capture a couple of SINE and LINE family from genomes of two closely related species of East Asian cyprinid directly using magnetic separation

Background: Short and long interspersed elements (SINEs and LINEs, respectively), two types of retroposons, are active in shaping the architecture of genomes and powerful tools for studies of phylogeny and population biology. Here we developed special protocol to apply biotin-streptavidin bead system into isolation of interspersed repeated sequences rapidly and efficiently, in which SINEs and LINEs were captured directly from digested genomic DNA by hybridization to bead-probe complex in solution instead of traditional strategy including genomic library construction and screening. Results: A new couple of SINEs and LINEs that shared an almost identical 3'tail was isolated and characterized in silver carp and bighead carp of two closely related species. These SINEs (34 members), designated HAmo SINE family, were little divergent in sequence and flanked by obvious TSD indicated that HAmo SINE was very young family. The copy numbers of this family was estimated to 2 x 10(5) and 1.7 x 10(5) per haploid genome by Real-Time qPCR, respectively. The LINEs, identified as the homologs of LINE2 in other fishes, had a conserved primary sequence and secondary structures of the 3'tail region that was almost identical to that of HAmo SINE. These evidences suggest that HAmo SINEs are active and amplified recently utilizing the enzymatic machinery for retroposition of HAmoL2 through the recognition of higher-order structures of the conserved 42-tail region. We analyzed the possible structures of HAmo SINE that lead to successful amplification in genome and then deduced that HAmo SINE, SmaI SINE and FokI SINE that were similar in sequence each other, were probably generated independently and created by LINE family within the same lineage of a LINE phylogeny in the genomes of different hosts. Conclusion: The presented results show the advantage of the novel method for retroposons isolation and a pair of young SINE family and its partner LINE family in two carp fishes, which strengthened the hypotheses containing the slippage model for initiation of reverse transcription, retropositional parasitism of SINEs on LINEs, the formation of the stem loop structure in 3'tail region of some SINEs and LINEs and the mechanism of template switching in generating new SINE family.

Establishment of a Chinese sturgeon Acipenser sinensis tail-fin cell line and its susceptibility to frog iridovirus

Chinese sturgeon Acipenser sinensis, a cartilaginous ganoid, is a 'living fossil' on a deeply isolated evolutionary branch. A cell line was established from Chinese sturgeon tail-fin tissue (CSTF) . These epithelial CSTF cells grew well in Dulbecco's modified Eagle's medium at 25 degrees C. Karyotypic analysis revealed a normal diploid karyotype with 2n = 264 and large numbers of punctate chromosomes. A strain of frog iridoviruses [Rana grylio virus (RGV)] was used to test the susceptibility of this cell line to infection. Infection was confirmed by cytopathic effect, immunofluorescence and electron-microscope observations, which detected the viral antigens or particles in the cytoplasm of RGV-infected cells. Molecular analysis further suggested that c. 550 bp DNA fragment could be cloned from the RGV-infected CSTF cells' DNA with major capsid protein gene polymerase chain reaction primers. Furthermore, after transfection with pEGFP vector DNA, the CSTF cell line produced significant fluorescent signals indicating its utility in exogenous studies.

Establishment, characterization, and virus susceptibility of a new marine cell line from red spotted grouper (Epinephelus akaara)

A marine fish cell line from the snout of red spotted grouper Epinephelus akaara, a protogynous hermaphrodite, was established, characterized, and subcultured with more than 60 passages. The grouper snout cell line (GSC) cells multiplied well in Dulbecco's modified Eagle's medium (DMEM) medium supplemented with 10% fetal bovine serum. The optimal growth temperature was 25 degrees C, and morphologically the cells were fibroblastic. Chromosome analysis revealed that the GSC cell line has a normal diploid karyotype with 2n = 8st + 40t. A virus titration study indicated that the cells were susceptible to turbot Scophthalmus Maximus rhabdovirus (SMRV) (10(8.5) TCID50 ml(-1)), while the viral titer of frog Rana grylio virus 9807 (RGV(9807)) reached 10(3.5) TCID50 ml-1. The infection was confirmed by cytopathic effect (CPE), immunofluorescence, and electron microscopy experiments, which detected the viral particles in the cytoplasm of virus-infected cells, respectively. Further, significant fluorescent signals were observed when the GSC cells were transfected with pEGFP vector DNA, indicating their potential utility for transgenic and genetic manipulation studies.

Theoretical study of line narrowing in a sub-terahertz monolithic dual laser source with an integrated reflector

A monolithic design is proposed for low-noise sub-THz signal generation by integrating a reflector onto a dual laser source. The reflectivity and the position of such a reflector can be adjusted to obtain constructive feedback from the reflector to both lasers, thus causing a Vernier feedback effect. As a result, 10-fold line narrowing, the narrowing being limited by the resolution of the simulation, is predicted using a transmission line model. Finally, a simple control scheme using an electrical feedback loop to adjust laser biases is proposed to maintain the line narrowing performance. This line narrowing technique, comprising a passive integrated reflector, could allow the development of a low-cost, compact and energy-efficient solution for high-purity sub-THz signal generation. © The Institution of Engineering and Technology 2014.

Effects of brominated flame retardants and brominated dioxins on steroidogenesis in H295R human adrenocortical carcinoma cell line

Brominated flame retardants (BFRs) and brominated dioxins are emerging persistent organic pollutants that are ubiquitous in the environment and can be accumulated by wildlife and humans. These chemicals can disturb endocrine function. Recent studies have demonstrated that one of the mechanisms of endocrine disruption by chemicals is modulation of steroidogenic gene expression or enzyme activities. In this study, an in vitro assay based on the H295R human adrenocortical carcinoma cell line, which possesses most key genes or enzymes involved in steroidogenesis, was used to examine the effects of five bromophenols, two polybrominated biphenyls (PBBs 77 and 169), 2,3,7,8-tetrabromodibenzo-p-dioxin, and 2,3,7,8-tetrabromodibenzofuran on the expression of 10 key steroidogenic genes. The H295R cells were exposed to various BFR concentrations for 48 h, and the expression of specific genescytochrome P450 (CYP11A, CYP11B2, CYP17, CYP19, and CYP21), 3 beta-hydroxysteroid dehydrogenase (3PHSD2), 17 beta-hydroxysteroid dehydrogenase (17 beta HSD1 and 17 beta HSD4), steroidogenic acute regulatory protein (StAR), and 3-hydroxy-3-methylglutaryl coenzyme A reductase (HMGR)-was quantitatively measured using real-time polymerase chain reaction. Cell viability was not affected at the doses tested. Most of the genes were either up- or down-regulated, to some extent, by BFR exposure. Among the genes tested, 3PHSD2 was the most markedly up-regulated, with a range of magnitude from 1.6- to 20-fold. The results demonstrate that bromophenol, bromobiphenyls, and bromodibenzo-p-dioxin/furan are able to modulate steroidogenic gene expression, which may lead to endocrine disruption.

Electron microscopic examination of the viromatrix of Rana grylio virus in a fish cell line

Rana grylio virus (RGV), a Ranavirus belonging to the family Iridoviridae, assembles in the viromatrix which is a factory for viral genome replication and particle assembly. Ultrastructural studies of the viromatrix will clarify the pathway of assembly. The viromatrix and quantitative changes in RGV infected epithelipma papulosum cyprini (EPC) cells, one of fish cell lines, were studied by electron microscopy. It was shown that viromatrices were adjacent to the nucleus, and the electron density was lower than that of the surrounding cytoplasm. The viromatrix contained virus particles with different forms, electron-dense materials and amorphous structures which included tubules and membranous materials. Tubules were often observed in direct continuity with empty capsids. Several bundles of intermediate filaments were seen alongside the viromatrix and crystalline aggregates. Large clusters of mitochondria occurred in proximity to viromatrix. A total of 990 cells profiles were examined. The results showed that 394 cells contained viromatrix: 89.3% contained one, and 10.7% contained two to four viromatrices. The number of viromatrices increased gradually and reached a peak at 16 h p.i. The viromatrix area at 24 h p.i. increased up to 7.4 +/- 0.69 mu m(2) which was three-times lower than that at 6 h p.i. The number of empty capsids within viromatrix was generally more than that of "full" particles at different time points, and there was a strong positive correlation between them. (c) 2005 Elsevier B.V. All rights reserved.

Inductive expression and characterization analysis of Paralichthys olivaceus pigment epithelium-derived factor in a virally infected cell line

Pigment epithelium-derived factor (PEDF) is acknowledged to be a non-inhibitory member of the serine protease inhibitor (serpin) superfamily, with antiangiogenesis, and neuroprotective and immumoregulatory function, mainly in the tissues of nervous system. Here, A PEDF gene homolog, Paralichthys olivaceus PEDF (PoPEDF), was isolated from flounder embryonic cells (FEC) treated with UV-inactivated Grass carp hemorrhage virus (GCHV) and subsequently identified as a differentially expressed gene. The full length of PoPEDF cDNA is 1803 bp with an open reading frame of 1212 bp encoding a 403-amino-acid protein. This deduced protein contains an N-terminal signal peptide, a glycosylation site, a consensus serpin motif, and a 34-mer and a 44-mer fragment, all of which are very conserved in the PEDF family. PoPEDF gene exhibits a conserved exon-intron arrangement with 8 exons and 7 introns. This conserved evolutionary relationship was further confirmed by a phylogenetic analysis, where fish PEDFs and mammalian members formed a well-supported clade. Constitutive expression of PoPEDF was widely detected in many tissues. In response to UV-inactivated GCHV or poly(I:C), PEDF mRNA was upregulated in FEC cells with time. This is the first report on the transcriptional induction of PEDF in virally infected cells. (C) 2005 Elsevier Inc. All rights reserved.

Establishment of a normal medakafish spermatogonial cell line capable of sperm production in vitro

Spermatogonia are the male germ stem cells that continuously produce sperm for the next generation. Spermatogenesis is a complicated process that proceeds through mitotic phase of stem cell renewal and differentiation, meiotic phase, and postmeiotic phase of spermiogenesis. Full recapitulation of spermatogenesis in vitro has been impossible, as generation of normal spermatogonial stem cell lines without immortalization and production of motile sperm from these cells after long-term culture have not been achieved. Here we report the derivation of a normal spermatogonial cell line from a mature medakafish testis without immortalization. After 140 passages during 2 years of culture, this cell line retains stable but growth factor-dependent proliferation, a diploid karyotype, and the phenotype and gene expression pattern of spermatogonial stem cells. Furthermore, we show that this cell line can undergo meiosis and spermiogenesis to generate motile sperm. Therefore, the ability of continuous proliferation and sperm production in culture is an intrinsic property of medaka spermatogonial stem cells, and immortalization apparently is not necessary to derive male germ cell cultures. Our findings and cell line will offer a unique opportunity to study and recapitulate spermatogenesis in vitro and to develop approaches for germ-line transmission.

Induction of apoptosis in a carp leucocyte cell line infected with turbot (Scophthalmus maximus L.) rhabdovirus

A rhabdovirus was observed from the diseased turbot (Scophthalmus maximus L.) with lethal syndrome. In this study, a carp leucocyte (CLC) cell line was used to investigate the infection process and cell death mechanism occurring during the virus infection. Strong cytopathogenic effect (CPE) and the morphological changes, such as extreme chromatin condensation, nucleus fragmentation, and apoptotic body formation, were observed under fluorescence microscopy after DAPI staining in the infected CLC cells. Transmission electron microscopy analysis showed cell shrinkage, plasma membrane blebbing, cytoplasm vacuolization, chromatin condensation, nuclear breakdown and formation of discrete apoptotic bodies. The bullet-shaped nucleocapsids were measured and ranged in size from 110 to 150 nm in length and 40 to 60 nm in diameter. And therefore the virus is called Scophthalmus maximus rhabdovirus (SMRV). Agarose gel electrophoresis analysis of the DNA extracted from infected cells showed typical DNA ladder in the course of SMRV infection. Flow cytometry analysis of SMRV infected CLC cells detected apoptotic peak in the virus infected CLC cells. Virus titre analysis and electron microscopic observation revealed that the virus replication fastigium was earlier than that of the apoptosis occurrence. No apoptosis was observed in the CLC infected with UV-inactivated SMRV. All these supported that SMRV infected CLC cells undergo apoptosis and the virus replication is necessary for apoptosis induction of CLC cells. (C) 2004 Published by Elsevier B.V.

Studies on morphogenesis and cellular interactions of Rana grylio virus in an infected fish cell line

A pathogenic virus (RGV), isolated from diseased pig frog Rana grylio with lethal syndrome, was investigated with regard to morphogenesis and cellular interactions in EPC cells, a cell Line from fish. Different stages of virus amplification, maturation and assembly were observed at nucleus, cytoplasm and cellular membranes. The matured virus particles, were not only distributed diffusely in nucleus, cytoplasm and cellular surface, but also aggregated as pseudocrystalline arrays in the cytoplasm. Virions were released by budding from the plasma membranes, or following cell lysis. Various types of cell damage, such as small vacuoles, spherical inclusions, and swollen and empty mitochondria, were also found. Some typical characteristics of RGV, such as the symmetrical shape of the virions, replication process involving both nuclear and cytoplasmic phases, budding release from cellular membrane and intracellular membrane, viromatrix and paracrystalline aggregation in cytoplasm, and its acute pathogenic effects, were observed to be similar to that of other iridoviruses. Therefore, the RGV appears to be a member of the Iridoviridae based on these studies. (C) 1999 Elsevier Science B.V. All rights reserved.

High efficiency operation of butt joint line-defect-waveguide microlaser in two-dimensional photonic crystal slab

Butt joint line-defect-waveguide microlasers are demonstrated on photonic crystal slabs with airholes in a triangular lattice. Such microlaser is designed to increase the output power from the waveguide edge directly. The output power is remarkably enhanced to 214 times higher by introducing chirped structure in the output waveguide. The lasing mode operates in the linear dispersion region of the output waveguide so that the absorption loss due to the band-edge effect is reduced. The laser resonance is illustrated theoretically using the finite difference time domain method. A practical high power efficiency of 20% is obtained in this microlaser. (C) 2008 American Institute of Physics.