On-line policy optimisation of spoken dialogue systems via live interaction with human subjects

Statistical dialogue models have required a large number of dialogues to optimise the dialogue policy, relying on the use of a simulated user. This results in a mismatch between training and live conditions, and significant development costs for the simulator thereby mitigating many of the claimed benefits of such models. Recent work on Gaussian process reinforcement learning, has shown that learning can be substantially accelerated. This paper reports on an experiment to learn a policy for a real-world task directly from human interaction using rewards provided by users. It shows that a usable policy can be learnt in just a few hundred dialogues without needing a user simulator and, using a learning strategy that reduces the risk of taking bad actions. The paper also investigates adaptation behaviour when the system continues learning for several thousand dialogues and highlights the need for robustness to noisy rewards. © 2011 IEEE.

Study of the turbulence in the air-side and water-side boundary layers in experimental laboratory wind induced surface waves

This study detailed the structure of turbulence in the air-side and water-side boundary layers in wind-induced surface waves. Inside the air boundary layer, the kurtosis is always greater than 3 (the value for normal distribution) for both horizontal and vertical velocity fluctuations. The skewness for the horizontal velocity is negative, but the skewness for the vertical velocity is always positive. On the water side, the kurtosis is always greater than 3, and the skewness is slightly negative for the horizontal velocity and slightly positive for the vertical velocity. The statistics of the angle between the instantaneous vertical fluctuation and the instantaneous horizontal velocity in the air is similar to those obtained over solid walls. Measurements in water show a large variance, and the peak is biased towards negative angles. In the quadrant analysis, the contribution of quadrants Q2 and Q4 is dominant on both the air side and the water side. The non-dimensional relative contributions and the concentration match fairly well near the interface. Sweeps in the air side (belonging to quadrant Q4) act directly on the interface and exert pressure fluctuations, which, in addition to the tangential stress and form drag, lead to the growth of the waves. The water drops detached from the crest and accelerated by the wind can play a major role in transferring momentum and in enhancing the turbulence level in the water side.On the air side, the Reynolds stress tensor's principal axes are not collinear with the strain rate tensor, and show an angle α σ≈=-20°to-25°. On the water side, the angle is α σ≈=-40°to-45°. The ratio between the maximum and the minimum principal stresses is σ a/σ b=3to4 on the air side, and σ a/σ b=1.5to3 on the water side. In this respect, the air-side flow behaves like a classical boundary layer on a solid wall, while the water-side flow resembles a wake. The frequency of bursting on the water side increases significantly along the flow, which can be attributed to micro-breaking effects - expected to be more frequent at larger fetches. © 2012 Elsevier B.V.

Modeling fatigue crack growth in crystalline solids with discrete dislocation plasticity

Analyses of crack growth under cyclic loading conditions are discussed where plastic flow arises from the motion of large numbers of discrete dislocations and the fracture properties are embedded in a cohesive surface constitutive relation. The formulation is the same as used to analyse crack growth under monotonic loading conditions, differing only in the remote loading being a cyclic function of time. Fatigue, i.e. crack growth in cyclic loading at a driving force for which the crack would have arrested under monotonic loading, emerges in the simulations as a consequence of the evolution of internal stresses associated with the irreversibility of the dislocation motion. A fatigue threshold, Paris law behaviour, striations, the accelerated growth of short cracks and the scaling with material properties are outcomes of the calculations. Results for single crystals and polycrystals will be discussed.

Deformation and fracture of impulsively loaded sandwich panels

Light metal sandwich panel structures with cellular cores have attracted interest for multifunctional applications which exploit their high bend strength and impact energy absorption. This concept has been explored here using a model 6061-T6 aluminum alloy system fabricated by friction stir weld joining extruded sandwich panels with a triangular corrugated core. Micro-hardness and miniature tensile coupon testing revealed that friction stir welding reduced the strength and ductility in the welds and a narrow heat affected zone on either side of the weld by approximately 30%. Square, edge clamped sandwich panels and solid plates of equal mass per unit area were subjected to localized impulsive loading by the impact of explosively accelerated, water saturated, sand shells. The hydrodynamic load and impulse applied by the sand were gradually increased by reducing the stand-off distance between the test charge and panel surfaces. The sandwich panels suffered global bending and stretching, and localized core crushing. As the pressure applied by the sand increased, face sheet fracture by a combination of tensile stretching and shear-off occurred first at the two clamped edges of the panels that were parallel with the corrugation and weld direction. The plane of these fractures always lay within the heat affected zone of the longitudinal welds. For the most intensively loaded panels additional cracks occurred at the other clamped boundaries and in the center of the panel. To investigate the dynamic deformation and fracture processes, a particle-based method has been used to simulate the impulsive loading of the panels. This has been combined with a finite element analysis utilizing a modified Johnson-Cook constitutive relation and a Cockcroft-Latham fracture criterion that accounted for local variation in material properties. The fully coupled simulation approach enabled the relationships between the soil-explosive test charge design, panel geometry, spatially varying material properties and the panel's deformation and dynamic failure responses to be explored. This comprehensive study reveals the existence of a strong instability in the loading that results from changes in sand particle reflection during dynamic evolution of the panel's surface topology. Significant fluid-structure interaction effects are also discovered at the sample sides and corners due to changes of the sand reflection angle by the edge clamping system. © 2012 Elsevier Ltd. All rights reserved.

Lift and the leading-edge vortex

Flapping wings often feature a leading-edge vortex (LEV) that is thought to enhance the lift generated by the wing. Here the lift on a wing featuring a leading-edge vortex is considered by performing experiments on a translating flat-plate aerofoil that is accelerated from rest in a water towing tank at a fixed angle of attack of 15°. The unsteady flow is investigated with dye flow visualization, particle image velocimetry (PIV) and force measurements. Leading-and trailing-edge vortex circulation and position are calculated directly from the velocity vectors obtained using PIV. In order to determine the most appropriate value of bound circulation, a two-dimensional potential flow model is employed and flow fields are calculated for a range of values of bound circulation. In this way, the value of bound circulation is selected to give the best fit between the experimental velocity field and the potential flow field. Early in the trajectory, the value of bound circulation calculated using this potential flow method is in accordance with Kelvin's circulation theorem, but differs from the values predicted by Wagner's growth of bound circulation and the Kutta condition. Later the Kutta condition is established but the bound circulation remains small; most of the circulation is contained instead in the LEVs. The growth of wake circulation can be approximated by Wagner's circulation curve. Superimposing the non-circulatory lift, approximated from the potential flow model, and Wagner's lift curve gives a first-order approximation of the measured lift. Lift is generated by inertial effects and the slow buildup of circulation, which is contained in shed vortices rather than bound circulation. © 2013 Cambridge University Press.

Water, salt water, and alkaline solution uptake in epoxy thin films

As a means of characterizing the diffusion parameters of fiber reinforced polymer (FRP) composites within a relatively short time frame, the potential use of short term tests on epoxy films to predict the long-term behavior is investigated. Reference is made to the literature to assess the effectiveness of Fickian and anomalous diffusion models to describe solution uptake in epoxies. The influence of differing exposure conditions on the diffusion in epoxies, in particular the effect of solution type and temperature, are explored. Experimental results, where the solution uptake in desiccated (D) or undesiccated (U) thin films of a commercially available epoxy matrix subjected to water (W), salt water (SW), or alkali concrete pore solution (CPS) at either 20 or 60°C, are also presented. It was found that the type of solution did not significantly influence the diffusion behavior at 20°C and that the mass uptake profile was anomalous. Exposure to 60°C accelerated the initial diffusion behavior and appeared to raise the level of saturation. In spite of the accelerated approach, conclusive values of uptake at saturation remained elusive even at an exposure period of 5 years. This finding questions the viability of using short-term thin film results to predict the long-term mechanical performance of FRP materials. © 2013 Wiley Periodicals, Inc.

The sensitivity of vibration characteristics of reinforced concrete beams under incremental static and cyclic loading

The use of changes in vibration properties for global damage detection and monitoring of existing concrete structures has received great research attention in the last three decades. To track changes in vibration properties experimentally, structures have been artificially damaged by a variety of scenarios. However, this procedure does not represent realistically the whole design-life degradation of concrete structures. This paper presents experimental work on a set of damaged reinforced concrete beams due to different loading regimes to assess the sensitivity of vibration characteristics. Of the total set, three beams were subject to incremental static loading up to failure to simulate overloading, and two beams subject to 15 million loading cycles with varying amplitudes to produce an accelerated whole-life degradation scenario. To assess the vibration behaviour in both cases, swept sine and harmonic excitations were conducted at every damage level. The results show that resonant frequencies are not sensitive enough to damage due to cyclic loading, whereas cosh spectral and root mean square distances are more sensitive, yet more scattered. In addition, changes in non-linearity follow a softening trend for beams under incremental static loading, whilst they are significantly inconsistent for beams under cyclic loading. Amongst all examined characteristics, changes in modal stiffness are found to be most sensitive to damage and least scattered, but modal stiffness is tedious to compute due mainly to the difficulty of constructing restoring force surfaces from field measurements. © (2013) Trans Tech Publications.

Impact of hydrated magnesium carbonate additives on the carbonation of reactive MgO cements

Reactive magnesia (MgO) cements have emerged as a potentially more sustainable and technically superior alternative to Portland cement due to their lower production temperature and ability to sequester significant quantities of CO2. Porous blocks containing MgO were found to achieve higher strength values than PC blocks. A number of variables are investigated to achieve maximum carbonation and associated high strengths. This paper focuses on the impact of four different hydrated magnesium carbonates (HMCs) as cement replacements of either 20 or 50%. Accelerated carbonation (20 C, 70-90% RH, 20% CO2) is compared with natural curing (20 C, 60-70% RH, ambient CO2). SEM, TG/DTA, XRD, and HCl acid digestion are utilized to provide a thorough understanding of the performance of MgO-cement porous blocks. The presence of HMCs resulted in the formation of larger size carbonation products with a different morphology than those in the control mix, leading to significantly enhanced carbonation and strength. © 2013 Elsevier Ltd.

Strength and drying shrinkage of reactive MgO modified alkali-activated slag paste

Conventional alkali-activated slag (AAS) cements suffer from significant drying shrinkage which hinders their widespread application. This paper investigates the potential of using commercial reactive MgO to reduce the drying shrinkage of AAS. Two different reactive MgOs were added at a content of 2.5-7.5 wt% of the slag, which was activated by sodium hydroxide and water-glass. The strength and the drying shrinkage of those reactive MgO modified AAS (MAAS) pastes were measured up to 90 days. It is found that MgO with high reactivity accelerated the early hydration of AAS, while MgO with medium reactivity had little effect. The drying shrinkage was significantly reduced by highly reactive MgO but it also generated severe cracking under the dry condition. On the other hand, medium-reactive MgO only showed observable shrinkage-reducing effect after one month, but the cement soundness was improved. The hydration products, analysed by X-ray diffraction, thermogravimetric analysis and scanning electron microscopy techniques, showed that Mg was mainly incorporated in the hydrotalcite-like phases. It is concluded that the curing conditions and the time of hydrotalcite-like phases formation and their quantity are crucial to the developed strength and shrinkage reduction properties of MAAS, which are highly dependent on the reactivity and content of reactive MgO. Crown Copyright © 2013 Published by Elsevier Ltd. All rights reserved.

Distinct Evolutionary Patterns Between Two Duplicated Color Vision Genes Within Cyprinid Fishes

We investigated the molecular evolution of duplicated color vision genes (LWS-1 and SWS2) within cyprinid fish, focusing on the most cavefish-rich genus-Sinocyclocheilus. Maximum likelihood-based codon substitution approaches were used to analyze the evolution of vision genes. We found that the duplicated color vision genes had unequal evolutionary rates, which may lead to a related function divergence. Divergence of LWS-1 was strongly influenced by positive selection causing an accelerated rate of substitution in the proportion of pocket-forming residues. The SWS2 pigment experienced divergent selection between lineages, and no positively selected site was found. A duplicate copy of LWS-1 of some cyprinine species had become a pseudogene, but all SWS2 sequences remained intact in the regions examined in the cyprinid fishes examined in this study. The pseudogenization events did not occur randomly in the two copies of LWS-1 within Sinocyclocheilus species. Some cave species of Sinocyclocheilus with numerous morphological specializations that seem to be highly adapted for caves, retain both intact copies of color vision genes in their genome. We found some novel amino acid substitutions at key sites, which might represent interesting target sites for future mutagenesis experiments. Our data add to the increasing evidence that duplicate genes experience lower selective constraints and in some cases positive selection following gene duplication. Some of these observations are unexpected and may provide insights into the effect of caves on the evolution of color vision genes in fishes.

Enhanced protection against oxidative stress in an astaxanthin-overproduction Haematococcus mutant (Chlorophyceae)

Many unicellular green algae can become yellow or red in various natural habitats due to mass accumulation of a secondary carotenoid, such as lutein, or astaxanthin. The accumulation of secondary carotenoids is generally thought to be a survival strategy of the algae under photo-oxidative stress or other adverse environmental conditions. The physiological role of the carotenoids in stress response is less well understood at the subcellular or molecular level. In this study, a stable astaxanthin overproduction mutant (MT 2877) was isolated by chemical mutagenesis of a wild type (WT) of the green microalga Haematococcus pluvialis Flotow NIES-144. MT 2877 was identical to the WT with respect to morphology, pigment composition, and growth kinetics during the early vegetative stage of the life cycle. However, it had the ability to synthesize and accumulate about twice the astaxanthin content of the WT under high light, or under high light in the presence of excess amounts of ferrous sulphate and sodium acetate. Under stress, the mutant exhibited higher photosynthetic activities than the WT, based on considerably higher chlorophyll fluorescence induction, chlorophyll autofluorescence intensities, and oxygen evolution rates. Cell mortality caused by stress was reduced by half in the mutant culture compared with the WT. Enhanced protection of the mutant against stress is attributed to its accelerated carotenogenesis and accumulation of astaxanthin. Our results suggest that MT 2877, or other astaxanthin overproduction Haematococcus mutants, may offer dual benefits, as compared with the wild type, by increasing cellular astaxanthin content while reducing cell mortality during stress-induced carotenogenesis.

Kinetic study of the 2-methyl-3-methoxy-4-phenylbutanoic acid produced by oxidation of microcystin in aqueous solutions

Microcystins (MCs) are a family of related cyclic hepatotoxic heptapeptides, of which more than 70 types have been identified. The chemically unique nature of the C20 beta-amino acid, (2S, 3S, 8S, 9S)-3-amino-9-methoxy-2,6,8-trimethyl-10-phenyldeca4,6-dienoic acid (Adda), portion of the MCs has been exploited to develop a strategy to analyze the entirety. Oxidation of MCs causes the cleavage of MC Adda to form 2-methyl-3-methoxy-4-phenylbutanoic acid (MMPB). In the present study, we investigated the kinetics of MMPB produced by oxidation of the most-often-studied MC variant, MC-LR (L = leucine, R = arginine), with permanganate-periodate. This investigation allowed insight regarding the influence of the reaction conditions (concentration of the reactants, temperature, and pH) on the conversion rate. The results indicated that the reaction was second order overall and first order with respect to both permanganate and MC-LR. The second-order rate constant ranged from 0.66 to 1.35 M/s at temperatures from 10 to 30 degrees C, and the activation energy was 24.44 kJ/mol. The rates of MMPB production can be accelerated through increasing reaction temperature and oxidant concentration, and sufficient periodate is necessary for the formation of MMPB. The initial reaction rate under alkaline and neutral conditions is higher than that under acidic conditions, but the former decreases faster than the latter except under weakly acidic conditions. These results provided new insight concerning selection of the permanganate-periodate concentration, pH, and temperature needed for the oxidation of MCs with a high and stable yield of MMPB.

Light histories influence the impacts of solar ultraviolet radiation on photosynthesis and growth in a marine diatom, Skeletonema costatum

Phytoplanktonic species acclimated to high light are known to show less photoinhibition. However, little has been documented on how cells grown under indoor conditions for decades without exposure to UV radiation (UVR, 280-400 nm) would respond differently to solar UVR compared to those in situ grown under natural solar radiation. Here, we have shown the comparative photosynthetic and growth responses to solar UVR in an indoor-(IS) and a naturally grown (WS) Skeletonema costatum type. In short-term experiment (<1 day), phi(PSII) and photosynthetic carbon fixation rate were more inhibited by UVR in the IS than in the WS cells. The rate of UVR-induced damages of PSII was faster and their repair was significantly slower in IS than in WS. Even under changing solar radiation simulated for vertical mixing, solar UVR-induced higher inhibition of photosynthetic rate in IS than in WS cells. During long-term (10 days) exposures to solar radiation, the specific growth rate was much lower in IS than WS at the beginning, then increased 3 days later to reach an equivalent level as that of WS. UVR-induced inhibition of photosynthetic carbon fixation in the IS was identical with that of WS at the end of the long-term exposure. The photosynthetic acclimation was not accompanied with increased contents of UV-absorbing compounds, indicating that repair processes for UVR-induced damages must have been accelerated or upgraded. (C) 2008 Elsevier B.V. All rights reserved.

Fast-growing transgenic common carp mounfing compensatory growth

Compensatory growth is a phase of accelerated growth apparent when favourable conditions are restored after a period of growth depression. To investigate if F-2 common 'all-fish' growth hormone gene transgenic common carp (Cyprinus carpio) could mount compensatory growth, a 9 week study at 29 degrees C was performed. The control group was fed to satiation twice a day throughout the experiment. The other two groups were deprived of feed for 1 or 2 weeks, respectively, and then fed to satiation during the re-feeding period. At the end of the experiment, the live masses of fish in the deprived groups were still significantly lower than those of the controls. During the re-feeding period, size-adjusted mean specific growth rates and mean feed intakes were significantly higher in the deprived fish than in the controls, indicating a partial compensatory growth response in these fish. No significant differences were found in food conversion efficiency between the deprived and control fish during re-feeding, suggesting that hyperphagia was the mechanism responsible for increased growth rates. The proximate composition of the deprived fish at the end of the experiment was similar to that of the control fish. This study is, to our knowledge, the first to report that fast-growing transgenic fish can achieve partial compensation of growth following starvation. (c) 2007 The Authors Journal compilation (c) 2007 The Fisheries Society of the British Isles.

Kinetics of the oxidation of MCRR by potassium permanganate

The occurrence of the microcystins in the water bodies, especially in drinking water resources, has received considerable attentions. In situ chemical oxidation is a promising cost-effective treatment method to remove MC from water body. This research investigated the reaction kinetics of the oxidation of MCRR by permanganate. Experimental results indicate that the reaction is second order overall and first order with respect to both permanganate and MCRR, and has an activation energy of 18.9 kJ/mol. The second-order rate constant ranges from 0.154 to 0.225 l/mg/min at temperature from 15 to 30 degrees C. The MCRR degradation rates can be accelerated through increasing reaction temperature and oxidant concentration. The reaction under acid conditions was slightly faster than under alkaline conditions. The half-life of the reaction was less than 1 min, and more than 99.5% of MCRR was degraded within 10 min. (c) 2005 Elsevier Ltd. All rights reserved.