Effective handling of dialogue state in the hidden information state POMDP-based dialogue manager

Effective dialogue management is critically dependent on the information that is encoded in the dialogue state. In order to deploy reinforcement learning for policy optimization, dialogue must be modeled as a Markov Decision Process. This requires that the dialogue statemust encode all relevent information obtained during the dialogue prior to that state. This can be achieved by combining the user goal, the dialogue history, and the last user action to form the dialogue state. In addition, to gain robustness to input errors, dialogue must be modeled as a Partially Observable Markov Decision Process (POMDP) and hence, a distribution over all possible states must be maintained at every dialogue turn. This poses a potential computational limitation since there can be a very large number of dialogue states. The Hidden Information State model provides a principled way of ensuring tractability in a POMDP-based dialogue model. The key feature of this model is the grouping of user goals into partitions that are dynamically built during the dialogue. In this article, we extend this model further to incorporate the notion of complements. This allows for a more complex user goal to be represented, and it enables an effective pruning technique to be implemented that preserves the overall system performance within a limited computational resource more effectively than existing approaches. © 2011 ACM.

On the reaction of marine fishes in interrupted A.C. of 50 Hz

The reactions of marine fishes in interrupted A. C. off uniform electrical field and constant current density have been studied in order to determine the optimum effective periods of shock: for narcosis and fixation. Higher effective periods were required with gradual decrease in potential difference between head and tail, which in turn depended on the length of fish and its position in electrical field. The body voltage of fish varied directly with the length and inversely with the rise of angle between their body axis and field lines. The fish subjected to higher effective period took longer time for recovery from narcosis. The effect of impulse current was manifested by increased rate of gill movements in Platax tefora, Haetodon ollaris, Crysophus burda, Siganus vermiculatus and Scolopsis leucotaenia, and lowered rate of movements in others when subjected to different effective periods inspective of length.

Organic pollution in culture water resulting from excess feed and metabolite buildup

Penaeus monodon postlarvae were subjected to increasing feed concentrations and their growth and survival rates were recorded. Measurements were made of dissolved organic matter, and ammonia and nitrite-nitrogen concentrations. Survival was highest at the lowest feeding level and decreased as feed concentration increased. It is concluded that although organic matter enriches the food supply for P. monodon postlarvae, at higher concentration levels it can pollute the culture water, which in turn leads to mass mortality of the postlarvae. Secondly, the survival rate of P. monodon postlarvae is directly related to dissolved organic matter concentration, oxygen tension, and ammonia-nitrogen concentrations in the culture water. Even at sublethal levels these adverse environmental conditions decrease the survival rate.

Influences of dietary lipid and phosphorus levels on retention and excretion of phosphorus and nitrogen in fingerlings red sea bream, Pagrus major

A laboratory based 2x3 factorial experiment was conducted for 12 weeks to investigate the influences of dietary lipid and phosphorus (P) levels on retention and excretion of phosphorus and nitrogen (N) in fingerling red sea bream. Two levels of lipid (210 and 260 g/kg) and three levels of phosphorus (17, 14 and 12 g/kgˉ¹) in the dry diets were tested. Duplicate groups of 25 red sea bream (average weight 3.74±0.07 g) per 60L glass tank were fed experimental diets three times a day near to satiation level at 22 to 28°C water temperature. A reduction in dietary fish meal from 500 to 300 g/kg dry diet, corresponding to a supplementation in both dietary lipid and P resulted in significant increase in both P and N retention which resulted in the reduction of their excretion by red sea bream. The overall results of the present study demonstrated that both lipid and phosphorus supplementation are necessary for developing less-polluting feed which in turn, reduce fish meal level in the diet of fingerling red sea bream. Further studies in this regard with different size and age groups of red sea bream are warranted.

Investigation into IGBT dV/dt during turn-off and its temperature dependence

In many power converter applications, particularly those with high variable loads, such as traction and wind power, condition monitoring of the power semiconductor devices in the converter is considered desirable. Monitoring the device junction temperature in such converters is an essential part of this process. In this paper, a method for measuring the insulated gate bipolar transistor (IGBT) junction temperature using the collector voltage dV/dt at turn-OFF is outlined. A theoretical closed-form expression for the dV/dt at turn-OFF is derived, closely agreeing with experimental measurements. The role of dV/dt in dynamic avalanche in high-voltage IGBTs is also discussed. Finally, the implications of the temperature dependence of the dV/dt are discussed, including implementation of such a temperature measurement technique. © 2006 IEEE.

Contact and channel modelling using part and function libraries in a function-based design approach

To support the development and analysis of engineering designs at the embodiment stage, designers work iteratively with representations of those designs as they consider the function and form of their constituent parts. Detailed descriptions of "what a machine does" usually include flows of forces and active principles within the technical system, and their localization within parts and across the interfaces between them. This means that a representation should assist a designer in considering form and function at the same time and at different levels of abstraction. This paper describes a design modelling approach that enables designers to break down a system architecture into its subsystems and parts, while assigning functions and flows to parts and the interfaces between them. In turn, this may reveal further requirements to fulfil functions in order to complete the design. The approach is implemented in a software tool which provides a uniform, computable language allowing the user to describe functions and flows as they are iteratively discovered, created and embodied. A database of parts allows the user to search for existing design solutions. The approach is illustrated through an example: modelling the complex mechanisms within a humanoid robot. Copyright © 2010 by ASME.

Switching characteristics of diamond-based m-i-p+ diodes in power electronic applications

Modeling and numerical analysis of diamond m-i-p+ diode have been performed for static and transient analysis using TCAD Sentaurus platform. The simulation results are compared with experimental measurements. Prediction of transient turn-off characteristics of diamond m-i-p+ diode at high temperature is performed for the first time. It was found that unlike conventional Si diode, peak reverse current in diamond m-i-p+ diode reduces with increasing temperature while on-state voltage drop increases. © 2011 IEEE.

Photovoltaic measurements in carbon nanotube - Amorphous silicon core/shell nanowire

Carbon nanotube is one of the promising materials for exploring new concepts in solar energy conversion and photon detection. Here, we report the first experimental realization of a single core/shell nanowire photovoltaic device (2-4μm) based on carbon nanotube and amorphous silicon. Specifically, a multi-walled carbon nanotube (MWNTs) was utilized as the metallic core, on which n-type and intrinsic amorphous silicon layers were coated. A Schottky junction was formed by sputtering a transparent conducting indium-tin-oxide layer to wrap the outer shell of the device. The single coaxial nanowire device showed typical diode ratifying properties with turn-on voltage around 1V and a rectification ratio of 104 when biased at ±2V. Under illumination, it gave an open circuit voltage of ∼0.26V. Our study has shown a simple and useful platform for gaining insight into nanowire charge transport and collection properties. Fundamental studies of such nanowire device are important for improving the efficiency of future nanowire solar cells or photo detectors. © 2012 IEEE.

Real-time marker prediction and CoR estimation in optical motion capture

Optical motion capture systems suffer from marker occlusions resulting in loss of useful information. This paper addresses the problem of real-time joint localisation of legged skeletons in the presence of such missing data. The data is assumed to be labelled 3d marker positions from a motion capture system. An integrated framework is presented which predicts the occluded marker positions using a Variable Turn Model within an Unscented Kalman filter. Inferred information from neighbouring markers is used as observation states; these constraints are efficient, simple, and real-time implementable. This work also takes advantage of the common case that missing markers are still visible to a single camera, by combining predictions with under-determined positions, resulting in more accurate predictions. An Inverse Kinematics technique is then applied ensuring that the bone lengths remain constant over time; the system can thereby maintain a continuous data-flow. The marker and Centre of Rotation (CoR) positions can be calculated with high accuracy even in cases where markers are occluded for a long period of time. Our methodology is tested against some of the most popular methods for marker prediction and the results confirm that our approach outperforms these methods in estimating both marker and CoR positions. © 2012 Springer-Verlag.

Cortical substrates for exploratory decisions in humans.

Decision making in an uncertain environment poses a conflict between the opposing demands of gathering and exploiting information. In a classic illustration of this 'exploration-exploitation' dilemma, a gambler choosing between multiple slot machines balances the desire to select what seems, on the basis of accumulated experience, the richest option, against the desire to choose a less familiar option that might turn out more advantageous (and thereby provide information for improving future decisions). Far from representing idle curiosity, such exploration is often critical for organisms to discover how best to harvest resources such as food and water. In appetitive choice, substantial experimental evidence, underpinned by computational reinforcement learning (RL) theory, indicates that a dopaminergic, striatal and medial prefrontal network mediates learning to exploit. In contrast, although exploration has been well studied from both theoretical and ethological perspectives, its neural substrates are much less clear. Here we show, in a gambling task, that human subjects' choices can be characterized by a computationally well-regarded strategy for addressing the explore/exploit dilemma. Furthermore, using this characterization to classify decisions as exploratory or exploitative, we employ functional magnetic resonance imaging to show that the frontopolar cortex and intraparietal sulcus are preferentially active during exploratory decisions. In contrast, regions of striatum and ventromedial prefrontal cortex exhibit activity characteristic of an involvement in value-based exploitative decision making. The results suggest a model of action selection under uncertainty that involves switching between exploratory and exploitative behavioural modes, and provide a computationally precise characterization of the contribution of key decision-related brain systems to each of these functions.

Detailed design of242mAm breeding in pressurized water reactors

There is growing interest in the use of 242mAm as a nuclear fuel. Because of its very high thermal fission cross section and its large number of neutrons released per fission, it can be used for various unique applications, such as space propulsion, medical applications, and compact energy sources. Since the thermal absorption cross section of 242mAm is very high, the best way to obtain 242mAm is by the capture of fast or epithermal neutrons in 241Am. However, fast spectrum reactors are not readily available. In this paper, we explore the possibility of producing 242mAm in existing pressurized water reactors (PWRs) with minimal interference in reactor performance. As suggested in previous studies on the subject, the 242mAm breeding targets are shielded with strong thermal absorbers in order to suppress the thermal neutron flux that causes 242mAm destruction. Since 242mAm enrichment within the Am target mainly depends on the neutron energy distribution, which in turn depends on the Am target thickness and on the neutron filter cutoff energy (thermal absorber type), this unique Am target design was developed. In our study, Cd, Sm, and Gd were considered as thermal neutron filters, as suggested by Cesana et al. The most favorable results were obtained by irradiating Am targets covered either with Gd or Cd. In these cases, up to 8.65% enrichment of 242mAm is obtained after 4.5 yr (three successive PWR fuel cycles) of irradiation. It was also found that significant quantities [up to 1.3 kg/GW (electric)-yr] of 242mAm can be obtained in PWR reactors without notable interference with reactor performance. However, in order to maintain the original fuel cycle length, the enrichment of the driver (UO2) fuel must be increased by ∼1%, raised from the conventional 4.5 to 5.5%, depending on the thermal neutron filter used. The most important reactivity feedback coefficients for fuel assemblies containing the 242mAm breeding targets were evaluated and found to be close to those of a standard PWR. Another product of neutron capture in the 241Am reaction is 238Pu. It was found that in a typical 1000 MW (electric) PWR core with one-third of the fuel assemblies containing 241Am targets, up to 15.1 kg of 238Pu enriched to 80% can be produced per year.

Optimization of burnable poison design for Pu incineration in fully fertile free PWR core

The design challenges of the fertile-free based fuel (FFF) can be addressed by careful and elaborate use of burnable poisons (BP). Practical fully FFF core design for PWR reactor has been reported in the past [1]. However, the burnable poison option used in the design resulted in significant end of cycle reactivity penalty due to incomplete BP depletion. Consequently, excessive Pu loading were required to maintain the target fuel cycle length, which in turn decreased the Pu burning efficiency. A systematic evaluation of commercially available BP materials in all configurations currently used in PWRs is the main objective of this work. The BP materials considered are Boron, Gd, Er, and Hf. The BP geometries were based on Wet Annular Burnable Absorber (WABA), Integral Fuel Burnable Absorber (IFBA), and Homogeneous poison/fuel mixtures. Several most promising combinations of BP designs were selected for the full core 3D simulation. All major core performance parameters for the analyzed cases are very close to those of a standard PWR with conventional UO2 fuel including possibility of reactivity control, power peaking factors, and cycle length. The MTC of all FFF cores was found at the full power conditions at all times and very close to that of the UO2 core. The Doppler coefficient of the FFF cores is also negative but somewhat lower in magnitude compared to UO2 core. The soluble boron worth of the FFF cores was calculated to be lower than that of the UO2 core by about a factor of two, which still allows the core reactivity control with acceptable soluble boron concentrations. The main conclusion of this work is that judicial application of burnable poisons for fertile free fuel has a potential to produce a core design with performance characteristics close to those of the reference PWR core with conventional UO2 fuel.

Phase perfection in zinc Blende and Wurtzite III-V nanowires using basic growth parameters.

Controlling the crystallographic phase purity of III-V nanowires is notoriously difficult, yet this is essential for future nanowire devices. Reported methods for controlling nanowire phase require dopant addition, or a restricted choice of nanowire diameter, and only rarely yield a pure phase. Here we demonstrate that phase-perfect nanowires, of arbitrary diameter, can be achieved simply by tailoring basic growth parameters: temperature and V/III ratio. Phase purity is achieved without sacrificing important specifications of diameter and dopant levels. Pure zinc blende nanowires, free of twin defects, were achieved using a low growth temperature coupled with a high V/III ratio. Conversely, a high growth temperature coupled with a low V/III ratio produced pure wurtzite nanowires free of stacking faults. We present a comprehensive nucleation model to explain the formation of these markedly different crystal phases under these growth conditions. Critical to achieving phase purity are changes in surface energy of the nanowire side facets, which in turn are controlled by the basic growth parameters of temperature and V/III ratio. This ability to tune crystal structure between twin-free zinc blende and stacking-fault-free wurtzite not only will enhance the performance of nanowire devices but also opens new possibilities for engineering nanowire devices, without restrictions on nanowire diameters or doping.

Kelvin-Helmholtz-like instabilities in turbulent flows over complex surfaces

Riblets are small surface protrusions aligned with the flow direction, which confer an anisotropic roughness to the surface [6]. We have recently reported that the transitional-roughness effect in riblets, which limits their performance, is due to a Kelvin–Helmholtz-like instability of the overlying mean flow [7]. According to our DNSs, the instability sets on as the Reynolds number based on the roughness size of the riblets increases, and coherent, elongated spanwise vortices begin to develop immediately above the riblet tips, causing the degradation of the drag-reduction effect. This is a very novel concept, since prior studies had proposed that the degradation was due to the interaction of riblets with the flow as independent units, either to the lodging of quasi-streamwise vortices in the surface grooves [2] or to the shedding of secondary streamwise vorticity at the riblet peaks [9]. We have proposed an approximate inviscid analysis for the instability, in which the presence of riblets is modelled through an average boundary condition for an overlying, spanwise-independent mean flow. This simplification lacks the accuracy of an exact analysis [4], but in turn applies to riblet surfaces in general. Our analysis succeeds in predicting the riblet size for the onset of the instability, while qualitatively reproducing the wavelengths and shapes of the spanwise structures observed in the DNSs. The analysis also connects the observations with the Kelvin–Helmholtz instability of mixing layers. The fundamental riblet length scale for the onset of the instability is a ‘penetration length,’ which reflects how easily the perturbation flow moves through the riblet grooves. This result is in excellent agreement with the available experimental evidence, and has enabled the identification of the key geometric parameters to delay the breakdown. Although the appearance of elongated spanwise vortices was unexpected in the case of riblets, similar phenomena had already been observed over other rough [3], porous [1] and permeable [11] surfaces, as well as over plant [5,14] and urban [12] canopies, both in the transitional and in the fully-rough regimes. However, the theoretical analyses that support the connection of these observations with the Kelvin–Helmholtz instability are somewhat scarce [7, 11, 13]. It has been recently proposed that Kelvin–Helmholtz-like instabilities are a dominant feature common to “obstructed” shear flows [8]. It is interesting that the instability does not require an inflection point to develop, as is often claimed in the literature. The Kelvin-Helmholtz rollers are rather triggered by the apparent wall-normal-transpiration ability of the flow at the plane immediately above the obstructing elements [7,11]. Although both conditions are generally complementary, if wall-normal transpiration is not present the spanwise vortices may not develop, even if an inflection point exists within the roughness [10]. REFERENCES [1] Breugem, W. P., Boersma, B. J. & Uittenbogaard, R. E. 2006 J. Fluid Mech. 562, 35–72. [2] Choi, H., Moin, P. & Kim, J. 1993 J. Fluid Mech. 255, 503–539. [3] Coceal, O., Dobre, A., Thomas, T. G. & Belcher, S. E. 2007 J. Fluid Mech. 589, 375–409. [4] Ehrenstein, U. 2009 Phys. Fluids 8, 3194–3196. [5] Finnigan, J. 2000 Ann. Rev. Fluid Mech. 32, 519–571. [6] Garcia-Mayoral, R. & Jimenez, J. 2011 Phil. Trans. R. Soc. A 369, 1412–1427. [7] Garcia-Mayoral, R. & Jimenez, J. 2011 J. Fluid Mech. doi: 10.1017/jfm.2011.114. [8] Ghisalberti, M. 2009 J. Fluid Mech. 641, 51–61. [9] Goldstein, D. B. & Tuan, T. C. 1998 J. Fluid Mech. 363, 115–151. [10] Hahn, S., Je, J. & Choi, H. 2002 J. Fluid Mech. 450, 259–285. [11] Jimenez, J., Uhlman, M., Pinelli, A. & G., K. 2001 J. Fluid Mech. 442, 89–117. [12] Letzel, M. O., Krane, M. & Raasch, S. 2008 Atmos. Environ. 42, 8770–8784. [13] Py, C., de Langre, E. & Moulia, B. 2006 J. Fluid Mech. 568, 425–449. [14] Raupach, M. R., Finnigan, J. & Brunet, Y. 1996 Boundary-Layer Meteorol. 78, 351–382.

A hybrid density functional view of native vacancies in gallium nitride.

We investigated the transition energy levels of the vacancy defects in gallium nitride by means of a hybrid density functional theory approach (DFT). We show that, in contrast to predictions from a recent study on the level of purely local DFT, the inclusion of screened exchange stabilizes the triply positive charge state of the nitrogen vacancy for Fermi energies close to the valence band. On the other hand, the defect levels associated with the negative charge states of the nitrogen vacancy hybridize with the conduction band and turn out to be energetically unfavorable, except for high n-doping. For the gallium vacancy, the increased magnetic splitting between up-spin and down-spin bands due to stronger exchange interactions in sX-LDA pushes the defect levels deeper into the band gap and significantly increases the associated charge transition levels. Based on these results, we propose the ϵ(0| - 1) transition level as an alternative candidate for the yellow luminescence in GaN.