Natural actor and belief critic: Reinforcement algorithm for learning parameters of dialogue systems modelled as POMDPs

This article presents a novel algorithm for learning parameters in statistical dialogue systems which are modeled as Partially Observable Markov Decision Processes (POMDPs). The three main components of a POMDP dialogue manager are a dialogue model representing dialogue state information; a policy that selects the system's responses based on the inferred state; and a reward function that specifies the desired behavior of the system. Ideally both the model parameters and the policy would be designed to maximize the cumulative reward. However, while there are many techniques available for learning the optimal policy, no good ways of learning the optimal model parameters that scale to real-world dialogue systems have been found yet. The presented algorithm, called the Natural Actor and Belief Critic (NABC), is a policy gradient method that offers a solution to this problem. Based on observed rewards, the algorithm estimates the natural gradient of the expected cumulative reward. The resulting gradient is then used to adapt both the prior distribution of the dialogue model parameters and the policy parameters. In addition, the article presents a variant of the NABC algorithm, called the Natural Belief Critic (NBC), which assumes that the policy is fixed and only the model parameters need to be estimated. The algorithms are evaluated on a spoken dialogue system in the tourist information domain. The experiments show that model parameters estimated to maximize the expected cumulative reward result in significantly improved performance compared to the baseline hand-crafted model parameters. The algorithms are also compared to optimization techniques using plain gradients and state-of-the-art random search algorithms. In all cases, the algorithms based on the natural gradient work significantly better. © 2011 ACM.

Reliability and need for standardisation of electrical systems in small wooden fishing vessels

The working condition and atmosphere in a wooden fishing vessel are generally most injurious to the electrical systems. Therefore great care has to be taken in designing electrical systems for small c1afts. This paper deals with the difficult operating conditions and standardisation of electrical systems as applicable to small fishing vessels.

Chemical control of psychrophilic bacterial spoilage of fish 1. Isolation and identification of psychrophilic bacteria from marine fish

Making use of the streak plate technique and low temperature incubation, 28 cultures belonging to six genera namely, Achromobacter, Flavobacterium, Pseudomonas, Micrococcus, Vibrio and Alcaligenes were isolated from different varieties of marine fish. The growth studies indicated that all of them were able to grow between -5 and +5°C within a week's time and none of them showed growth at 37°C. The optimum temperature of growth for all these cultures was in the range 25-28°C. Among these only one, i.e., a Vibrio sp., was found to be an obligate psychrophile.

Response of extract release volume to the variations in pH and microbial load during spoilage of fish at refrigeration temperature

This report briefly describes the microbial status and storage properties of fish raised under composite fish culture in sewage fed ponds.

The biology and control of Caligus sp., an ectoparasite of the adult milkfish Chanos chanos Forskal

One unidentified species of copepod belonging to the genus Caliqus of the family Caigidae was found to infest the adult milkfish broodstock. To control the parasites infesting the adult milkfish, tests were made using the chemical (2,2,2-trichloro-1-hydroxyl)-phosphonic acid-dimethylethol (Neguvon) at a concentration of 0 . 25 ppm. It is noted that a concentration of 0 . 25 ppm of Neguvon maintained for 12-24 hours in the sabalo-containing tanks in a closed water system but with aeration is effective in controlling the parasites. Fish mortality during the experiment was due to inadequate aeration in the tanks.

Effect of paradoxical sleep deprivation and stress on passive avoidance behavior

Previous studies have shown that several types of stress can induce memory impairment. However, the memory effects of paradoxical sleep deprivation (PSD), a stressor in itself, are unclear. We therefore compared passive avoidance behavior of rats undergoing PSD and PSD stress yoked-control (PSC) using the "reversed flowerpot method." When rats were kept isolated on a PSC platform for 24 It immediately after criterion training, retention trials showed impaired aversive memory storage. When delayed for 24 h after criterion training, PSC stress did not disrupt retention performance. In rats subjected to PSD, either immediately or 24 It after criterion training, there was no disruption of aversive memory consolidation. These results suggest that, during stress, paradoxical sleep plays a role in erasing aversive memory traces, in line with the theory that we "dream in order to forget." (C) 2003 Elsevier Inc. All rights reserved.

The zooplankton population structure and their trend of variations in the southern of Caspian Sea (Iranian waters)

Caspian Sea has gone under a lot of changes due to human influences and the unwanted presence of a ctenophora Menomiopsis leidyi which has greatly changed the structure of planktons in the last recent years. Therefore, this study was carried out in order to determine these changes in the zooplankton community. the Sampling was done in 8 transacts in Astara, Anzali, Sefidrood, Tonekaboun, Noushahr, Babolsar, Amirabad and Bandar Torkaman coastal waters at 5 different depths including 5, 10, 20, 50 and 100 m. Sampling was carried out in four seasons of spring, summer, autumn and winter during 2008, 2009 and 2010 on board of R/V Gilan. Altogether, 12 species of zooplankton were identified in 2008, 22 species in 2009 and 14 species in 2010. The zooplankton included four groups: copepoda (4 species), cladocera (8species), rotatoria (10 species) and protozoa (2 species).The increase of diversity in 2009 was due to cladocera and rotatoria groups. The abundance of zooplankton in the spring was 5074 + 7807 ind/m3 more than other season in 2008. The abundance of copepoda in the summer reached the highest value of 3332 ind/m3 and since autumn the abundance gradually decreases and in the winter reached to the lowest value. The most abundance of cladocera was 797 ind/m3 in winter and decreased in summer and autumn. The abundance of rotatoria was 2189 ind/m3 in winter. rotifera and copepoda consisted the main population of Zooplanktons in the winter. The results of 2009 and 2010 showed that the abundance of zooplankton in winter was 2.6 fold of autumn, 1.6 fold of summer and 1.1 fold (1/9 fold in 2010)of spring. After increasing increased of temperature, phytoplankton, and zooplankton in summer, M.leidyi increased too. In the autumn M. leidyi reached to the highest rate and decreased zooplankton. The maximum population of zooplankton was in the layer 0-20 m and in the layer more than 20 meters, the abundance of zooplankton decreased very much. In 216 2008, 2009 and 2010, the abundance of zooplankton was 87, 77 and 77 percent in the layer 0-20 m respectively. In this study, the thermocline was observed in the layer 10 – 20 meters in the spring, that formed a thin layer but in the summer it was in the layer 20 to 50 meters. Temperature decreased between 11 to 15 oC in this layer. The variation of temperature between surfaces to bottom was 10 to 13 oC in spring, 19 to 21 in summer, about 9 oC in autumn and maximum 3 oC in winter. The most biomass of zooplankton was in the west. The biomass of zooplankton in central west and east of Southern of Caspian Sea was 54 %, 22 % and 24 % respectively in 2008, in 2009 was 48%, 33% and 20% respectively and in 2010 was 54 %, 29 % and 16 % respectively .The biomass decreased from west to east. The model of zooplankton designed by principal component analysis (PCA)and linear regression for Southern of Caspian Sea.

Biodiversity values of different aquatic systems, habitats and organisms in relation to restoration and sustaining of biodiversity

Biodiversity values provide objective data and advice from which policy makes could assess the conservation options and determine optimal policies that would balance the needs of conservation with the socia-economic needs of the people in the area.

The fish stocks in Uganda aquatic systems: opportunities and challenges for transformation

The status of fish stocks in a water body at any one time is a function of several factors affecting the production of fish in that water body. These include: total number (abundance) and biomass(weight) present, growth (size and age), recruitment (the quantity of fish entering the fishery) including reproduction, mortality which is caused by fishing or natural causes, Other indirect factors of major importance to the status of the stocks include production factors (water quality and availability of natural food for fish), the life history parameters of the different species making up the stocks (e.g. sex ratios, condition of the fish, reproductive potential (i.e. fecundity) etc), Changes in fish stocks do occur when any of the above listed factors directly influence aspects of growth, reproduction and mortality and therefore, numbers and standing stock (biomass). In the exploited fisheries, major research concerns regarding stocks relate to the listed factors especially: estimates of stock abundance/biomass, the quantity of fish being caught,where the fish are caught, which species are caught (relative abundance)when the fish are caught, how the fish are caught. The balance between stock abundance and amount of fish caught provides the basis for intervention. Due to the diverse characteristics of the physical water environment, fishes are in general, not evenly distributed throughout a water body. Shallow and vegetated areas tend to support higher abundance and diversity of fish species. In addition, seasonal variations in fish abundance are so strong that fluctuations in catch have to be expected at fish landings.

Fishery resource assessment and monitoring in the development and control of fisheries in the Lake Volta

Gill-netting and rotenoning have been used for assessing and monitoring fish stock abundance in Volta Lake. The lake and the main gear types used on it have been described. Before a gill-net sampling plan was set up, a preliminary survey was undertaken which largely determined the final form of the plan. An investigation as to whether or not the lake was being overfished concluded that it was being underfished. Commercial and experimental catch data analyses disclosed that the adults of the small species were being little utilized. Commercial sized species were also not being harvested according to their apparent proportion in the population. Production is presently fluctuating between approximately 37,000 and 40,000 tonnes. A high correlation between commercial and experimental catch was realized. Developments which have followed in the wake of stock assessment and monitoring studies include: introduction of monofilament nylon net, development of a special scoop net to permit mass harvest of clupeids after they have been attracted to light, and the design of a larger canoe which would help to extend the fishery into open water. New regulation and management policies will have to be formulated in the light of new findings before a rational exploitation of all the species can be achieved.

Guided propagation of surface acoustic waves and piezoelectric field enhancement in ZnO/GaAs systems

The characteristics and dispersion of the distinct surface acoustic waves (SAWs) propagating in ZnO/GaAs heterostructures have been studied experimentally and theoretically. Besides the Rayleigh mode, strong Sezawa modes, which propagate confined in the overlayer, arise due to the smaller sound velocity in ZnO than in the substrate. The design parameters of the structure providing the strongest piezoelectric field at a given depth within the layered system for the different modes have been determined. The piezoelectric field of the Rayleigh mode is shown to be more than 10 times stronger at the interface region of the tailored ZnO/GaAs structure than at the surface region of the bulk GaAs, whereas the same comparison for the first Sezawa mode yields a factor of 2. This enhancement, together with the capacity of selecting waves with different piezoelectric and strain field depth profiles, will facilitate the development of SAW-modulated optoelectronic applications in GaAs-based systems. © 2011 American Institute of Physics.