Investigation of multilingual deep neural networks for spoken term detection

The development of high-performance speech processing systems for low-resource languages is a challenging area. One approach to address the lack of resources is to make use of data from multiple languages. A popular direction in recent years is to use bottleneck features, or hybrid systems, trained on multilingual data for speech-to-text (STT) systems. This paper presents an investigation into the application of these multilingual approaches to spoken term detection. Experiments were run using the IARPA Babel limited language pack corpora (∼10 hours/language) with 4 languages for initial multilingual system development and an additional held-out target language. STT gains achieved through using multilingual bottleneck features in a Tandem configuration are shown to also apply to keyword search (KWS). Further improvements in both STT and KWS were observed by incorporating language questions into the Tandem GMM-HMM decision trees for the training set languages. Adapted hybrid systems performed slightly worse on average than the adapted Tandem systems. A language independent acoustic model test on the target language showed that retraining or adapting of the acoustic models to the target language is currently minimally needed to achieve reasonable performance. © 2013 IEEE.

Elevated levels of urinary 8-hydroxy-2'-deoxyguanosine in male electrical and electronic equipment dismantling workers exposed to high concentrations of polychlorinated dibenzo-p-dioxins and dibenzofurans, polybrominated diphenyl ethers, and polychlorinated biphenyls

To investigate the occupational exposure levels to polychlorinated dibenzo-p-dioxins and dibenzofurans (PCDD/Fs), polybrominated diphenyl ethers (PBDEs), and polychlorinated biphenyls (PCBs), indoor dust (n = 3) in workshops and hair samples from male workers (n = 64) were collected at two electrical and electronic equipment waste (E-waste) dismantling factories located in the LQ area in east China in July 11-13, 2006. Pre- and postworkshift urines (64 of each) were also collected from the workers to study oxidative damage to DNA using 8-hydroxy-2'-deoxyguanosine (8-OHdG) as a biomarker. The concentrations of PCDD/Fs, PCDD/F-WHO-TEQs, PBDEs, PCBs and PCB-WHO-TEQs were (50.0 +/- 8.1) x 10(3), 724.1 +/- 249.6, (27.5 +/- 5.8) x 10(6), (1.6 +/- 0.4) x 10(9), (26.2 +/- 3.0) x 10(3) pg/g dry weight (dw) in dust, and (2.6 +/- 0.6) x 10(3), 42.4 +/- 9.3, (870.8 +/- 205.4) x 10(3), (1.6 +/- 0.2) x 10(6), 41.5 +/- 5.5 pg/g dw in hair, respectively. The homologue and congener profiles in the samples demonstrated that high concentrations of PCDD/Fs, PBDEs, and PCBs were originated from open burning of E-waste. The 8-OHdG levels were detected at 6.40 +/- 1.64 mu mol/mol creatinine in preworkshift urines. However, the levels significantly increased to 24.55 +/- 5.96 mu mol/mol creatinine in postworkshift urines (p < 0.05). Then, it is concluded that there is a high cancer risk originated from oxidative stress indicated by the elevated 8-OHdG levels in the E-waste dismantling workers exposed to high concentrations of PCDD/Fs, PBDEs, and PCBs.

Avoiding pathologies in very deep networks

Choosing appropriate architectures and regularization strategies of deep networks is crucial to good predictive performance. To shed light on this problem, we analyze the analogous problem of constructing useful priors on compositions of functions. Specifically, we study the deep Gaussian process, a type of infinitely-wide, deep neural network. We show that in standard architectures, the representational capacity of the network tends to capture fewer degrees of freedom as the number of layers increases, retaining only a single degree of freedom in the limit. We propose an alternate network architecture which does not suffer from this pathology. We also examine deep covariance functions, obtained by composing infinitely many feature transforms. Lastly, we characterize the class of models obtained by performing dropout on Gaussian processes.

Enzyme-linked immunosorbent assay of changes in serum levels of growth hormone (cGH) in common carps (Cyprinus carpio)

The aim of the present study was to purify the common native carp growth hormone (ncGH), produce monoclonal antibodies (mAbs) to common native carp growth hormone (ncGH), and further enhance the sensitivity of enzyme-linked immunosorbent assays (ELISA) for ncGH. Additionally, we investigated changes in serum ncGH levels in carps raised in different environmental conditions. The recombinant grass carp (Ctenopharyngodon idella) growth hormone was purified and used as antigen to immunize the rabbit. The natural ncGH was isolated from the pituitaries of common carp. SDS-PAGE and Western blot utilizing the polyclonal anti-rgcGH antibody confirmed the purification of ncGH from pituitaries. Purified ncGH was then used as an immunogen in the B lymphocyte hybridoma technique. A total of 14 hybridoma cell lines (FMU-cGH 1-14) were established that were able to stably secrete mAbs against ncGH. Among them, eight clones (FMU-cGH1-6, 12 and 13) were successfully used for Western blot while nine clones (FMU-cGH 1-7, 9 and 10) were used in fluorescent staining and immunohistochemistry. Epitope mapping by competitive ELISA demonstrated that these mAbs recognized five different epitopes. A sensitive sandwich ELISA for detection of ncGH was developed using FMU-cGH12 as the coating mAb and FMU-cGH6 as the enzyme labeled mAb. This detection system was found to be highly stable and sensitive, with detection levels of 70 pg/mL. Additionally, we found that serum ncGH levels in restricted food group and in the net cage group increased 6.9-and 5.8-fold, respectively, when compared to controls, demonstrating differences in the GH stress response in common carp under different living conditions.

In situ studies on physiological and biochemical responses of four fishes with different trophic levels to toxic cyanobacterial blooms in a large Chinese lake

Physiological and biochemical responses of four fishes with different trophic levels to toxic cyanobacterial blooms were studied in a large net cage in Meiliang Bay, a hypereutrophic region of Lake Taihu. We sampled four fishes: the phytoplanktivorous Hypophthalmichthys molitrix and Aristichthys nobilis, the omnivorous Carassius auratus, and the carnivorous Culter ilishaeformis. Alterations of the antioxidant (GSH) and the major antioxidant enzymes (CAT, SOD, GPx, GST) in livers were monitored monthly, and the ultrastructures of livers were compared between the bloom and post-bloom periods. During the cyanobacterial blooms, the phytoplanktivorous fishes displayed only slight ultrastructural changes in liver, while the carnivorous fish presented the most serious injury as swollen endomembrane system and morphologically altered nuclei in hepatocytes. Biochemically, the phytoplanktivorous fishes possessed higher basal GSH concentrations and better correlations between the major antioxidant enzymes in liver, which might be responsible for their powerful resistance to MCs. This article provided physiological and toxicological evidences for the possible succession of fish communities following occurrence of toxic cyanobacterial blooms and also for the applicability of using phytoplanktivorous fish to counteract toxic cyanobacterial blooms in natural waters. (C) 2007 Elsevier Ltd. All rights reserved.

Thermo-hydro-geomechanical simulations of methane gas production from deep sea methane hydrate formations

A new constitutive model called Methane Hydrate Critical State (MHCS) model was conducted to investigate the geomechanical response of the gas-hydrate-bearing sediments at the Nankai Trough during the wellbore construction process. The strength and dilatancy of gas-hydrate-bearing soil would gradually disappear when the bonds are destroyed because of excessively shearing, which are often observed in dense soils and also in bonded soils such as cemented soil and unsaturated soil. In this study, the MHCS model, which presents such softening features, would be incorporated into a staged-finite-element model in ABAQUS, which mainly considered the loading history of soils and the interaction between cement-casing-formation. This model shows the influence of gas-hydrate-bearing soil to the deformation and stability of a wellbore and the surrounding sediments during wellbore construction. At the same time, the conventional Mohr-Coulomb model was used in the model to show the advantages of MHCS model by comparing the results of the two models.

Oxygen vacancy defects in Ta2O5 showing long-range atomic re-arrangements

The structure, formation energy, and energy levels of the various oxygen vacancies in Ta2O5 have been calculated using the λ phase model. The intra-layer vacancies give rise to unusual, long-range bonding rearrangements, which are different for each defect charge state. The 2-fold coordinated intra-layer vacancy is the lowest cost vacancy and forms a deep level 1.5 eV below the conduction band edge. The 3-fold intra-layer vacancy and the 2-fold inter-layer vacancy are higher cost defects, and form shallower levels. The unusual bonding rearrangements lead to low oxygen migration barriers, which are useful for resistive random access memory applications. © 2014 AIP Publishing LLC.

Effects of polyaluminum chloride and copper sulfate on phosphorus and UV254 under different anoxic levels

Experimental sediments and water from shallow, eutrophic Dianchi Lakes were treated in a controlled laboratory microcosm using different chemicals under different anoxic levels. This study revealed that the polyaluminum chloride (PAC) was able to inhibit the phosphorus release and decrease the UV254 value at any anoxic level. When the DO concentrations were between 0.76-0.95 mg(.) L-1, the UV(254)value, total phosphorus (TP), and total dissolved phosphorus (TDP) in the water column were decreased by 71.93%, 87.12% and 64.24% respectively. The UV254, TP, and TDP were also decreased by 72.94%, 70.87% and 50.76% respectively at the levels of 4.56-5.32mg(.)L(-1) of DO concentrations. The treatment effects of TP and TDP in the water column using copper sulfate however were not as efficient as the PAC treatment. The UV254 value was increased with the addition of copper sulfate at every anoxic level tested but the chlorophyll-a (Chl-a) content was decreased rapidly and efficiently by copper sulfate more than the treatment by PAC. When the DO concentrations were 0.76-0.86mg(.)L(-1) and 4.75-5.14mg(.)L(-1), the Chl-a concentrations were decreased by 84.87% and 75.07% respectively through copper sulfate treatment. With additions of PAC and copper sulfate, the phosphorus fractions in sediments were shifted forward to the favorable shapes that have little ability of release. The TP concentrations in sediments were increased after treatment via PAC and copper sulfate. Under anoxic conditions, most of the BD-P (Fe-P) to NaOH-P (Al-P) was converted using the recommended PAC dose in BD-P rich sediment. Similar to the PAC, the copper sulfate also could flocculate the exchange phosphorus from sediment to overlying water. Overall though, the effects of copper sulfate treatment were not better than that of the PAC.

Present status and changes of the phytoplankton community after invasion of Neosalanx taihuensis since 1982 in a deep oligotrophic plateau lake, Lake Fuxian in the subtropical China

Phytoplankton assemblages in the subtrophical oligotrophic Lake Fuxian, the second deepest lake in China, were investigated monthly from September 2002 to August 2003. A total of 113 species belonging to seven phyla were identified, among them, a filamentous green alga, Mougeotia sp., dominated almost throughout the study period and comprised most of the total phytoplankton biomass. Mougeotia sp. has made a substantial development during the past decades: it was absent in 1957, only occasionally present in 1983, increased substantially in 1993, and became predominant in 2002-2003. It is likely that natural invasion of the Taihu Lake noodlefish (Neosalanx taihuensis) has led to a change of dominant herbivorous zooplankton from small to large calanoid, which has increased grazing pressure on small edible algae, and thus has indirectly favored the development of the inedible filamentous Mougeotia sp.

Positive effects of continuous low nitrate levels on growth and photosynthesis of Alexandrium tamarense (Gonyaulacales, Dinophyceae)

The growth and photosynthesis of Alexandrium tamarense (Lebour) Balech in different nutrient conditions were investigated. Low nitrate level (0.0882 mmol/L) resulted in the highest average growth rate from day 0 to day 10 (4.58 x 10(2) cells mL(-1) d(-1)), but the lowest cell yield (5420 cells mL(-1)) in three nitrate level cultures. High nitrate-grown cells showed lower levels of chlorophyll a-specific and cell-specific light-saturated photosynthetic rate (P-m(chl a) and P-m(cell)), dark respiration rate (R-d(chl a) and R-d(cell)) and chlorophyll a-specific apparent photosynthetic efficiency (alpha(chl a)) than was seen for low nitrate-grown cells; whereas the cells became light saturated at higher irradiance at low nitrate condition. When cultures at low nitrate were supplemented with nitrate at 0.7938 mmol/L in late exponential growth phase, or with nitrate at 0.7938 mmol/L and phosphate at 0.072 mmol/L in stationary growth phase, the cell yield was drastically enhanced, a 7-9 times increase compared with non-supplemented control culture, achieving 43 540 cells mL(-1) and 52 300 cells mL(-1), respectively; however, supplementation with nitrate in the stationary growth phase or with nitrate and phosphate in the late exponential growth phase increased the cell yield by no more than 2 times. The results suggested that continuous low level of nitrate with sufficient supply of phosphate may facilitate the growth of A. tamarense.

Fibre optic monitoring of a deep circular excavation

This paper describes part of the monitoring undertaken at Abbey Mills shaft F, one of the main shafts of Thames Water's Lee tunnel project in London, UK. This shaft, with an external diameter of 30 m and 73 m deep, is one of the largest ever constructed in the UK and consequently penetrates layered and challenging ground conditions (Terrace Gravel, London Clay, Lambeth Group, Thanet Sand Formation, Chalk Formation). Three out of the twenty 1-2 m thick and 84 m deep diaphragm wall panels were equipped with fibre optic instrumentation. Bending and circumferential hoop strains were measured using Brillouin optical time-domain reflectometry and analysis technologies. These measurements showed that the overall radial movement of the wall was very small. Prior to excavation during a dewatering trial, the shaft may have experienced three-dimensional deformation due to differential water pressures. During excavation, the measured hoop and bending strains of the wall in the chalk exceeded the predictions. This appears to be related to the verticality tolerances of the diaphragm wall and lower circumferential hoop stiffness of the diaphragm walls at deep depths. The findings from this case study provide valuable information for future deep shafts in London. © ICE Publishing: All rights reserved.

Effects of doubled atmospheric CO2 concentration on the photosynthesis and growth of Chlorella pyrenoidosa cultured at varied levels of light

Chlorella pyrenoidosa was cultured with 350 and 700 p.p.m.v. CO2 at varied levels of light to see the impacts of doubled atmospheric CO2 concentration on its growth and photosynthesis. The CO2 enrichment did not affect the growth rate (mu), but significantly increased the cell density when light was sufficiently supplied. The CO2 enrichment significantly depressed light-saturated photosynthesis and dark respiration in the cells grown under a high-light regime, but not those under a low-light regime. The light-saturating point for photosynthesis and photosynthetic efficiency was not affected by the CO2 enrichment under either the high-light or low-light conditions.

Patterns and levels of PCDD/F in a Chinese graphite electrode sludge

The graphite electrode sludge was sampled from a huge chloralkali plant in central China. The total level of PCDD/F was found as high as 378.85 mu g/kg sludge (dry weight). The patterns of PCDD/F in each homologue indicated the predominance of tetra- to octa-chlorinated PCDFs, Furthermore, the toxic 2,3,7,8-substituted PCDFs constituted over 80% of the total PCDFs in the sludge and the corresponding PCDDs were only at 15 mu g/kg level. The calculated value of the international toxic equivalence (I-TEQ) in sludge was 21.65 mu g/kg sludge (dry weight). This typical "dioxin chloralkali pattern" was apparently identified in the sediments near the effluent outlet of the chloralkali plant.