Continuous speech recognition for the TIMIT database using neural networks

Four types of neural networks which have previously been established for speech recognition and tested on a small, seven-speaker, 100-sentence database are applied to the TIMIT database. The networks are a recurrent network phoneme recognizer, a modified Kanerva model morph recognizer, a compositional representation phoneme-to-word recognizer, and a modified Kanerva model morph-to-word recognizer. The major result is for the recurrent net, giving a phoneme recognition accuracy of 57% from the si and sx sentences. The Kanerva morph recognizer achieves 66.2% accuracy for a small subset of the sa and sx sentences. The results for the word recognizers are incomplete.

Probabilistic fault identification using vibration data and neural networks

Bayesian formulated neural networks are implemented using hybrid Monte Carlo method for probabilistic fault identification in cylindrical shells. Each of the 20 nominally identical cylindrical shells is divided into three substructures. Holes of (12±2) mm in diameter are introduced in each of the substructures and vibration data are measured. Modal properties and the Coordinate Modal Assurance Criterion (COMAC) are utilized to train the two modal-property-neural-networks. These COMAC are calculated by taking the natural-frequency-vector to be an additional mode. Modal energies are calculated by determining the integrals of the real and imaginary components of the frequency response functions over bandwidths of 12% of the natural frequencies. The modal energies and the Coordinate Modal Energy Assurance Criterion (COMEAC) are used to train the two frequency-response-function-neural-networks. The averages of the two sets of trained-networks (COMAC and COMEAC as well as modal properties and modal energies) form two committees of networks. The COMEAC and the COMAC are found to be better identification data than using modal properties and modal energies directly. The committee approach is observed to give lower standard deviations than the individual methods. The main advantage of the Bayesian formulation is that it gives identities of damage and their respective confidence intervals.

Dynamic learning with the EM algorithm for neural networks

In this paper, we derive an EM algorithm for nonlinear state space models. We use it to estimate jointly the neural network weights, the model uncertainty and the noise in the data. In the E-step we apply a forwardbackward Rauch-Tung-Striebel smoother to compute the network weights. For the M-step, we derive expressions to compute the model uncertainty and the measurement noise. We find that the method is intrinsically very powerful, simple and stable.

Introduction to the development of an information management system for soil mix technology using artificial neural networks

This paper introduces current work in collating data from different projects using soil mix technology and establishing trends using artificial neural networks (ANNs). Variation in unconfined compressive strength as a function of selected soil mix variables (e.g., initial soil water content and binder dosage) is observed through the data compiled from completed and on-going soil mixing projects around the world. The potential and feasibility of ANNs in developing predictive models, which take into account a large number of variables, is discussed. The main objective of the work is the management and effective utilization of salient variables and the development of predictive models useful for soil mix technology design. Based on the observed success in the predictions made, this paper suggests that neural network analysis for the prediction of properties of soil mix systems is feasible. © ASCE 2011.

Preliminary model development for predicting strength and stiffness of cement-stabilized soils using artificial neural networks

This paper presents ongoing work on data collection and collation from a large number of laboratory cement-stabilization projects worldwide. The aim is to employ Artificial Neural Networks (ANN) to establish relationships between variables, which define the properties of cement-stabilized soils, and the two parameters determined by the Unconfined Compression Test, the Unconfined Compressive Strength (UCS), and stiffness, using E50 calculated from UCS results. Bayesian predictive neural network models are developed to predict the UCS values of cement-stabilized inorganic clays/silts, as well as sands as a function of selected soil mix variables, such as grain size distribution, water content, cement content and curing time. A model which can predict the stiffness values of cement-stabilized clays/silts is also developed and compared to the UCS model. The UCS model results emulate known trends better and provide more accurate estimates than the results from the E50 stiffness model. © 2013 American Society of Civil Engineers.

Investigation of multilingual deep neural networks for spoken term detection

The development of high-performance speech processing systems for low-resource languages is a challenging area. One approach to address the lack of resources is to make use of data from multiple languages. A popular direction in recent years is to use bottleneck features, or hybrid systems, trained on multilingual data for speech-to-text (STT) systems. This paper presents an investigation into the application of these multilingual approaches to spoken term detection. Experiments were run using the IARPA Babel limited language pack corpora (∼10 hours/language) with 4 languages for initial multilingual system development and an additional held-out target language. STT gains achieved through using multilingual bottleneck features in a Tandem configuration are shown to also apply to keyword search (KWS). Further improvements in both STT and KWS were observed by incorporating language questions into the Tandem GMM-HMM decision trees for the training set languages. Adapted hybrid systems performed slightly worse on average than the adapted Tandem systems. A language independent acoustic model test on the target language showed that retraining or adapting of the acoustic models to the target language is currently minimally needed to achieve reasonable performance. © 2013 IEEE.

Prediction and elucidation of the population dynamics of Microcystis spp. in Lake Dianchi (China) by means of artificial neural networks

Lake Dianchi is a shallow and turbid lake, located in Southwest China. Since 1985, Lake Dianchi has experienced severe cyanabacterial blooms (dominated by Microcystis spp.). In extreme cases, the algal cell densities have exceeded three billion cells per liter. To predict and elucidate the population dynamics ofMicrocystis spp. in Lake Dianchi, a neural network based model was developed. The correlation coefficient (R 2) between the predicted algal concentrations by the model and the observed values was 0.911. Sensitivity analysis was performed to clarify the algal dynamics to the changes of environmental factors. The results of a sensitivity analysis of the neural network model suggested that small increases in pH could cause significantly reduced algal abundance. Further investigations on raw data showed that the response of Microcystis spp. concentration to pH increase was dependent on algal biomass and pH level. When Microcystis spp. population and pH were moderate or low, the response of Microcystis spp. population would be more likely to be positive in Lake Dianchi; contrarily, Microcystis spp. population in Lake Dianchi would be more likely to show negative response to pH increase when Microcystis spp. population and pH were high. The paper concluded that the extremely high concentration of algal population and high pH could explain the distinctive response of Microcystis spp. population to +1 SD (standard deviation) pH increase in Lake Dianchi. And the paper also elucidated the algal dynamics to changes of other environmental factors. One SD increase of water temperature (WT) had strongest positive relationship with Microcystis spp. biomass. Chemical oxygen demand (COD) and total phosphorus (TP) had strong positive effect on Microcystis spp. abundance while total nitrogen (TN), biological oxygen demand in five days (BOD5), and dissolved oxygen had only weak relationship with Microcystis spp. concentration. And transparency (Tr) had moderate positive relationship with Microcystis spp. concentration.

Modelling algal blooms in Lake Dianchi, China using neural networks

Lake Dianchi is one of the most extensively impacted freshwater lakes by algal blooms. To investigate the response of dominant algal genera, neural networks were applied to model the relationship between water quality parameters and the biomass of four dominant genera (Microcystic spp., Anabaena sp., Quadricauda (Turp.) Breb, Pediastrum Mey) in Dianchi. Results showed that the timing and magnitude of algal blooms of Microcystic spp., nabaena sp., Quadricauda (Turp.) Breb, and Pediastrum Mey in Dianchi could be successfully predicted. The evaluation of environmental factors showed that pH had more significant impact on concentrations of all the four dominant algal genera than the nutrient factors, such as total phosphorus and total nitrogen.

Single-electron tunneling depressing synapse for cellular neural networks

In this paper, a cellular neural network with depressing synapses for contrast-invariant pattern classification and synchrony detection is presented, starting from the impulse model of the single-electron tunneling junction. The results of the impulse model and the network are simulated using simulation program with integrated circuit emphasis (SPICE). It is demonstrated that depressing synapses should be an important candidate of robust systems since they exhibit a rapid depression of excitatory postsynaptic potentials for successive presynaptic spikes.

The application of DBF neural networks for object recognition

On the basis of DBF nets proposed by Wang Shoujue, the model and properties of DBF neural network were discussed in this paper. When applied in pattern recognition, the algorithm and implement on hardware were presented respectively. We did experiments on recognition of omnidirectionally oriented rigid objects on the same level, using direction basis function neural networks, which acts by the method of covering the high dimensional geometrical distribution of the sample set in the feature space. Many animal and vehicle models (even with rather similar shapes) were recognized omnidirectionally thousands of times. For total 8800 tests, the correct recognition rate is 98.75%, the error rate and the rejection rate are 0.5% and 1.25% respectively. (C) 2003 Elsevier Inc. All rights reserved.