Dynamic learning with the EM algorithm for neural networks

In this paper, we derive an EM algorithm for nonlinear state space models. We use it to estimate jointly the neural network weights, the model uncertainty and the noise in the data. In the E-step we apply a forwardbackward Rauch-Tung-Striebel smoother to compute the network weights. For the M-step, we derive expressions to compute the model uncertainty and the measurement noise. We find that the method is intrinsically very powerful, simple and stable.

Forecasting Daily Chlorophyll a Concentration during the Spring Phytoplankton Bloom Period in Xiangxi Bay of the Three-Gorges Reservoir by Means of a Recurrent Artificial Neural Network

A recurrent artificial neural network was used for 0-and 7-days-ahead forecasting of daily spring phytoplankton bloom dynamics in Xiangxi Bay of Three-Gorges Reservoir with meteorological, hydrological, and limnological parameters as input variables. Daily data from the depth of 0.5 m was used to train the model, and data from the depth of 2.0 m was used to validate the calibrated model. The trained model achieved reasonable accuracy in predicting the daily dynamics of chlorophyll a both in 0-and 7-days-ahead forecasting. In 0-day-ahead forecasting, the R-2 values of observed and predicted data were 0.85 for training and 0.89 for validating. In 7-days-ahead forecasting, the R-2 values of training and validating were 0.68 and 0.66, respectively. Sensitivity analysis indicated that most ecological relationships between chlorophyll a and input environmental variables in 0-and 7-days-ahead models were reasonable. In the 0-day model, Secchi depth, water temperature, and dissolved silicate were the most important factors influencing the daily dynamics of chlorophyll a. And in 7-days-ahead predicting model, chlorophyll a was sensitive to most environmental variables except water level, DO, and NH3N.

Investigation of multilingual deep neural networks for spoken term detection

The development of high-performance speech processing systems for low-resource languages is a challenging area. One approach to address the lack of resources is to make use of data from multiple languages. A popular direction in recent years is to use bottleneck features, or hybrid systems, trained on multilingual data for speech-to-text (STT) systems. This paper presents an investigation into the application of these multilingual approaches to spoken term detection. Experiments were run using the IARPA Babel limited language pack corpora (∼10 hours/language) with 4 languages for initial multilingual system development and an additional held-out target language. STT gains achieved through using multilingual bottleneck features in a Tandem configuration are shown to also apply to keyword search (KWS). Further improvements in both STT and KWS were observed by incorporating language questions into the Tandem GMM-HMM decision trees for the training set languages. Adapted hybrid systems performed slightly worse on average than the adapted Tandem systems. A language independent acoustic model test on the target language showed that retraining or adapting of the acoustic models to the target language is currently minimally needed to achieve reasonable performance. © 2013 IEEE.

Modelling algal blooms in Lake Dianchi, China using neural networks

Lake Dianchi is one of the most extensively impacted freshwater lakes by algal blooms. To investigate the response of dominant algal genera, neural networks were applied to model the relationship between water quality parameters and the biomass of four dominant genera (Microcystic spp., Anabaena sp., Quadricauda (Turp.) Breb, Pediastrum Mey) in Dianchi. Results showed that the timing and magnitude of algal blooms of Microcystic spp., nabaena sp., Quadricauda (Turp.) Breb, and Pediastrum Mey in Dianchi could be successfully predicted. The evaluation of environmental factors showed that pH had more significant impact on concentrations of all the four dominant algal genera than the nutrient factors, such as total phosphorus and total nitrogen.

Single-electron tunneling depressing synapse for cellular neural networks

In this paper, a cellular neural network with depressing synapses for contrast-invariant pattern classification and synchrony detection is presented, starting from the impulse model of the single-electron tunneling junction. The results of the impulse model and the network are simulated using simulation program with integrated circuit emphasis (SPICE). It is demonstrated that depressing synapses should be an important candidate of robust systems since they exhibit a rapid depression of excitatory postsynaptic potentials for successive presynaptic spikes.

The application of DBF neural networks for object recognition

On the basis of DBF nets proposed by Wang Shoujue, the model and properties of DBF neural network were discussed in this paper. When applied in pattern recognition, the algorithm and implement on hardware were presented respectively. We did experiments on recognition of omnidirectionally oriented rigid objects on the same level, using direction basis function neural networks, which acts by the method of covering the high dimensional geometrical distribution of the sample set in the feature space. Many animal and vehicle models (even with rather similar shapes) were recognized omnidirectionally thousands of times. For total 8800 tests, the correct recognition rate is 98.75%, the error rate and the rejection rate are 0.5% and 1.25% respectively. (C) 2003 Elsevier Inc. All rights reserved.

A novel face recognition method based on hypersausage neural networks

In this paper, we firstly give the nature of 'hypersausages', study its structure and training of the network, then discuss the nature of it by way of experimenting with ORL face database, and finally, verify its unsurpassable advantages compared with other means.

Modeling and optimization of semiconductor manufacturing process with neural networks

A neural network-based process model is proposed to optimize the semiconductor manufacturing process. Being different from some works in several research groups which developed neural network-based models to predict process quality with a set of process variables of only single manufacturing step, we applied this model to wafer fabrication parameters control and wafer lot yield optimization. The original data are collected from a wafer fabrication line, including technological parameters and wafer test results. The wafer lot yield is taken as the optimization target. Learning from historical technological records and wafer test results, the model can predict the wafer yield. To eliminate the "bad" or noisy samples from the sample set, an experimental method was used to determine the number of hidden units so that both good learning ability and prediction capability can be obtained.

Dynamic power management approaches based on neural network

Dynamic Power Management (DPM) is a technique to reduce power consumption of electronic system. by selectively shutting down idle components. In this article we try to introduce back propagation network and radial basis network into the research of the system-level policies. We proposed two PAY policies-Back propagation Power Management (BPPM) and Radial Basis Function Power management (RBFPM) which are based on Artificial Neural Networks (ANN). Our experiments show that the two power management policies greatly lowered the system-level power consumption and have higher performance than traditional Power Management(PM) techniques-BPPM is 1.09-competitive and RBFPM is 1.08-competitive vs. 1.79,145,1.18-competitive separately for traditional timeout PM, adaptive predictive PM and stochastic PM.

A DSWN-based specific-purpose neural computing system

The Double Synapse Weighted Neuron (DSWN) is a kind of general-purpose neuron model, which with the ability of configuring Hyper-sausage neuron (HSN). After introducing the design method of hardware DSWN synapse, this paper proposed a DSWN-based specific purpose neural computing device-CASSANN-IIspr. As its application, a rigid body recognition system was developed on CASSANN-IIspr, which achieved better performance than RIBF-SVMs system.

Architecture research and hardware implementation on simplified neural computing system for face identification

This paper describes a special-purpose neural computing system for face identification. The system architecture and hardware implementation are introduced in detail. An algorithm based on biomimetic pattern recognition has been embedded. For the total 1200 tests for face identification, the false rejection rate is 3.7% and the false acceptance rate is 0.7%.

Artificial neural network applied to diagnosis of lung cancer

Artificial neural network(ANN) approach was applied to classification of normal persons and lung cancer patients based on the metal content of hair and serum samples obtained by inductively coupled plasma atomic emission spectrometry (ICP-AES) for the two groups. This method was verified with independent prediction samples and can be used as an aiding means of the diagnosis of lung cancer. The case of predictive classification with one element missing in the prediction samples was studied in details, The significance of elements in hair and serum samples for classification prediction was also investigated.