Globally optimal learning rates in multilayer neural networks

A method for calculating the globally optimal learning rate in on-line gradient-descent training of multilayer neural networks is presented. The method is based on a variational approach which maximizes the decrease in generalization error over a given time frame. We demonstrate the method by computing optimal learning rates in typical learning scenarios. The method can also be employed when different learning rates are allowed for different parameter vectors as well as to determine the relevance of related training algorithms based on modifications to the basic gradient descent rule.

Efficient Bayesian inference for learning in the Ising linear perceptron and signal detection in CDMA

Efficient new Bayesian inference technique is employed for studying critical properties of the Ising linear perceptron and for signal detection in code division multiple access (CDMA). The approach is based on a recently introduced message passing technique for densely connected systems. Here we study both critical and non-critical regimes. Results obtained in the non-critical regime give rise to a highly efficient signal detection algorithm in the context of CDMA; while in the critical regime one observes a first-order transition line that ends in a continuous phase transition point. Finite size effects are also studied. © 2006 Elsevier B.V. All rights reserved.

Enterprise networking:multilayer switching and applications

Primarily targeted toward the network or MIS manager who wants to stay abreast of the latest networking technology, Enterprise Networking: Multilayer Switching and Applications offers up to date information relevant for the design of modern corporate networks and for the evaluation of new networking equipment. The book describes the architectures and standards of switching across the various protocol layers and will also address issues such as multicast quality of service, high-availability and network policies that are requirements of modern switched networks.

Exploitation of multilayer coatings for infrared surface plasmon resonance fiber sensors

We demonstrate surface plasmon resonance (SPR) fiber devices based upon ultraviolet inscription of a grating-type structure into both single-layered and multilayered thin films deposited on the flat side of a lapped D-shaped fiber. The single-layered devices were fabricated from germanium, while the multilayered ones comprised layers of germanium, silica, and silver. Some of the devices operated in air with high coupling efficiency in excess of 40 dB and an estimated index sensitivity of Delta lambda/Delta n = 90 mn from 1 to 1.15 index range, while others provided an index sensitivity of Delta lambda/Delta n = 6790 mn for refractive indices from 1.33 to 1.37. (C) 2009 Optical Society of America

Computational capabilities of multilayer committee machines

We obtained an analytical expression for the computational complexity of many layered committee machines with a finite number of hidden layers (L < 8) using the generalization complexity measure introduced by Franco et al (2006) IEEE Trans. Neural Netw. 17 578. Although our result is valid in the large-size limit and for an overlap synaptic matrix that is ultrametric, it provides a useful tool for inferring the appropriate architecture a network must have to reproduce an arbitrary realizable Boolean function.

Large extraordinary Hall effect in [Pt/Co]5/Ru/[Co/Pt]5 multilayer

This Brief Report presents giant extraordinary Hall effect (EHE) in the Ru-mediated antiferromagnetically coupled [Pt/Co]5/Ru/[Co/Pt]5 multilayers (MLs) compared with those MLs without the Ru spacer. The enhancement of the EHE is attributed to the strong Ru/Co interface scattering. Through the variation in the Pt layer thickness and the temperature, we determine the relation between the Hall voltage and the longitudinal resistivity. It is found that the conventional scaling analysis has difficulties in consistently interpreting our data.

Numerical modelling of multilayer semiconductor devices

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT

Performance of the Bayesian online algorithm for the perceptron

In this letter, we derive continuum equations for the generalization error of the Bayesian online algorithm (BOnA) for the one-layer perceptron with a spherical covariance matrix using the Rosenblatt potential and show, by numerical calculations, that the asymptotic performance of the algorithm is the same as the one for the optimal algorithm found by means of variational methods with the added advantage that the BOnA does not use any inaccessible information during learning. © 2007 IEEE.