Capacity of the upstart algorithm


Autoria(s): West, Ansgar H L; Saad, David
Contribuinte(s)

Ellacott, Stephen W.

Mason, John C.

Anderson, Iain J.

Data(s)

1997

Resumo

The storage capacity of multilayer networks with overlapping receptive fields is investigated for a constructive algorithm within a one-step replica symmetry breaking (RSB) treatment. We find that the storage capacity increases logarithmically with the number of hidden units <span class='mathrm'>K</span> without saturating the Mitchison-Durbin bound. The slope of the logarithmic increase decays exponentionally with the stability with which the patterns have been stored.

Formato

application/pdf

Identificador

http://eprints.aston.ac.uk/661/1/NCRG_96_017.pdf

West, Ansgar H L and Saad, David (1997). Capacity of the upstart algorithm. IN: Mathematics of Neural Networks: Models, Algorithms and Applications. Ellacott, Stephen W.; Mason, John C. and Anderson, Iain J. (eds) Oxford: Kluwer.

Publicador

Kluwer

Relação

http://eprints.aston.ac.uk/661/

Tipo

Book Section

NonPeerReviewed