Capacity of the upstart algorithm
Contribuinte(s) |
Ellacott, Stephen W. Mason, John C. Anderson, Iain J. |
---|---|
Data(s) |
1997
|
Resumo |
The storage capacity of multilayer networks with overlapping receptive fields is investigated for a constructive algorithm within a one-step replica symmetry breaking (RSB) treatment. We find that the storage capacity increases logarithmically with the number of hidden units <span class='mathrm'>K</span> without saturating the Mitchison-Durbin bound. The slope of the logarithmic increase decays exponentionally with the stability with which the patterns have been stored. |
Formato |
application/pdf |
Identificador |
http://eprints.aston.ac.uk/661/1/NCRG_96_017.pdf West, Ansgar H L and Saad, David (1997). Capacity of the upstart algorithm. IN: Mathematics of Neural Networks: Models, Algorithms and Applications. Ellacott, Stephen W.; Mason, John C. and Anderson, Iain J. (eds) Oxford: Kluwer. |
Publicador |
Kluwer |
Relação |
http://eprints.aston.ac.uk/661/ |
Tipo |
Book Section NonPeerReviewed |