Transients and asymptotics of natural gradient learning


Autoria(s): Rattray, Magnus; Saad, David
Contribuinte(s)

Niklasson, L.

Boden, M.

Ziemke, T.

Data(s)

01/09/1998

Resumo

We analyse natural gradient learning in a two-layer feed-forward neural network using a statistical mechanics framework which is appropriate for large input dimension. We find significant improvement over standard gradient descent in both the transient and asymptotic phases of learning.

Formato

application/pdf

Identificador

http://eprints.aston.ac.uk/1227/1/NCRG_98_008.pdf

Rattray, Magnus and Saad, David (1998). Transients and asymptotics of natural gradient learning. IN: Proceedings of the 8th International Conference on Artificial Neural Networks. Niklasson, L.; Boden, M. and Ziemke, T. (eds) Springer.

Publicador

Springer

Relação

http://eprints.aston.ac.uk/1227/

Tipo

Book Section

NonPeerReviewed