1 resultado para Demmon, Isaac Newton, 1842-1920.
em Aston University Research Archive
Filtro por publicador
- Aberystwyth University Repository - Reino Unido (2)
- Acceda, el repositorio institucional de la Universidad de Las Palmas de Gran Canaria. España (6)
- AMS Tesi di Dottorato - Alm@DL - Università di Bologna (1)
- AMS Tesi di Laurea - Alm@DL - Università di Bologna (4)
- Andina Digital - Repositorio UASB-Digital - Universidade Andina Simón Bolívar (6)
- Aquatic Commons (1)
- Archivo Digital para la Docencia y la Investigación - Repositorio Institucional de la Universidad del País Vasco (2)
- Argos - Repositorio Institucional de la Secretaría de Investigación y Postgrado de la Facultad de Humanidades y Ciencias Sociales de la Universidad Nacional de Misiones (2)
- Aston University Research Archive (1)
- Biblioteca de Teses e Dissertações da USP (1)
- Biblioteca Digital | Sistema Integrado de Documentación | UNCuyo - UNCUYO. UNIVERSIDAD NACIONAL DE CUYO. (7)
- Biblioteca Digital da Câmara dos Deputados (4)
- Biblioteca Digital da Produção Intelectual da Universidade de São Paulo (16)
- Biblioteca Digital da Produção Intelectual da Universidade de São Paulo (BDPI/USP) (7)
- Biblioteca Digital de la Universidad Católica Argentina (3)
- Biblioteca Digital de Teses e Dissertações Eletrônicas da UERJ (7)
- BORIS: Bern Open Repository and Information System - Berna - Suiça (38)
- Boston University Digital Common (6)
- Brock University, Canada (49)
- Bucknell University Digital Commons - Pensilvania - USA (1)
- Cambridge University Engineering Department Publications Database (5)
- CentAUR: Central Archive University of Reading - UK (17)
- Center for Jewish History Digital Collections (39)
- Chinese Academy of Sciences Institutional Repositories Grid Portal (2)
- Comissão Econômica para a América Latina e o Caribe (CEPAL) (9)
- CORA - Cork Open Research Archive - University College Cork - Ireland (2)
- CUNY Academic Works (5)
- Dalarna University College Electronic Archive (4)
- Deakin Research Online - Australia (23)
- Digital Archives@Colby (4)
- Digital Peer Publishing (1)
- DigitalCommons@University of Nebraska - Lincoln (1)
- Digitale Sammlungen - Goethe-Universität Frankfurt am Main (83)
- Doria (National Library of Finland DSpace Services) - National Library of Finland, Finland (3)
- DRUM (Digital Repository at the University of Maryland) (1)
- Duke University (1)
- Funes: Repositorio digital de documentos en Educación Matemática - Colombia (1)
- Gallica, Bibliotheque Numerique - Bibliothèque nationale de France (French National Library) (BnF), France (196)
- Greenwich Academic Literature Archive - UK (2)
- Harvard University (2)
- Helda - Digital Repository of University of Helsinki (14)
- Indian Institute of Science - Bangalore - Índia (13)
- Livre Saber - Repositório Digital de Materiais Didáticos - SEaD-UFSCar (1)
- Lume - Repositório Digital da Universidade Federal do Rio Grande do Sul (4)
- Memoria Académica - FaHCE, UNLP - Argentina (87)
- Ministerio de Cultura, Spain (40)
- Plymouth Marine Science Electronic Archive (PlyMSEA) (1)
- Publishing Network for Geoscientific & Environmental Data (21)
- QSpace: Queen's University - Canada (1)
- QUB Research Portal - Research Directory and Institutional Repository for Queen's University Belfast (23)
- Queensland University of Technology - ePrints Archive (9)
- RDBU - Repositório Digital da Biblioteca da Unisinos (4)
- Repositorio Academico Digital UANL (1)
- Repositório digital da Fundação Getúlio Vargas - FGV (7)
- Repositório Digital da Universidade Municipal de São Caetano do Sul - USCS (1)
- REPOSITORIO DIGITAL IMARPE - INSTITUTO DEL MAR DEL PERÚ, Peru (3)
- Repositório Institucional UNESP - Universidade Estadual Paulista "Julio de Mesquita Filho" (62)
- School of Medicine, Washington University, United States (12)
- Scielo Uruguai (1)
- South Carolina State Documents Depository (6)
- Universidad Autónoma de Nuevo León, Mexico (10)
- Universidad de Alicante (3)
- Universidad del Rosario, Colombia (6)
- Universidad Politécnica de Madrid (1)
- Universidade de Lisboa - Repositório Aberto (1)
- Universidade Federal do Pará (5)
- Universidade Federal do Rio Grande do Norte (UFRN) (13)
- Universitat de Girona, Spain (2)
- Universitätsbibliothek Kassel, Universität Kassel, Germany (1)
- Université de Montréal, Canada (10)
- University of Connecticut - USA (11)
- University of Michigan (53)
- WestminsterResearch - UK (2)
- Worcester Research and Publications - Worcester Research and Publications - UK (1)
Resumo:
We analyse the dynamics of a number of second order on-line learning algorithms training multi-layer neural networks, using the methods of statistical mechanics. We first consider on-line Newton's method, which is known to provide optimal asymptotic performance. We determine the asymptotic generalization error decay for a soft committee machine, which is shown to compare favourably with the result for standard gradient descent. Matrix momentum provides a practical approximation to this method by allowing an efficient inversion of the Hessian. We consider an idealized matrix momentum algorithm which requires access to the Hessian and find close correspondence with the dynamics of on-line Newton's method. In practice, the Hessian will not be known on-line and we therefore consider matrix momentum using a single example approximation to the Hessian. In this case good asymptotic performance may still be achieved, but the algorithm is now sensitive to parameter choice because of noise in the Hessian estimate. On-line Newton's method is not appropriate during the transient learning phase, since a suboptimal unstable fixed point of the gradient descent dynamics becomes stable for this algorithm. A principled alternative is to use Amari's natural gradient learning algorithm and we show how this method provides a significant reduction in learning time when compared to gradient descent, while retaining the asymptotic performance of on-line Newton's method.