Rattray, Magnus and Saad, David (1998). Transients and asymptotics of natural gradient learning. IN: Proceedings of the 8th International Conference on Artificial Neural Networks. Niklasson, L.; Boden, M. and Ziemke, T. (eds) Springer.
Abstract
We analyse natural gradient learning in a two-layer feed-forward neural network using a statistical mechanics framework which is appropriate for large input dimension. We find significant improvement over standard gradient descent in both the transient and asymptotic phases of learning.
| Divisions: | College of Engineering & Physical Sciences > Systems analytics research institute (SARI) |
|---|---|
| Additional Information: | The original publication is available at www.springerlink.com |
| ISBN: | 3540762639 |
| Last Modified: | 29 Nov 2023 13:43 |
| Date Deposited: | 22 Sep 2009 13:30 |
| Full Text Link: |
10.1007/978-1-4471-1599-1_21 |
| Related URLs: |
https://link.sp ... -4471-1599-1_21
(Publisher URL) |
PURE Output Type: | Chapter |
| Published Date: | 1998-09-01 |
| Authors: |
Rattray, Magnus
Saad, David |
![[img]](https://publications.aston.ac.uk/style/images/fileicons/application_pdf.png)
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)