Dynamics of on-line gradient descent learning for multilayer neural networks

Saad, David and Solla, Sara A. (1996). Dynamics of on-line gradient descent learning for multilayer neural networks. Advances in Neural Information Processing Systems, 8 , pp. 302-308.


We consider the problem of on-line gradient descent learning for general two-layer neural networks. An analytic solution is presented and used to investigate the role of the learning rate in controlling the evolution and convergence of the learning process.

Divisions: Engineering & Applied Sciences > Mathematics
Engineering & Applied Sciences > Non-linearity and complexity research group
Additional Information: Copyright of Massachusetts Institute of Technology Press (MIT Press) http://mitpress.mit.edu/mitpress/copyright/default.asp
Uncontrolled Keywords: on-line,gradient descent learning,general two-layer neural networks,learning rate,learning process.
Full Text Link: http://books.google.co.uk/books?id=ZkJrSots_SAC&lpg=PA302&ots=YgKTHRP9QP&dq=%22Dynamics%20of%20on-line%20gradient%20descent%20learning%20for%20multilayer%20neural%20networks%22&lr=&pg=PA303
Related URLs:
Published Date: 1996
Authors: Saad, David ( 0000-0001-9821-2623)
Solla, Sara A.



Export / Share Citation


Additional statistics for this record