Globally optimal parameters for on-line learning in multilayer neural networks

Saad, David and Rattray, Magnus (1997). Globally optimal parameters for on-line learning in multilayer neural networks. Physical Review Letters, 79 (13), pp. 2578-2581.

Abstract

We present a framework for calculating globally optimal parameters, within a given time frame, for on-line learning in multilayer neural networks. We demonstrate the capability of this method by computing optimal learning rates in typical learning scenarios. A similar treatment allows one to determine the relevance of related training algorithms based on modifications to the basic gradient descent rule as well as to compare different training methods.

Publication DOI: https://doi.org/10.1103/PhysRevLett.79.2578
Divisions: Engineering & Applied Sciences > Mathematics
Engineering & Applied Sciences > Systems analytics research institute (SARI)
Additional Information: Copyright of the American Physical Society
Uncontrolled Keywords: on-line learning,multilayer neural networks,learning rates,training algorithms
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://prola.ap ... v79/i13/p2578_1 (Publisher URL)
Published Date: 1997-09-29
Authors: Saad, David ( 0000-0001-9821-2623)
Rattray, Magnus

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record