The learning dynamics of a universal approximator

Abstract

The learning properties of a universal approximator, a normalized committee machine with adjustable biases, are studied for on-line back-propagation learning. Within a statistical mechanics framework, numerical studies show that this model has features which do not exist in previously studied two-layer network models without adjustable biases, e.g., attractive suboptimal symmetric phases even for realizable cases and noiseless data.

Divisions: College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
?? 50811700Jl ??
Additional Information: Copyright of the Massachusetts Institute of Technology Press (MIT Press)
Uncontrolled Keywords: approximator,back-propagation,symmetric phases,realizable cases,noiseless data
Publication ISSN: 1049-5258
Last Modified: 06 Feb 2024 08:02
Date Deposited: 11 Mar 2019 17:28
Full Text Link:
Related URLs: http://mitpress ... type=2&tid=3990 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 1997-05
Authors: West, Ansgar H. L.
Saad, David (ORCID Profile 0000-0001-9821-2623)
Nabney, Ian T. (ORCID Profile 0000-0003-1513-993X)

Download

[img]

Version: Published Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record