Curvature-driven smoothing: a learning algorithm for feed-forward networks

Abstract

The performance of feed-forward neural networks in real applications can be often be improved significantly if use is made of a-priori information. For interpolation problems this prior knowledge frequently includes smoothness requirements on the network mapping, and can be imposed by the addition to the error function of suitable regularization terms. The new error function, however, now depends on the derivatives of the network mapping, and so the standard back-propagation algorithm cannot be applied. In this paper, we derive a computationally efficient learning algorithm, for a feed-forward network of arbitrary topology, which can be used to minimize the new error function. Networks having a single hidden layer, for which the learning algorithm simplifies, are treated as a special case.

Publication DOI: https://doi.org/10.1109/72.248466
Divisions: Aston University (General)
Additional Information: ©1993 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords: feed-forward neural networks,real applications,a-priori information,interpolation,network mapping,error,back-propagation,algorithm,arbitrary topology
Publication ISSN: 1941-0093
Last Modified: 07 Oct 2024 07:13
Date Deposited: 02 Jul 2009 09:05
Full Text Link:
Related URLs: https://ieeexpl ... document/248466 (Publisher URL)
PURE Output Type: Article
Published Date: 1993-09
Authors: Bishop, Christopher M.

Download

[img]

Version: Published Version


Export / Share Citation


Statistics

Additional statistics for this record