Capacity of the upstart algorithm

Abstract

The storage capacity of multilayer networks with overlapping receptive fields is investigated for a constructive algorithm within a one-step replica symmetry breaking (RSB) treatment. We find that the storage capacity increases logarithmically with the number of hidden units <span class='mathrm'>K</span> without saturating the Mitchison-Durbin bound. The slope of the logarithmic increase decays exponentionally with the stability with which the patterns have been stored.

Divisions: College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
Additional Information: The original publication is available at www.springerlink.com
ISBN: 0-7923-9933-1
Last Modified: 29 Nov 2023 13:43
Date Deposited: 08 Jul 2009 10:58
Full Text Link: 10.1007/978-1-4615-6099-9_65
Related URLs: https://link.sp ... -4615-6099-9_65 (Publisher URL)
PURE Output Type: Chapter
Published Date: 1997
Authors: West, Ansgar H L
Saad, David

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record