Compression by replication

Abstract

A recently introduced inference method based on system replication and an online message passing algorithm is employed to complete a previously suggested compression scheme based on a nonlinear perceptron. The algorithm is shown to approach the information theoretical bounds for compression as the number of replicated systems increases, offering superior performance compared to basic message passing algorithms. In addition, the suggested method does not require fine-tuning of parameters or other complementing heuristic techniques, such as the introduction of inertia terms, to improve convergence rates to nontrivial results.

Publication DOI: https://doi.org/10.1103/PhysRevE.89.033301
Divisions: College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
College of Engineering & Physical Sciences
Uncontrolled Keywords: Condensed Matter Physics,Statistical and Nonlinear Physics,Statistics and Probability
Publication ISSN: 1550-2376
Last Modified: 24 Jan 2024 08:05
Date Deposited: 28 Apr 2015 07:26
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://journals ... sRevE.89.033301 (Publisher URL)
PURE Output Type: Article
Published Date: 2014-03-04
Authors: Alamino, Roberto C. (ORCID Profile 0000-0001-8224-2801)
Neirotti, Juan P. (ORCID Profile 0000-0002-2409-8917)
Saad, David (ORCID Profile 0000-0001-9821-2623)

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record