Compression by replication

Abstract

A recently introduced inference method based on system replication and an online message passing algorithm is employed to complete a previously suggested compression scheme based on a nonlinear perceptron. The algorithm is shown to approach the information theoretical bounds for compression as the number of replicated systems increases, offering superior performance compared to basic message passing algorithms. In addition, the suggested method does not require fine-tuning of parameters or other complementing heuristic techniques, such as the introduction of inertia terms, to improve convergence rates to nontrivial results.

Publication DOI: https://doi.org/10.1103/PhysRevE.89.033301
Divisions: Engineering & Applied Sciences > Mathematics
Engineering & Applied Sciences > Systems analytics research institute (SARI)
Engineering & Applied Sciences
Uncontrolled Keywords: Condensed Matter Physics,Statistical and Nonlinear Physics,Statistics and Probability
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://journals ... sRevE.89.033301 (Publisher URL)
PURE Output Type: Article
Published Date: 2014-03-04
Authors: Alamino, Roberto C. ( 0000-0001-8224-2801)
Neirotti, Juan P. ( 0000-0002-2409-8917)
Saad, David ( 0000-0001-9821-2623)

Download

[img]

Version: Accepted Version


Export / Share Citation


Statistics

Additional statistics for this record