Compression by replication


A recently introduced inference method based on system replication and an online message passing algorithm is employed to complete a previously suggested compression scheme based on a nonlinear perceptron. The algorithm is shown to approach the information theoretical bounds for compression as the number of replicated systems increases, offering superior performance compared to basic message passing algorithms. In addition, the suggested method does not require fine-tuning of parameters or other complementing heuristic techniques, such as the introduction of inertia terms, to improve convergence rates to nontrivial results.

Publication DOI:
Divisions: Engineering & Applied Sciences > Mathematics
Engineering & Applied Sciences > Systems analytics research institute (SARI)
Engineering & Applied Sciences
Uncontrolled Keywords: Condensed Matter Physics,Statistical and Nonlinear Physics,Statistics and Probability
Full Text Link: http://journals ... sRevE.89.033301
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2014-03-04
Authors: Alamino, Roberto C. ( 0000-0001-8224-2801)
Neirotti, Juan P. ( 0000-0002-2409-8917)
Saad, David ( 0000-0001-9821-2623)



Version: Draft Version

Export / Share Citation


Additional statistics for this record