Freire, Pedro J., Napoli, Antonio, Ron, Diego Arguello, Spinnler, Bernhard, Anderson, Michael, Schairer, Wolfgang, Bex, Thomas, Costa, Nelson, Turitsyn, Sergei K. and Prilepsky, Jaroslaw E. (2023). Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation. Journal of Lightwave Technology, 41 (14), pp. 4557-4581.
Abstract
This paper introduces a novel methodology for developing low-complexity neural network (NN) based equalizers to address impairments in high-speed coherent optical transmission systems. We present a comprehensive exploration and comparison of deep model compression techniques applied to feed-forward and recurrent NN designs, assessing their impact on equalizer performance. Our investigation encompasses quantization, weight clustering, pruning, and other cutting-edge compression strategies. We propose and evaluate a Bayesian optimization-assisted compression approach that optimizes hyperparameters to simultaneously enhance performance and reduce complexity. Additionally, we introduce four distinct metrics (RMpS, BoP, NABS, and NLGs) to quantify computing complexity in various compression algorithms. These metrics serve as benchmarks for evaluating the relative effectiveness of NN equalizers when compression approaches are employed. The analysis is completed by evaluating the trade-off between compression complexity and performance using simulated and experimental data. By employing optimal compression techniques, we demonstrate the feasibility of designing a simplified NN-based equalizer surpassing the performance of conventional digital back-propagation (DBP) equalizers with only one step per span. This is achieved by reducing the number of multipliers through weighted clustering and pruning algorithms. Furthermore, we highlight that an NN-based equalizer can achieve better performance than the full electronic chromatic dispersion compensation block while maintaining a similar level of complexity. In conclusion, we outline remaining challenges, unanswered questions, and potential avenues for future research in this field.
Publication DOI: | https://doi.org/10.1109/jlt.2023.3234327 |
---|---|
Divisions: | College of Engineering & Physical Sciences > Aston Institute of Photonics Technology (AIPT) College of Engineering & Physical Sciences Aston University (General) |
Additional Information: | This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/. Funding: This paper was supported by the EU Horizon 2020 program under the Marie Sklodowska-Curie grant agreements 813144 (REAL-NET) and 860360 (POST-DIGITAL). JEP is supported by Leverhulme Trust, Grant No. RP- 2018-063. SKT acknowledges support of the EPSRC project TRANSNET. |
Uncontrolled Keywords: | Artificial neural networks,Bayesian Optimizer,Coherent Detection,Computational Complexity,Computational modeling,Equalizers,Fiber nonlinear optics,Neural Network,Nonlinear Equalizer,Nonlinear optics,Optical fibers,Pruning,Quantization,Symbols,Atomic and Molecular Physics, and Optics |
Publication ISSN: | 0733-8724 |
Last Modified: | 09 Dec 2024 08:54 |
Date Deposited: | 16 Jan 2023 10:07 |
Full Text Link: | |
Related URLs: |
https://ieeexpl ... cument/10006884
(Publisher URL) http://www.scop ... tnerID=8YFLogxK (Scopus URL) |
PURE Output Type: | Article |
Published Date: | 2023-07-15 |
Published Online Date: | 2023-01-05 |
Accepted Date: | 2022-12-20 |
Authors: |
Freire, Pedro J.
Napoli, Antonio Ron, Diego Arguello ( 0000-0002-6004-385X) Spinnler, Bernhard Anderson, Michael Schairer, Wolfgang Bex, Thomas Costa, Nelson Turitsyn, Sergei K. ( 0000-0003-0101-3834) Prilepsky, Jaroslaw E. ( 0000-0002-3035-4112) |