Convolutional long short-term memory neural network equalizer for nonlinear Fourier transform-based optical transmission systems


We evaluate improvement in the performance of the optical transmission systems operating with the continuous nonlinear Fourier spectrum by the artificial neural network equalisers installed at the receiver end. We propose here a novel equaliser designs based on bidirectional long short-term memory (BLSTM) gated recurrent neural network and compare their performance with the equaliser based on several fully connected layers. The proposed approach accounts for the correlations between different nonlinear spectral components. The application of BLSTM equaliser leads to a 16x improvement in terms of bit-error rate (BER) compared to the non-equalised case. The proposed equaliser makes it possible to reach the data rate of 170 Gbit/s for one polarisation conventional nonlinear Fourier transform (NFT) based system at 1000 km distance. We show that our new BLSTM equalisers significantly outperform the previously proposed scheme based on a feed-forward fully connected neural network. Moreover, we demonstrate that by adding a 1D convolutional layer for the data pre-processing before BLSTM recurrent layers, we can further enhance the performance of the BLSTM equaliser, reaching 23x BER improvement for the 170 Gbit/s system over 1000 km, staying below the 7% forward error correction hard decision threshold (HD-FEC).

Publication DOI:
Divisions: College of Engineering & Physical Sciences > Aston Institute of Photonics Technology (AIPT)
College of Engineering & Physical Sciences
Additional Information: Published by The Optical Society under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI. Funding: Leverhulme Trust (ECF-2020-150, RP-2018-063); Engineering and Physical Sciences Research Council (EP/R035342/1); H2020 Marie Skłodowska-Curie Actions (713694
Uncontrolled Keywords: Atomic and Molecular Physics, and Optics
Publication ISSN: 1094-4087
Last Modified: 28 May 2024 07:25
Date Deposited: 28 Jun 2021 12:19
Full Text Link:
Related URLs: https://www.osa ... I=oe-29-7-11254 (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2021-03-26
Accepted Date: 2021-03-13
Authors: Kotlyar, Oleksandr
Kamalian-kopae, Morteza (ORCID Profile 0000-0002-6278-976X)
Pankratova, Maryna
Vasylchenkova, Anastasiia (ORCID Profile 0000-0002-6997-9427)
Prilepsky, Jaroslaw E. (ORCID Profile 0000-0002-3035-4112)
Turitsyn, Sergei K. (ORCID Profile 0000-0003-0101-3834)



Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Additional statistics for this record