Abstract

High-speed optical transmission systems suffer from severe inter-symbol interferences (ISIs) and nonlinear distortions due to the limited bandwidth and the nonlinear response of optical and electrical components at the transceivers. Previous work has shown the benefits of applying maximum-likelihood sequence estimation (MLSE) to deal with the ISI and using the neural network-based equalizer (NNE) to mitigate strong nonlinearities. However, most of the NNE has a quasi-hard output as the training and validation loss continue to drop to an over-equalized state in which the quasi-hard output sequence loses the symbol-wise soft information of the signal and fails to obtain the BER performance gain from MLSE. In this work, we investigate the cascaded NNE and MLSE equalization scheme to deal with linear and nonlinear impairments. To solve the over-equalized problem, we propose a modified loss function (MLF) assisting NNE to achieve soft-out without entering into the over-equalized state. With the soft output after NNE, joint linear and nonlinear equalization can be realized by cascading the NNE with MLSE. Both numerical simulations and experimental demonstrations confirm the improved performance of our proposed method. With joint linear and nonlinear equalization, improved back-to-back (BtB) and fiber transmission performances of the 220-Gbps PAM-4 signal are demonstrated.

Advanced nonlinearity equalizer with TC-NL-MLSE for transmitting beyond 200-Gb/s PAM-8 in IM/DD systems

Jiahao Zhou, Jing Zhang, Xue Zhao, Taowei Jin, Shaohua Hu, Hong Lin, Yu Zhenming, Qianwu Zhang, Bo Xu, and Kun Qiu
Opt. Express 30(21) 37416-37425 (2022)

Joint clock recovery and feed-forward equalization for PAM4 transmission

Honghang Zhou, Yan Li, Dan Lu, Lei Yue, Chao Gao, Yuyang Liu, Ruibin Hao, Zhixi Zhao, Wei Li, Jifang Qiu, Xiaobin Hong, Hongxiang Guo, Yong Zuo, and Jian Wu
Opt. Express 27(8) 11385-11395 (2019)

Decision region partition aided MLSE for O-band 65-Gbaud PAM-4 system over 40-km transmission with a severe bandwidth constraint

Weihao Ni, Fan Li, Mingzhu Yin, Zhiwei Chen, Wei Wang, Dongdong Zou, Yi Cai, Qi Sui, and Zhaohui Li
Opt. Lett. 47(17) 4387-4390 (2022)

Burst errors suppression for MLSE in high-speed IM/DD transmission systems using PAM

Jiahao Zhou, Jing Zhang, Xue Zhao, Chenye Wang, Taowei Jin, Shaohua Hu, Qi Yang, Xiaoxiao Dai, Bo Xu, and Kun Qiu
Opt. Express 31(12) 19116-19125 (2023)

Recurrent neural networks achieving MLSE performance for optical channel equalization

Sai-Chandra-Kumari Kalla, Christian Gagné, Ming Zeng, and Leslie A. Rusch
Opt. Express 29(9) 13033-13047 (2021)