Abstract

This paper presents a cognitive flexible-bandwidth optical interconnect architecture for datacom networks. The proposed architecture leverages silicon photonic reconfigurable all-to-all switch fabrics interconnecting top-of-rack switches arranged in a Hyper-X-like topology with a cognitive control plane for optical reconfiguration by self-supervised learning. The proposed approach makes use of a clustering algorithm to learn the traffic patterns from historical traces. We developed a heuristic algorithm for optimizing the intra-pod connectivity graph for each identified traffic pattern. Further, to mitigate the scalability issue induced by frequent clustering operations, we parameterized the learned traffic patterns by a support vector machine classifier. The classifier is trained offline by self-labeled data to enable the classification of traffic matrices during online operations, thereby facilitating cognitive reconfiguration decision making. The simulation results show that compared with a static all-to-all interconnection, the proposed approach can improve the throughput by up to $1.62 \times$ while reducing the end-to-end packet latency and flow completion time by up to $3.84 \times$ and $20 \times$, respectively.

© 2021 Optical Society of America

Machine-learning-aided cognitive reconfiguration for flexible-bandwidth HPC and data center networks [Invited]

Xiaoliang Chen, Roberto Proietti, Marjan Fariborz, Che-Yu Liu, and S. J. Ben Yoo
J. Opt. Commun. Netw. 13(6) C10-C20 (2021)

QoS-aware data center network reconfiguration method based on deep reinforcement learning

Xiaotao Guo, Fulong Yan, Xuwei Xue, Bitao Pan, George Exarchakos, and Nicola Calabretta
J. Opt. Commun. Netw. 13(5) 94-107 (2021)

Topology configuration scheme for accelerating coflows in a hyper-FleX-LION

Hao Yang and Zuqing Zhu
J. Opt. Commun. Netw. 14(10) 805-814 (2022)

Performance trade-offs in reconfigurable networks for HPC

Min Yee Teh, Zhenguo Wu, Madeleine Glick, Sebastien Rumley, Manya Ghobadi, and Keren Bergman
J. Opt. Commun. Netw. 14(6) 454-468 (2022)

Flexible silicon photonic architecture for accelerating distributed deep learning

Zhenguo Wu, Liang Yuan Dai, Yuyang Wang, Songli Wang, and Keren Bergman
J. Opt. Commun. Netw. 16(2) A157-A168 (2024)