Abstract

This paper proposes a machine-learning (ML)-aided cognitive approach for effective bandwidth reconfiguration in optically interconnected datacenter/high-performance computing (HPC) systems. The proposed approach relies on a Hyper-X-like architecture augmented with flexible-bandwidth photonic interconnections at large scales using a hierarchical intra/inter-POD photonic switching layout. We first formulate the problem of the connectivity graph and routing scheme optimization as a mixed-integer linear programming model. A two-phase heuristic algorithm and a joint optimization approach are devised to solve the problem with low time complexity. Then, we propose an ML-based end-to-end performance estimator design to assist the network control plane with intelligent decision making for bandwidth reconfiguration. Numerical simulations using traffic distribution profiles extracted from HPC applications traces as well as random traffic matrices verify the accuracy performance of the ML design estimator (${\lt}9\%$ error) and demonstrate up to $5 \times$ throughput gain from the proposed approach compared with the baseline Hyper-X network using fixed all-to-all intra/inter-portable data center interconnects.

© 2021 Optical Society of America

SL-Hyper-FleX: a cognitive and flexible-bandwidth optical datacom network by self-supervised learning [Invited]

Che-Yu Liu, Xiaoliang Chen, Zhaohui Li, Roberto Proietti, and S. J. Ben Yoo
J. Opt. Commun. Netw. 14(2) A113-A121 (2022)

Performance trade-offs in reconfigurable networks for HPC

Min Yee Teh, Zhenguo Wu, Madeleine Glick, Sebastien Rumley, Manya Ghobadi, and Keren Bergman
J. Opt. Commun. Netw. 14(6) 454-468 (2022)

QoS-aware data center network reconfiguration method based on deep reinforcement learning

Xiaotao Guo, Fulong Yan, Xuwei Xue, Bitao Pan, George Exarchakos, and Nicola Calabretta
J. Opt. Commun. Netw. 13(5) 94-107 (2021)

Scalable and low server-to-server latency data center network architecture based on optical packet inter-rack and intra-rack switching

Georgios Drainakis, Peristera Baziana, and Adonis Bogris
J. Opt. Commun. Netw. 15(11) 804-819 (2023)

ReSAW: a reconfigurable and picosecond-synchronized optical data center network based on an AWGR and the WR protocol

Zuoqing Zhao, Xuwei Xue, Bingli Guo, Yisong Zhao, Xinwei Zhang, Yuanzhi Guo, Wei Ji, Rui Yin, Bin Chen, and Shanguo Huang
J. Opt. Commun. Netw. 14(9) 702-712 (2022)