Abstract

To improve the network scalability, a large elastic optical network is typically segmented into multiple autonomous domains, where each domain possesses high autonomy and privacy. This architecture is referred to as the multi-domain elastic optical network (MDEON). In the MDEON, the routing, modulation, and spectrum allocation (RMSA) for the inter-domain service requests are challenging. As a result, deep reinforcement learning (DRL) has been introduced recently where the RMSA policies are learned during the interaction of the DRL agents with the MDEON environment. Due to the autonomy of each domain in the MDEON, joint RMSA is essential to improve the overall performance. To realize the joint RMSA, we propose a hierarchical reinforcement learning (HRL) framework which consists of a high-level DRL module and multiple low-level DRL modules (one for each domain), with the collaboration of DRL modules. More specifically, for the inter-domain service requests, the high-level module obtains some abstracted information from the low-level DRL modules and generates the inter-domain RMSA decision for the low-level modules. Then the low-level DRL module gives the intra-domain RMSA decision and feeds back to the high-level module. The proposed HRL framework preserves the autonomy of each single domain while delivering effective overall network performance through the cooperation of the high-level and low-level DRL modules. Simulation results demonstrate that our proposed method outperforms previous approaches.

Leveraging double-agent-based deep reinforcement learning to global optimization of elastic optical networks with enhanced survivability

Xiao Luo, Chen Shi, Liqian Wang, Xue Chen, Yang Li, and Tao Yang
Opt. Express 27(6) 7896-7911 (2019)

Reinforcement-learning-based path planning in multilayer elastic optical networks [Invited]

Takafumi Tanaka
J. Opt. Commun. Netw. 16(1) A68-A77 (2024)

Deep reinforcement learning for proactive spectrum defragmentation in elastic optical networks

Ehsan Etezadi, Carlos Natalino, Renzo Diaz, Anders Lindgren, Stefan Melin, Lena Wosinska, Paolo Monti, and Marija Furdek
J. Opt. Commun. Netw. 15(10) E86-E96 (2023)

Routing in optical transport networks with deep reinforcement learning

José Suárez-Varela, Albert Mestres, Junlin Yu, Li Kuang, Haoyu Feng, Albert Cabellos-Aparicio, and Pere Barlet-Ros
J. Opt. Commun. Netw. 11(11) 547-558 (2019)

Experimental evaluation of a latency-aware routing and spectrum assignment mechanism based on deep reinforcement learning

C. Hernández-Chulde, R. Casellas, R. Martínez, R. Vilalta, and R. Muñoz
J. Opt. Commun. Netw. 15(11) 925-937 (2023)