Abstract

With the explosion of geo-distributed data, the huge treasures hidden in them are waiting to be explored to obtain valuable insights. This results in the need for an effective geo- distributed data analysis method. The traditional approach to geo-distributed data analytics is to gather all the required data into a single edge datacenter (edge DC) through one transmission and aggregation (centralized data aggregation). However, as the volume of data grows exponentially, the centralized data aggregation scheme becomes inefficient or infeasible due to the limitations of the computing and network resources. In this paper, we propose the geo-distributed data aggregation scheme in edge compute first networking (CFN) with joint consideration of computation and communication resources. The proposed scheme optimizes two objectives: the first is to minimize the job completion time (JCT) by selecting cluster centers, dividing clusters and provisioning lightpaths; the second objective is to reduce bandwidth consumption by reallocating routing and frequency slots based on JCT. To achieve the two objectives, we first formulate the optimization problem of multi-stage geo- distributed data aggregation as a linear programming (LP) model. To tackle the computational complexity issue of the LP model, a multi-stage geo-distributed data aggregation algorithm jointly with computation and communication resources (MGDD-CC) is proposed. Simulation results show that the proposed scheme can reduce JCT, alleviate the competition for bandwidth resources and is more suitable for scenarios with better data aggregation effects and larger quantities of geo-distributed data.

Joint Jobs Scheduling and Lightpath Provisioning in Fog Computing Micro Datacenter Networks

Zhen Liu, Jiawei Zhang, Yanan Li, Lin Bai, and Yuefeng Ji
J. Opt. Commun. Netw. 10(7) B152-B163 (2018)

Accelerating model synchronization for distributed machine learning in an optical wide area network

Ling Liu, Liangjun Song, Xi Chen, Hongfang Yu, and Gang Sun
J. Opt. Commun. Netw. 14(10) 852-865 (2022)

Deterministic latency networks: the enabler of edge data center synchronous operation [Invited]

Nihel Benzaoui, Subhadeep Sahoo, and Sebastien Bigo
J. Opt. Commun. Netw. 13(9) D115-D125 (2021)

Reliable and efficient RAR-based distributed model training in computing power network

Ling Chen, Yajie Li, Carlos Natalino, Yongcheng Li, Boxin Zhang, Yingbo Fan, Wei Wang, Yongli Zhao, and Jie Zhang
J. Opt. Commun. Netw. 16(5) 527-540 (2024)

Leveraging joint allocation of multidimensional resources for distributed task assignment

Jialong Li, Nan Hua, Kangqi Zhu, Chen Zhao, Guanqin Pan, Yanhe Li, Xiaoping Zheng, and Bingkun Zhou
J. Opt. Commun. Netw. 14(5) 351-364 (2022)