MADRLOM: A Computation Offloading Mechanism for Software-Defined Cloud-Edge Computing Power Network

Cloud-edge computing power network often exhibits complex and heterogeneous structures, posing several challenges to computation offloading that significantly impact network performance and the efficient utilization of computation resources. In this paper, we propose a cloud-edge computing power network architecture that efficiently integrates cloud and edge computing resources into a single network system using software-defined networking technology to support upper-layer business applications. In this context, existing computation offloading methods struggle with issues like users' personalized requirements for latency and energy consumption, as well as the inability to adapt to dynamically complex environments. To overcome these challenges, we introduce a computation offloading mechanism, MADRLOM, focusing on the network's heterogeneity and modeling the computation offloading problem at the cloud-edge end. We formalize the offloading problem as a Markov process and employ a multi-agent deep reinforcement learning algorithm based on priority experience replay sampling to address the planning problem of computation offloading, allowing user equipment to continuously optimize offloading strategies in response to environmental changes and achieve rational resource allocation. Through dynamic offloading strategies, computation tasks can be intelligently allocated to appropriate computing nodes, thereby achieving optimal resource utilization. We utilized the Mininet simulation platform to construct the experimental environment for the software-defined cloud-edge computing power network and compared it with several representative computation offloading strategies. The experimental results demonstrate that the MADRLOM significantly reduces the total system overhead in the software-defined cloud-edge computing network and shows excellent adaptability to environmental changes.