Resource Scheduling Mechanism for Space-Air-Ground Integrated Computing Power Networks

doi:10.19678/j.issn.1000-3428.0069471

Abstract

Abstract:

In response to the increasing demand for fast response and large-scale coverage in application scenarios such as satellite data processing and vehicle remote control, this study focuses on utilizing hierarchical control and artificial intelligence technology to design a resource scheduling mechanism for space-air-ground integrated computing power networks. Air, space, and ground networks are divided into three domains, and domain controllers are deployed for resource management in the corresponding local domain. The areas are divided based on the coverage of satellites and drones to ensure that they can achieve effective service guarantees, efficient data transmission, and task processing. A multi-agent reinforcement learning-based scheduling algorithm is proposed to optimize resource utilization in space-air-ground integrated computing power networks, considering each domain controller is treated as an agent with task scheduling and resource allocation capabilities. Intelligent resource scheduling and efficient resource allocation for computing tasks are realized through collaborative learning and distributed decision-making with satisfactory delay and energy consumption constraints. Computing tasks are generated in different scenarios and processed in real time. Simulation results show that the proposed mechanism can effectively improve resource utilization and shorten task response time.

Key words: Space-Air-Ground Integrated Network (SAGIN), computing power network, task scheduling, resource allocation, multi-agent reinforcement learning

摘要：

为满足卫星数据处理、车辆远程控制等快速响应和大范围覆盖的应用场景需求, 聚焦于采用分层控制和人工智能技术的方法, 设计一种空天地一体化算力网络资源调度机制。将空天地网络划分为3个域, 分别部署域控制器, 负责本地域的资源管理, 同时通过卫星和无人机的覆盖范围进行地面区域划分, 确保地面区域能够得到有效的服务保障, 以实现高效的数据传输和任务处理。为了优化空天地算力网络资源利用率, 引入多智能体强化学习算法, 对不同场景下产生的计算任务进行实时处理, 将每个域控制器视为具备任务调度和资源分配能力的智能体, 在满足时延和能耗的约束下, 通过协同学习和分布式决策实现计算任务智能调度和高效分配。实验结果表明, 该机制能够有效提高资源利用率和缩短任务响应时间。

关键词: 空天地一体化网络, 算力网络, 任务调度, 资源分配, 多智能体强化学习

WANG Kewen, ZHANG Weiting, SUN Tong. Resource Scheduling Mechanism for Space-Air-Ground Integrated Computing Power Networks[J]. Computer Engineering, 2025, 51(5): 52-61.

王克文, 张维庭, 孙童. 空天地一体化算力网络资源调度机制[J]. 计算机工程, 2025, 51(5): 52-61.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0069471

https://www.ecice06.com/EN/Y2025/V51/I5/52

Figures/Tables 7

Fig.1 Application scenarios of the SAGIN

Fig.2 Architecture of task scheduling and resource allocation based on MAPPO

Fig.3 System rewards under different algorithms

Fig.4 System rewards under different learning rates

Fig.5 System rewards under different computing resources

Fig.6 Average delay of tasks under different computing resource requirements

References 26

1	CHENG N , LV F , QUAN W , et al. Space/aerial-assisted computing offloading for IoT applications: a learning-based approach. IEEE Journal on Selected Areas in Communications, 2019, 37 (5): 1117- 1129. doi: 10.1109/JSAC.2019.2906789
2	张维庭, 孙呈蕙, 王洪超, 等. 算网资源智能适配与融合调度方法. 电信科学, 2023, 39 (9): 12- 20.
	ZHANG W T , SUN C H , WANG H C , et al. Intelligent adaptation and integrated scheduling method for computing and networking resources. Telecommunications Science, 2023, 39 (9): 12- 20.
3	ZHANG P Y , WANG C , KUMAR N , et al. Space-air-ground integrated multi-domain network resource orchestration based on virtual network architecture: a DRL method. IEEE Transactions on Intelligent Transportation Systems, 2022, 23 (3): 2798- 2808. doi: 10.1109/TITS.2021.3099477
4	WANG C , LIU L , JIANG C X , et al. Incorporating distributed DRL into storage resource optimization of space-air-ground integrated wireless communication network. IEEE Journal of Selected Topics in Signal Processing, 2022, 16 (3): 434- 446. doi: 10.1109/JSTSP.2021.3136027
5	ZHANG N , ZHANG S , YANG P , et al. Software defined space-air-ground integrated vehicular networks: challenges and solutions. IEEE Communications Magazine, 2017, 55 (7): 101- 109. doi: 10.1109/MCOM.2017.1601156
6	HE J C , CHENG N , YIN Z S , et al. Service-oriented network resource orchestration in space-air-ground integrated network. IEEE Transactions on Vehicular Technology, 2024, 73 (1): 1162- 1174. doi: 10.1109/TVT.2023.3301676
7	GUO H Z , LI J Y , LIU J J , et al. A survey on space-air-ground-sea integrated network security in 6G. IEEE Communications Surveys & Tutorials, 2022, 24 (1): 53- 87.
8	ZHANG P Y , CHEN N , SHEN S G , et al. AI-enabled space-air-ground integrated networks: management and optimization. IEEE Network, 2024, 38 (2): 186- 192. doi: 10.1109/MNET.131.2200477
9	CAO B , ZHANG J T , LIU X , et al. Edge-cloud resource scheduling in space-air-ground-integrated networks for Internet of vehicles. IEEE Internet of Things Journal, 2022, 9 (8): 5765- 5772. doi: 10.1109/JIOT.2021.3065583
10	曾锋, 张政, 陈志刚. 基于深度强化学习的计算卸载与资源分配策略. 通信学报, 2023, 44 (7): 124- 135.
	ZENG F , ZHANG Z , CHEN Z G . Computation offloading and resource allocation strategy based on deep reinforcement learning. Journal on Communications, 2023, 44 (7): 124- 135.
11	CHEN M Z , CHALLITA U , SAAD W , et al. Artificial neural networks-based machine learning for wireless networks: a tutorial. IEEE Communications Surveys & Tutorials, 2019, 21 (4): 3039- 3071.
12	SUNDAR S , CHAMPATI J P , LIANG B . Multi-user task offloading to heterogeneous processors with communication delay and budget constraints. IEEE Transactions on Cloud Computing, 2022, 10 (3): 1958- 1974. doi: 10.1109/TCC.2020.3019952
13	ZHANG W T , YANG D , ZHANG C , et al. (Com)²Net: a novel communication and computation integrated network architecture. IEEE Network, 2024, 38 (2): 35- 44. doi: 10.1109/MNET.2024.3355922
14	TANG F X , HOFNER H , KATO N , et al. A deep reinforcement learning-based dynamic traffic offloading in Space-Air-Ground Integrated Networks (SAGIN). IEEE Journal on Selected Areas in Communications, 2022, 40 (1): 276- 289. doi: 10.1109/JSAC.2021.3126073
15	XIE R C , TANG Q Q , WANG Q N , et al. Satellite-terrestrial integrated edge computing networks: architecture, challenges, and open issues. IEEE Network, 2020, 34 (3): 224- 231. doi: 10.1109/MNET.011.1900369
16	SHANG B D , YI Y , LIU L J . Computing over space-air-ground integrated networks: challenges and opportunities. IEEE Network, 2021, 35 (4): 302- 309. doi: 10.1109/MNET.011.2000567
17	张婷婷, 武楠, 姚海鹏. 天地融合网络智能组网体系架构研究. 天地一体化信息网络, 2022, 3 (3): 47- 55.
	ZHANG T T , WU N , YAO H P . Research on intelligent networking architecture for the integrated space-terrestrial networks. Space-Integrated-Ground Information Networks, 2022, 3 (3): 47- 55.
18	李斌, 刘文帅, 费泽松. 面向空天地异构网络的边缘计算部分任务卸载策略. 电子与信息学报, 2022, 44 (9): 3091- 3098.
	LI B , LIU W S , FEI Z S . Partial computation offloading for mobile edge computing in space-air-ground integrated network. Journal of Electronics & Information Technology, 2022, 44 (9): 3091- 3098.
19	PENG H X, SHEN X S. DDPG-based resource management for MEC/UAV-assisted vehicular networks[C]//Proceedings of the IEEE 92nd Vehicular Technology Conference (VTC2020-Fall). Washington D.C., USA: IEEE Press, 2020: 1-6.
20	CHENG M , ZHU C L , LIN M , et al. An O-MAPPO scheme for joint computation offloading and resources allocation in UAV assisted MEC systems. Computer Communications, 2023, 208, 190- 199. doi: 10.1016/j.comcom.2023.06.008
21	XIAO Y, SONG Y Q, LIU J. Towards energy efficient resource allocation: when green mobile edge computing meets multi-agent deep reinforcement learning[C]//Proceedings of the IEEE International Conference on Communications. Washington D.C., USA: IEEE Press, 2022: 4056-4061.
22	JIANG Y Y , MAO Y X , WU G X , et al. A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning. Computers and Electrical Engineering, 2022, 103, 108278. doi: 10.1016/j.compeleceng.2022.108278
23	YU C, VELU A, VINITSKY E, et al. The surprising effectiveness of PPO in cooperative, multi-agent games[EB/OL]. [2024-02-11]. https://arxiv.org/abs/2103.01955v4.
24	SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algorithms[EB/OL]. [2024-02-11]. https://arxiv.org/abs/1707.06347.
25	SCHULMAN J, MORITZ P, LEVINE S, et al. High-dimensional continuous control using generalized advantage estimation[EB/OL]. [2024-02-11]. https://arxiv.org/abs/1506.02438v6.
26	KANG H Y , CHANG X L , MIŠIĆ J , et al. Cooperative UAV resource allocation and task offloading in hierarchical aerial computing systems: a MAPPO-based approach. IEEE Internet of Things Journal, 2023, 10 (12): 10497- 10509. doi: 10.1109/JIOT.2023.3240173

[1]	LI Bin, SHAN Huimin. Collaborative Optimization of Heterogeneous Resources in Air-Ground Computing Power Networks [J]. Computer Engineering, 2025, 51(5): 1-8.
[2]	CHEN Hao, DANG Zheng, HEI Xinhong, ZHAO Tong, ZHANG Jie. Load Prediction of Digital Twin Logical Range in Space-Air-Ground Computing Power Networks Based on SSA-VMD [J]. Computer Engineering, 2025, 51(5): 20-32.
[3]	DU Jianbo, DONG Weizhe, JIN Rong, WANG Junxuan, KANG Jiawen, LIU Lei, Celimuge Wu. Task Segmentation and Resource Allocation in MEC-Based Space-Air-Ground Integrated Networks [J]. Computer Engineering, 2025, 51(5): 43-51.
[4]	FENG Shuang, JIANG Bo, XU Hong. Task Scheduling for Heterogeneous Multi-Core Processors Based on Evolutionary Adaptive Bat Algorithm [J]. Computer Engineering, 2025, 51(5): 249-256.
[5]	LIN Shaofu, CHEN Yingying, LI Shuopeng. Method of Joint Optimization for Multi-UAV Energy Transfer and Edge Computing Based on Deep Reinforcement Learning [J]. Computer Engineering, 2025, 51(3): 144-154.
[6]	ZHANG Junna, LI Tianze, ZHAO Xiaoyan, YUAN Peiyan. A Decentralized Priority Offloading Strategy Based on DQN [J]. Computer Engineering, 2024, 50(9): 235-245.
[7]	Yaoping ZENG, Yuting XIA, Weiwei JIANG, Yueqiang LIU. Research on UAV-Assisted Mobile Edge Computing Strategy with Weighted Energy Minimization [J]. Computer Engineering, 2024, 50(2): 288-297.
[8]	YAN Changyu, ZHANG Lei. Hybrid List-Scheduling Algorithm Based on Task Duplication and Pre-Scheduling [J]. Computer Engineering, 2024, 50(12): 124-132.
[9]	BI Qian, QIAN Cheng, ZHANG Ke, WANG Cheng. Design of Multi-Agent Angle Tracking Method Based on Deep Reinforcement Learning [J]. Computer Engineering, 2024, 50(11): 10-17.
[10]	ZHANG Junna, HAN Chaochen, CHEN Jiawei, ZHAO Xiaoyan, YUAN Peiyan. A Method for Joint Edge Server Deployment and Service Placement [J]. Computer Engineering, 2024, 50(10): 266-280.
[11]	Yuqi BAN, Liguo DUAN, Haoyu WEN, Aiping LI, Jumin ZHAO. Research on Mobility-Aware Computation Offloading and Resource Allocation Strategy [J]. Computer Engineering, 2023, 49(8): 163-173.
[12]	Jing MEI, Longbao DAI, Zhao TONG, Xin DENG, Jiake WANG. Adaptive Offloading Algorithm Based on Lyapunov Optimization Under Resource Constraints [J]. Computer Engineering, 2023, 49(7): 34-46.
[13]	LI Qiang, YI Jinhui, DU Tingting, WANG Shengchun. Dependent Task Offloading and Resource Allocation Based on A3C in Mobile Edge Computing [J]. Computer Engineering, 2023, 49(6): 42-52.
[14]	ZHENG Liping, ZHAO Yujuan, FEI Xuan. Communication Resource Allocation Algorithm Based on Improved MOEA/D in Internet of Vehicles [J]. Computer Engineering, 2023, 49(5): 191-197.
[15]	YANG Liwei, JIA Boyu, WANG Fang, PENG Xiangyuan. Resource Management Algorithm of Visible Light Communication and WiFi Heterogeneous Network [J]. Computer Engineering, 2023, 49(3): 203-210,220.

Please choose a citation manager

Content to export