Research on Kubernetes-based Cluster Energy-Saving Strategy

doi:10.19678/j.issn.1000-3428.0068453

Abstract

Abstract:

Within Kubernetes, the Horizontal Pod Autoscaler(HPA) possesses automatic Pod-scaling capability, adjusting the number of Pods based on fluctuations in traffic, increasing the Pod count during peak periods to meet demand, and reducing it during off-peak times to conserve resources. However, because HPA scales are based on the current performance metrics of Pods, sudden traffic surges can potentially have detrimental effects on the availability of application services. In addition, during periods of low demand, idle computing resources lead to a waste of resources. To address these challenges, this study investigates and validates cluster resource autoscaling and intelligent sleep-wake strategy based on time-series forecasting. This strategy utilizes the GC-TimesNet model to predict cluster resource usage. When resource utilization is low, the strategy calculates the number of compute nodes that need to be shut down, marks these nodes as unschedulable, evicts existing Pods, and places these machines in a sleep state. Conversely, when the resource demand increases, a sufficient number of machines are awakened, and the HPA controller is used to increase the required number of Pod replicas. The experimental results demonstrate that this strategy can reasonably and accurately predict trends in cluster load changes, enhance the operational management capabilities for optimizing clusters, maximize the utilization of computing resources, provide data support for reducing cluster energy expenses, and achieve energy savings and emission reduction when combined with the implementation of intelligent sleep and wake strategies.

Key words: Kubernetes tool, container orchestration, cluster energy-saving, time series forecasting, GC-TimesNet model, convolutional neural network, attention mechanism, energy saving and emission reduction

摘要：

在Kubernetes中, HPA具备自动扩展Pod的能力, 它可以根据流量的波动情况, 在高峰时增加Pod数量以应对需求, 而在低谷时减少数量以节省资源。然而, 由于HPA是根据当前Pod的性能指标来进行扩展的, 当流量激增时, 可能会对应用服务的可用性产生不利影响, 并且当压力较小时, 算力资源的空载会导致电子资源的浪费。针对上述问题, 研究并验证一种基于时序预测的集群资源自动缩放与智能休眠唤醒策略, 使用GC-TimesNet模型对集群资源的使用情况进行预测。当资源利用率较低时, 计算出需要关闭的算力节点数量, 将这些节点设置为不可调度状态, 并驱逐节点现有的Pod, 然后将这些机器置于睡眠状态。相反, 当资源需求增加时, 会唤醒足够数量的机器, 并通过HPA控制器增加所需数量的Pod副本。实验结果表明, 该策略能够较为准确地预测集群负载的变化趋势, 结合实施智能的休眠与唤醒策略, 提升优化集群的运维管理能力, 最大程度地提高计算资源的利用率, 为降低集群能源开销提供数据支撑, 实现节能减排。

关键词: Kubernetes工具, 容器编排, 集群节能, 时间序列预测, GC-TimesNet模型, 卷积神经网络, 注意力机制, 节能减排

LI Junjun, DONG Jiangang, LI Kun. Research on Kubernetes-based Cluster Energy-Saving Strategy[J]. Computer Engineering, 2024, 50(9): 82-91.

李俊俊, 董建刚, 李坤. 基于Kubernetes的集群节能策略研究[J]. 计算机工程, 2024, 50(9): 82-91.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0068453

https://www.ecice06.com/EN/Y2024/V50/I9/82

Figures/Tables 14

Fig.1 Overall architecture of Kubernetes

Fig.2 Overall architecture of CBAM

Fig.3 Schematic diagram of channel attention module

Fig.4 Schematic diagram of spatial attention module

Fig.5 CBAM-Inception architecture

Fig.6 TimesNet structure

Fig.7 TimesBlock process diagram

Fig.8 Model training process

Fig.9 Pod replica count variation chart

Fig.10 Cluster Node count variation chart

References 24

1	LINTHICUM D S. Cloud computing changes data integration forever: what's needed right now. IEEE Cloud Computing, 2017, 4(3): 50- 53. doi: 10.1109/MCC.2017.47
2	杨清波, 陈振宇, 刘东, 等. 基于容器的调控云PaaS平台的设计与实现. 电网技术, 2020, 44(6): 2030- 2037. URL
	YANG Q B, CHEN Z Y, LIU D, et al. Design and implementation of dispatching and control cloud PaaS platform based on container. Power System Technology, 2020, 44(6): 2030- 2037. URL
3	刘洋, 赵瑞锋, 李波, 等. 基于Docker技术的静态安全分析云计算应用. 电力科学与技术学报, 2021, 36(4): 181- 187. URL
	LIU Y, ZHAO R F, LI B, et al. Application research of static security analysis cloud computing based on Docker technology. Journal of Electric Power Science and Technology, 2021, 36(4): 181- 187. URL
4	吴逸文, 张洋, 王涛, 等. 从Docker容器看容器技术的发展: 一种系统文献综述的视角. 软件学报, 2023, 34(12): 5527- 5551. URL
	WU Y W, ZHANG Y, WANG T, et al. Development exploration of container technology through Docker containers: a systematic literature review perspective. Journal of Software, 2023, 34(12): 5527- 5551. URL
5	杜金涛, 董建刚, 承华青. Kubernetes水平伸缩策略的改进研究. 现代电子技术, 2023, 46(10): 129- 136. URL
	DU J T, DONG J G, CHENG H Q. Research on improvement of Kubernetes horizontal scaling strategy. Modern Electronics Technique, 2023, 46(10): 129- 136. URL
6	BRENDAN B, BRAIN G, DAVID O, et al. Omega, and Kubernetes: lessons learned from three container-management systems over a decade. Association for Computing Machinery, 2016, 14(1): 70- 93.
7	GILLY K, JUIZ C, PUIGJANER R. An up-to-date survey in Web load balancing. World Wide Web, 2011, 14(2): 105- 131.
8	NGUYEN T T, YEOM Y J, KIM T, et al. Horizontal Pod autoscaling in Kubernetes for elastic container orchestration. Sensors, 2020, 20(16): 4621.
9	苏逸凡. 基于Kubernetes的动态资源调度策略研究与实现[D]. 杭州: 浙江理工大学, 2022.
	SU Y F. Research and implementation of dynamic resource scheduling strategy based on Kubernetes[D]. Hangzhou: Zhejiang Sci-Tech University, 2022. (in Chinese)
10	石硕, 魏振辉, 刘晓菲, 等. 一种基于LSTM的Kubernetes容器云弹性伸缩策略研究. 制造业自动化, 2023, 45(9): 189- 196. URL
	SHI S, WEI Z H, LIU X F, et al. Research on an LSTM-based Kubernetes container cloud elastic scaling strategy. Manufacturing Automation, 2023, 45(9): 189- 196. URL
11	陈烨. 面向Web应用的Kubernetes容器弹性伸缩方法的研究[D]. 上海: 华东师范大学, 2022.
	CHEN Y. Research on flexible scaling method of Kubernetes container for Web application[D]. Shanghai: East China Normal University, 2022. (in Chinese)
12	BALLA D, SIMON C, MALIOSZ M. Adaptive scaling of Kubernetes Pods[C]//Proceedings of the 2020 IEEE/IFIP Network Operations and Management Symposium. Washington D. C., USA: IEEE Press, 2020: 1-5.
13	FARAHNAKIAN F, LILJEBERG P, PLOSILA J. LiRCUP: linear regression based CPU usage prediction algorithm for live migration of virtual machines in data centers[C]//Proceedings of the 39th Euromicro Conference on Software Engineering and Advanced Applications. Washington D. C., USA: IEEE Press, 2013: 23.
14	CALHEIROS R N, MASOUMI E, RANJAN R, et al. Workload prediction using ARIMA model and its impact on cloud applications' QoS. IEEE Transactions on Cloud Computing, 2015, 3(4): 449- 458.
15	JANARDHANAN D, BARRETT E. CPU workload forecasting of machines in data centers using LSTM recurrent neural networks and ARIMA models[C]//Proceedings of the 12th International Conference for Internet Technology and Secured Transactions(ICITST). Washington D. C., USA: IEEE Press, 2017: 55-60.
16	WU H, HU T, LIU Y, et al. TimesNet: temporal 2d-variation modeling for general time series analysis[EB/OL]. [2023-07-15]. https://ui.adsabs.harvard.edu/abs/2022arXiv221002186W/abstract.
17	LARA-BENÍTEZ P, GALLEGO-LEDESMA L, CARRANZA-GARCÍA M, et al. Evaluation of the Transformer architecture for univariate time series forecasting[C]//Proceedings of the 19th Conference of the Spanish Association for Artificial Intelligence. Berlin, Germany: Springer, 2021: 106-115.
18	刘杭, 殷歆, 陈杰, 等. 基于混合网络模型的多维时间序列预测. 计算机工程, 2023, 49(1): 121- 129. URL
	LIU H, YIN X, CHEN J, et al. Multi-dimensional time-series prediction based on hybrid network models. Computer Engineering, 2023, 49(1): 121- 129. URL
19	WU H, XU J, WANG J, et al. Autoformer: decomposition transformers with auto-correlation for long-term series forecasting. Advances in Neural Information Processing Systems, 2021, 34, 22419- 22430.
20	Kubernetes Official Website. Kubernetes introduction[EB/OL]. [2023-07-15]. https://kubernetes.io.
21	BISHOP C M. Training with noise is equivalent to Tikhonov regularization. Neural Computation, 1995, 7(1): 108- 116.
22	WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of ECCV 2018. Berlin, Germany: Springer, 2018: 3-19.
23	HENDRYCKS D, GIMPEL K. Gaussian Error Linear Units(GELUs)[EB/OL]. [2023-07-15]. https://arxiv.org/abs/1606.08415.
24	SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Washington D. C., USA: IEEE Press, 2015: 1-9.

[1]	ZHANG Tianpeng, HAN Jing, LÜ Xueqiang. Super-Resolution-Aided Small-Target Detection Based on Multi-Task Learning [J]. Computer Engineering, 2024, 50(9): 304-312.
[2]	GUO Min, ZHANG Xihan, LI Yang. Integrated Attentional Teacher Mutual Consistency Semi-Supervised Medical Image Segmentation [J]. Computer Engineering, 2024, 50(9): 313-323.
[3]	GAO Yubao, WEN Zhicheng. Dual Decoder Image Denoising Method Based on Attention Mechanism [J]. Computer Engineering, 2024, 50(9): 324-332.
[4]	ZENG Yuqi, LIU Bo, ZHONG Baichang, ZHONG Jin. Student Classroom Behavior Detection Algorithm Based on Improved YOLOv8 in Smart Education [J]. Computer Engineering, 2024, 50(9): 344-355.
[5]	LIN Chang, GUO Wei, REN Zhecong, JIN Haibo. Unification Algorithm for Object Tracking and Segmentation Based on Transformer [J]. Computer Engineering, 2024, 50(9): 130-141.
[6]	LI Zelin, LÜ Zhaofeng, CHEN Fuqiang, LI Ke. Entity Alignment Model Based on Multi-Hop Information Fusion [J]. Computer Engineering, 2024, 50(9): 142-152.
[7]	WANG Ruying, MA Jiajun, DONG Jianqiang, LIU Wanlong, ZHANG Haitao, YIN Kai, ZHAO Bochao. Industrial Load Forecasting Method Based on MTS-BiGRU-DMHSA [J]. Computer Engineering, 2024, 50(9): 169-178.
[8]	ZHANG Lu, TIAN Chunwei, SONG Huansheng, LIU Shigang. Multi-Level Dual-Tree Complex Wavelet Network for Low-Dose CT Image Denoising [J]. Computer Engineering, 2024, 50(9): 266-275.
[9]	ZHU Kai, LI Li, ZHANG Tong, JIANG Sheng, BIE Yiming. Multi-Stage Motion Blur Image Restoration Network Based on Transformer [J]. Computer Engineering, 2024, 50(9): 276-285.
[10]	WANG Zhihao, QIAN Yuntao. Super-Resolution Reconstruction of Spatiotemporal Fusion for Dual-Stream Remote Sensing Images Based on Swin Transformer [J]. Computer Engineering, 2024, 50(9): 33-45.
[11]	Suzhe WANG, Xueying ZHANG, Xiaoyu CHEN, Fenglian LI, Zeling WU. EEG Enhancement Algorithm Based on Combination of Effective Attention and GAN [J]. Computer Engineering, 2024, 50(8): 336-344.
[12]	Yu WANG, Qi QI, Chun WANG, Cai XU. High-Precision Fault Diagnosis Method for Energy Storage Inverter Signals [J]. Computer Engineering, 2024, 50(8): 389-396.
[13]	Rixin RAO, Yiwen WANG, Lizhi ZENG, Xintian TONG, Haitao ZHAO. Lightweight Network Model for Waste Cable Detection [J]. Computer Engineering, 2024, 50(8): 22-30.
[14]	Huayu LI, Zhikang ZHANG, Yang YAN, Yang YUE. Enhanced Domain Multi-modal Entity Recognition Based on Knowledge Graph [J]. Computer Engineering, 2024, 50(8): 31-39.
[15]	Lei WANG, Shipeng DANG, Feng PAN. Model for Predicting Concealed Accessory Pathway Based on Convolutional Neural Network [J]. Computer Engineering, 2024, 50(8): 40-49.

Please choose a citation manager

Content to export