基于OpenStack的高资源利用率Docker调度模型

doi:10.19678/j.issn.1000-3428.0062658

摘要/Abstract

摘要： 在现有OpenStack云平台与Docker容器技术的集成方案中，基于容器初始资源请求的调度模型由于未充分考虑容器运行时的实际资源使用情况，导致资源利用率较低。为满足云计算领域的高资源利用率和低成本需求，构建基于OpenStack云平台的Docker调度模型（DSM），将其与OpenStack的Keystone、Glance以及Neutron组件的API进行交互，获取创建容器所需的镜像、网络等资源，同时调用Docker Engine提供的API部署容器，对容器生命周期进行高效灵活管控。通过融合初始化模块、资源实时感知模块、容器调度模块、资源实时监测模块和容器迁移模块，并在容器调度模块中利用资源可用度评估与优先级决策调度机制为容器选择最优的计算节点，实现OpenStack云平台中资源的高效利用。实验结果表明，与经典Nova-Docker和Yun集成方案采用的调度模型相比，DSM调度模型在CPU和内存利用率上至少提升38.54、30.17个百分点和38.40、28.69个百分点。

关键词: OpenStack云平台, Docker容器技术, 资源实时监测, 容器调度, 资源利用率

Abstract: The existing integration schemes of the OpenStack cloud platform and Docker container technology adopt a scheduling model based on the initial resource request of the container, which does not fully reflect the actual resource usage of the container when running and results in low resource utilization.This study proposes a Docker Scheduling Model(DSM) based on OpenStack to satisfy the high resource utilization and low-cost requirements in cloud computing.The DSM interacts with the Application Programming Interfaces(APIs) of OpenStack's Keystone, Glance, and Neutron components to obtain resources, such as images and networks required to create containers.It deploys containers by calling the API provided by the Docker Engine to efficiently and flexibly manage the life cycle of containers.The DSM integrates the initialization, real-time resource awareness, container scheduling, real-time resource monitoring, and container migration modules.In addition, the DSM adopts Resource Availability-evaluation and Priority Decision-making(RAPD) scheduling mechanisms in the container scheduling module to select the optimal compute node for the container and efficiently utilize resources in OpenStack.The experimental results show that compared with the scheduling model used in Nova-Docker and Yun, the DSM improves CPU utilization by at least 38.54 and 30.17 percentage points, respectively, and improves memory utilization by at least 38.40 and 28.69 percentage points, respectively.

Key words: OpenStack cloud platform, Docker container technology, real-time resource monitoring, container scheduling, resource utilization

中图分类号:

TP393

王小雪, 王晓锋, 刘渊. 基于OpenStack的高资源利用率Docker调度模型[J]. 计算机工程, 2022, 48(9): 171-179,196.

WANG Xiaoxue, WANG Xiaofeng, LIU Yuan. OpenStack-based Docker Scheduling Model with High Resource Utilization[J]. Computer Engineering, 2022, 48(9): 171-179,196.

http://www.ecice06.com/CN/Y2022/V48/I9/171

图/表 11

20221008183003

20221008183007

20221008183012

20221008183015

20221008183018

20221008183023

20221008183026

20221008183033

20221008183036

20221008183040

20221008183043

参考文献

[1] ZHANG Y M, LAN X L, REN J, et al.Efficient computing resource sharing for mobile edge-cloud computing networks[J].IEEE/ACM Transactions on Networking, 2020, 28(3):1227-1240.
[2] BENOMAR Z, LONGO F, MERLINO G, et al.Cloud-based network virtualization in IoT with OpenStack[J].ACM Transactions on Internet Technology, 2022, 22(1):1-26.
[3] CHEN F F, ZHOU X F, SHI C.The container deployment strategy based on stable matching[C]//Proceedings of the 4th International Conference on Cloud Computing and Big Data Analysis.Washington D.C., USA:IEEE Press, 2019:215-221.
[4] DE BENEDICTIS M, LIOY A.Integrity verification of Docker containers for a lightweight cloud environment[J].Future Generation Computer Systems, 2019, 97:236-246.
[5] FAN W B, HAN Z J, LI P, et al.A live migration algorithm for containers based on resource locality[J].Journal of Signal Processing Systems, 2019, 91(10):1077-1089.
[6] 杨鹏, 马志程, 彭博, 等.集成Docker容器的OpenStack云平台性能研究[J].计算机工程, 2017, 43(8):26-31. YANG P, MA Z C, PENG B, et al.Performance research of OpenStack cloud platform integrated with Docker container[J].Computer Engineering, 2017, 43(8):26-31.(in Chinese)
[7] KOZHIRBAYEV Z, SINNOTT R O.A performance comparison of container-based technologies for the Cloud[J].Future Generation Computer Systems, 2017, 68:175-182.
[8] ALIC A S, ALMEIDA J, ALOISIO G, et al.BIGSEA:a big data analytics platform for public transportation information[J].Future Generation Computer Systems, 2019, 96:243-269.
[9] LI H F, ZHOU H C, ZHANG H K, et al.EmuStack:an OpenStack-based DTN network emulation platform[C]//Proceedings of International Conference on Networking and Network Applications.Washington D.C., USA:IEEE Press, 2016:387-392.
[10] KRISTIANI E, YANG C T, HUANG C Y, et al.The implementation of a cloud-edge computing architecture using OpenStack and Kubernetes for air quality monitoring application[J].Mobile Networks and Applications, 2021, 26(3):1070-1092.
[11] MEKALA M S, VISWANATHAN P.Energy-efficient virtual machine selection based on resource ranking and utilization factor approach in cloud computing for IoT[J].Computers & Electrical Engineering, 2019, 73:227-244.
[12] MESHKATI J, SAFI-ESFAHANI F.Energy-aware resource utilization based on particle swarm optimization and artificial bee colony algorithms in cloud computing[J].The Journal of Supercomputing, 2019, 75(5):2455-2496.
[13] 朱炜, 王俊, 周迅钊.基于负载均衡的医院云计算系统资源调度方案[J].计算机工程, 2018, 44(3):37-41, 54. ZHU W, WANG J, ZHOU X Z.Hospital cloud computing system resource scheduling scheme based on load balancing[J].Computer Engineering, 2018, 44(3):37-41, 54.(in Chinese)
[14] 韦传讲, 庄毅.面向移动云计算的自适应虚拟机调度算法[J].小型微型计算机系统, 2021, 42(1):96-104. WEI C J, ZHUANG Y.Self-adaptive virtual machine scheduling algorithm for mobile cloud computing[J].Journal of Chinese Computer Systems, 2021, 42(1):96-104.(in Chinese)
[15] DABBAGH M, HAMDAOUI B, GUIZANI M, et al.An energy-efficient VM prediction and migration framework for overcommitted clouds[J].IEEE Transactions on Cloud Computing, 2016, 6(4):955-966.
[16] BEGAM R, WANG W, ZHU D K.TIMER-cloud:time-sensitive VM provisioning in resource-constrained clouds[J].IEEE Transactions on Cloud Computing, 2020, 8(1):297-311.
[17] YANG C T, CHEN S T, LIU J C, et al.An energy-efficient cloud system with novel dynamic resource allocation methods[J].The Journal of Supercomputing, 2019, 75(8):4408-4429.
[18] ABDULLAH M, IQBAL W, BUKHARI F, et al.Diminishing returns and deep learning for adaptive CPU resource allocation of containers[J].IEEE Transactions on Network and Service Management, 2020, 17(4):2052-2063.
[19] YANG S J, WANG X F, AN L, et al.Yun:a high-performance container management service based on OpenStack[C]//Proceedings of the 4th IEEE International Conference on Data Science in Cyberspace.Washington D.C., USA:IEEE Press, 2019:202-209.
[20] 林伟伟, 王泽涛.基于遗传算法的Docker集群调度策略[J].华南理工大学学报(自然科学版), 2018, 46(3):127-133. LIN W W, WANG Z T.Docker cluster scheduling strategy based on genetic algorithm[J].Journal of South China University of Technology(Natural Science Edition), 2018, 46(3):127-133.(in Chinese)
[21] OpenStack.Zun[EB/OL].[2021-07-15].https://docs.openstack.org/zun/latest/.
[22] YANG S J, WANG X F, WANG X X, et al.High-performance Docker integration scheme based on OpenStack[J].World Wide Web, 2020, 23(4):2593-2632.
[23] XIE Y L, JIN M P, ZOU Z P, et al.Real-time prediction of Docker container resource load based on a hybrid model of ARIMA and triple exponential smoothing[J].IEEE Transactions on Cloud Computing, 2022, 10(2):1386-1401.
[24] UY N Q, NAM V H.A comparison of AMQP and MQTT protocols for Internet of Things[C]//Proceedings of the 6th NAFOSTED Conference on Information and Computer Science.Washington D.C., USA:IEEE Press, 2019:292-297.
[25] MAO Y, OAK J, POMPILI A, et al.DRAPS:dynamic and resource-aware placement scheme for Docker containers in a heterogeneous cluster[C]//Proceedings of the 36th International Performance Computing and Communications Conference.Washington D.C., USA:IEEE Press, 2017:1-8.
[26] MA L L, YI S H, CARTER N, et al.Efficient live migration of edge services leveraging container layered storage[J].IEEE Transactions on Mobile Computing, 2019, 18(9):2020-2033.
[27] Python.Psutil[EB/OL].[2021-07-15].https://pypi.org/project/psutil/.

选择文件类型/文献管理软件名称

选择包含的内容