基于虚拟机整合的云数据中心资源管理研究

doi:10.3969/j.issn.1000-3428.2016.09.002

摘要/Abstract

摘要：

虚拟机的动态整合是云数据中心资源管理的一种技术手段,通过将过载或欠载物理主机上的虚拟机(VM)进行在线迁移,并将空闲物理主机节点切换至休眠状态,实现将等量的VM汇聚至较少的物理机上,同时保证服务质量,由此提高云数据中心中资源利用率与能源效率,减少能源消耗,实现绿色计算。对近年来该领域的相关研究进行了梳理归纳,分别就过载检测、欠载检测、目的主机选取等子问题进行分析,并将一些涉及到的技术如负荷预测、优化技术等提炼出来进行阐释,描述实验验证环境与解决方案的评价问题,并对理论问题的相关研究和未来研究方向进行探讨。

关键词: 云计算, 资源管理, 虚拟机整合, 服务器整合, 数据中心, 虚拟化

Abstract:

Dynamic consolidation of Virtual Machines(VM) is a means of resource management in cloud data centers.By using live migration of virtual machines for those overloaded or underloaded Physical Machines(PM) and switching idle nodes to the sleep mode with the guarantee of Quality of Service(QoS) at the same time,it helps to improve the utilization of resources and energy efficiency in cloud data centers.It is an effective way to reduce energy consumption and realize green computing.This paper summarizes relevant literatures in recent years,and analyses sub problems including overload detection,underload detection,and destination host selection,etc.,and elucidates thoroughly the involved technique such as load prediction and optimization.It describes the circumstances for experimental verification and the evaluation of technical proposal,and discusses relevant research of theoretical problems and future research directions.

Key words: cloud computing, resource management, Virtual Machine(VM) consolidation, server consolidation, data center, virtualization

中图分类号:

TP399

王霆,董启文,范斐斐. 基于虚拟机整合的云数据中心资源管理研究[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2016.09.002.

WANG Ting,DONG Qiwen,FAN Feifei. Research on Resource Management in Cloud Data Center Based on Virtual Machine Consolidation[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2016.09.002.

http://www.ecice06.com/CN/Y2016/V42/I9/5

参考文献

参考文献［1］Buyya R,Yeo C S,Venugopal S,et al.Cloud Computing and Emerging IT Platforms:Vision,Hype,and Reality for Delivering Computing as the 5th Utility［J］.Future Generation Computer Systems,2009,25(6):599-616. ［2］国家绿色数据中心试点工作方案［EB/OL］.［2015-10-16］.http://www.miit.gov.cn/n11293472/n11293832/n12843926/n13917012/16514486.html. ［3］Liu Xiaocheng,Wang Chen,Zhou Bingbing,et al.Priority-based Consolidation of Parallel Workloads in the Cloud［J］.IEEE Transactions on Parallel and Distributed Systems,2013,24(9):1874-1883. ［4］Mastroianni C,Meo M,Papuzzo G.Probabilistic Consolidation of Virtual Machines in Self-organizing Cloud Data Centers［J］.IEEE Transactions on Cloud Computing,2013,1(2):215-228. ［5］Speitkamp B,Bichler M.A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers［J］.IEEE Transactions on Services Computing,2010,3(4):266-278. ［6］Beloglazov A,Abawajy J,Buyya R.Energy-aware Resource Allocation Heuristics for Efficient Management of Data Centers for Cloud Computing［J］.Future Generation Computer Systems,2012,28(5):755-768. ［7］Xiao Zhen,Song Weijia,Chen Qi.Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment［J］.IEEE Transactions on Parallel And Distributed Systems,2013,24(6):1107-1117. ［8］Beloglazov A,Buyya B.Optimal Online Deterministic Algorithms and Adaptive Heuristics for Energy and Performance Efficient Dynamic Consolidation of Virtual Machines in Cloud Data Centers［J］.Concurrency and Computation-practice & Experience,2012,24(13):1397-1420. ［9］Xu Hong,Li Baochun.Anchor:A Versatile and Efficient Framework for Resource Management in the Cloud［J］.IEEE Transactions on Parallel and Distributed Systems,2013,24(6):1066-1076. ［10］Chiang R C,Huang H H.TRACON:Interference-aware Scheduling for Data-intensive Applications in Virtualized Environments［J］.IEEE Transactions on Parallel and Distributed Systems,2014,25(5):1349-1358. ［11］Kansal N J,Chana I.Artificial Bee Colony Based Energy-aware Resource Utilization Technique for Cloud Computing［J］.Concurrency and Computation:Practice and Experience,2015,27(5):1207-1225. ［12］Xu Bo,Peng Zhiping,Xiao Fangxiong et al.Dynamic Deployment of Virtual Machines in Cloud Computing Using Multi-objective Optimization［J］.Soft Com-puting,2015,19(8):2265-2273. ［13］Farahnakian F,Ashraf A,Pahikkala T,et al.Using Ant Colony System to Consolidate VMs for Green Cloud Computing［J］.IEEE Transactions on Services Com-puting,2015,8(2):187-198. ［14］Agostinho L,Feliciano G,Olivi L,et al.A Bio-inspired Approach to Provisioning of Virtual Resources in Federated Clouds［C］//Proceedings of IEEE DASC’11.Washington D.C.,USA:IEEE Press,2011:598-604. ［15］董玉双.云平台中虚拟机部署的关键问题研究［D］.长春:吉林大学,2014. ［16］Beloglazov A,Buyya R.Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers Under Quality of Service Constraints［J］.IEEE Transactions on Parallel and Distributed Systems,2013,24(7):1366-1379. ［17］何丽.基于灰色关联度的云计算虚拟机分配方法［J］.计算机应用,2014,34(8):2252-2255. ［18］艾浩军,龚素文,袁远明.基于多目标演化算法的云计算虚拟机分配策略研究［J］.计算机科学,2014,41(6):48-53. ［19］Islam S,Keung J,Lee K,et al.Empirical Prediction Models for Adaptive Resource Provisioning in the Cloud［J］.Future Generation Computer Systems,2012,28(1):155-162. ［20］Kousiouris G,Cucinott T,Varvarigou T.The Effects of Scheduling,Workload Type and Consolidation Scenarios on Virtual Machine Performance and Their Prediction Through Optimized Artificial Neural Networks［J］.The Journal of Systems and Software,2011,84(8) 1270-1291. ［21］Cetinski K,Juric M B.AME-WPC:Advanced Model for Efficient Workload Prediction in the Cloud［J］.Journal of Network and Computer Applications,2015,55:191-201. ［22］Chen Zhijia,Zhu Yuanchang,Di Yanqiang,et al.Self-adaptive Prediction of Cloud Resource Demands Using Ensemble Model and Subtractive-fuzzy Clustering Based Fuzzy Neural Network［J］.Computational Intelligence and Neuroscience,2015,2015(1):1-17. ［23］Tang Maolin,Pan Shenchen.A Hybrid Genetic Algorithm for the Energy-efficient Virtual Machine Placement Problem in Data Centers［J］.Neural Processing Letters,2015,41(2):211-221. ［24］Jang JaeWan,Jeon M,Kim H S,et al.Energy Reduction in Consolidated Servers Through Memory-aware Virtual Machine Scheduling［J］.IEEE Transactions on Computers,2011,60(4):552-564. ［25］Pahlavan A,Momtazpour M,Goudarzi M.Power Reduction in HPC Data Centers:A Joint Server Placement and Chassis Consolidation Approach［J］.The Journal of Super Computing,2014,70(2):845-879. ［26］Gao Yongqiang,Guan Haibing,Qi Zhengwei,et al.Quality of Service Aware Power Management for Virtualized Data Centers［J］.Journal of Systems Archi-tecture,2013,59(4):245-259. ［27］Chen Huangke,Zhua Xiaomin,Guo Hui,et al.Towards Energy-efficient Scheduling for Real-time Tasks Underuncertain Cloud Computing Environment［J］.Journal of Systems and Software,2015,99(1):20-35. ［28］Tziritas N,Xu Chengzhong,Loukopoulos T,et al.Application-aware Workload Consolidation to Minimize Both Energy Consumption and Network Load in Cloud Environments［C］//Proceedings of the 42nd International Conference on Parallel Processing.Washington D.C.,USA:IEEE Press,2013:449-457. ［29］Ferdaus M H,Murshed M,Calheiros R N,et al.Virtual Machine Consolidation in Cloud Data Centers Using ACO Metaheuristic［C］//Proceedings of European Conference on Parallel Processing.Berlin,Germany:Springer,2014:306-317. ［30］Ye Kejiang,Wu Zhaohui,Wang Chen,et al.Profiling-based Workload Consolidation and Migration in Virtualized Data Centers［J］.IEEE Transactions on Parallel and Distributed Systems,2015,26(3):878-890. ［31］Sun Rao,Thilagam P S.Heuristics Based Server Consolidation with Residual Resource Defragmentation in Cloud Data Centers［J］.Future Generation Computer Systems,2015,50(1):87-98. ［32］GargS K,Toosi A N,Gopalaiyengar S K,et al.SLA-based Virtual Machine Management for Heterogeneous Workloads in a Cloud Datacenter［J］.Journal of Network and Computer Applications,2014,45(1):108-120. ［33］Ferreto T,Cesar A F,Rose D,et al.Maximum Migration Time Guarantees in Dynamic Server Con-solidation for Virtualized Data Centers［C］//Pro-ceedings of European Conference on Parallel Processing.Berlin,Germany:Springer,2011:443-454. ［34］Zaman S,Grosu D.A Combinatorial Auction-based Mechanism for Dynamic VM Provisioning and Allocation in Clouds［J］.IEEE Transactions on Cloud Computing,2013,1(2):129-141. ［35］Sharifi M,Salimi H,Najafzadeh M.Power-efficient Distributed Scheduling of Virtual Machines Using Workload-aware Consolidation Techniques［J］.Journal of Supercomput,2012,61(1):46-66. ［36］Wolke A,Tsend-Ayush B,Pfeiffer C,et al.More Than Bin Packing:Dynamic Resource Allocation Strategies in Cloud Datacenters［J］.Information Systems,2015,52(8):83-95. ［37］Velasco L,Asensio A,Berral J L,et al.Elastic Operations in Federated Datacenters for Performance and Cost Optimization［J］.Computer Communications,2014,50(9):142-151. ［38］陈玲,陈冬林,桂雁军,等.用户利益最大化的云计算联盟资源调度［J］.武汉理工大学学报:信息与管理工程版,2014,36(3):369-373. ［39］Sansottera A,Cremonesi P.Cooling-aware Workload Placement with Performance Constraints［J］.Performance Evaluation,2011,68(11):1232-1246. ［40］Yanagisawa H,Osogami T,Raymond R.Dependable Virtual Machine Allocation［C］//Proceedings of the 32th IEEE International Conference on Computer Communications.Washington D.C.,USA:IEEE Press,2013:629-637. ［41］Zhang Peng,Wang Hongbo,Li Junbo,et al.Smart Shuffle:Managing Online Virtual Machine Shuffle in Virtualized Data Centers［C］//Proceedings of the 33rd International Conference on Distributed Computing Systems Workshops.Washington D.C.,USA:IEEE Press,2013:113-118. ［42］Dong Jiankang,Wang Hongbo,Jin Xing,et al.Virtual Machine Placement for Improving Energy Efficiency and Network Performance in IaaS Cloud［C］//Proceedings of the 33rd International Conference on Distributed Computing Systems Workshops.Washington D.C.,USA:IEEE Press,2013:238-243. ［43］Tso F P,Oikonomou K,Kavvadia E,et al.Scalable Traffic-aware Virtual Machine Management for Cloud Data Centers［C］//Proceedings of ICDCS’14.Washington D.C.,USA:IEEE Press,2014:238-247. ［44］Xu Fei,Liu Fangming,Liu Linghui,et al.Aware:Making Live Migration of Virtual Machines Interference-aware in the Cloud［J］.IEEE Transactions on Computers,2014,63(12):3012-3025. ［45］付波.基于OpenStack的云平台构建与调度方案研究［D］.北京:北京交通大学,2014. ［46］苗壮.基于CloudStack的IaaS资源调度策略研究［D］.哈尔滨:哈尔滨工业大学,2014. ［47］Gupta A,Milojicic D,Balle S M.HPC-aware VM Placement in Infrastructure Clouds［C］//Proceedings of IC2E’13.Washington D.C.,USA:IEEE Press,2013:11-20. ［48］Nguyen K K,Cheriet M.Environment-aware Virtual Slice Provisioning in Green Cloud Environment［J］.IEEE Transactions on Services Computing,2015,8(3):507-519. ［49］Breitgand D,Epstein A.Improving Consolidation of Virtual Machines with Risk-aware Bandwidth over Subscription in Compute Clouds［C］//Proceedings of INFOCOM’12.Washington D.C.,USA:IEEE Press,2012:2861-2865. ［50］Perumal V,Subbiah S.Power-conservative Server Conso-lidation Based Resource Management in Cloud［J］.International Journal of Network Management,2014,24(6):415-432. ［51］Lu Lei,Zhang Hui,Smirni E,et al.Predictive VM Consoli-dation on Multiple Resources:Beyond Load Balancing［C］//Proceedings of IWQoS’13.Washington D.C.,USA:IEEE Press,2013:1-10. ［52］Gao Yongqiang,Guan Haibing,Qi Zhengwei,et al.A Multi-objective Ant Colony System Algorithm for Virtual Machine Placement in Cloud Computing［J］.Journal of Computer and System Sciences,2013,79(8):1230-1242. ［53］裴养,吴杰,王鑫.基于粒子群优化算法的虚拟机放置策略［J］.计算机工程,2012,38(8):291-293. ［54］姜建华,刘渝,王丽敏,等.数据云中基于启发式反向蜂群的虚拟机选择节能算法［J］.吉林大学学报:理学版,2014,52(6):1239-1248. ［55］Luo Jianping,Li Xia,Chen Minrong.Hybrid Shuffled Frog Leaping Algorithm for Energy-efficient Dynamic Con-solidation of Virtual Machines in Cloud Data Centers［J］.Expert Systems with Applications,2014,41(13):5804-5816. ［56］Yang Jyun-Shiung,Liu Pangfeng,Wu Janjan.Workload Characteristics-aware Virtual Machine Consolida-tion Algorithms［C］//Proceedings of CloudCom’12.Washington D.C.,USA:IEEE Press,2012:42-49. ［57］Zhang Q,Zhani M F,Boutaba R,et al.Dynamic Hetero-geneity-aware Resource Provisioning in the Cloud［J］.IEEE Transactions on Cloud Computing,2014,2(1):221-231. ［58］温少君,陈俊杰,郭涛.一种云平台中优化的虚拟机部署机制［J］.计算机工程,2012,38(6):17-19. ［59］Gamage S,Kangarlou A,Rao R,et al.Protocol Responsibility Offloading to Improve TCP Throughput in Virtualized Environments［J］.ACM Transactions on Computer Systems,2013,31(3):7-15. ［60］Li Mingfu,Bi Jingping,Li Zhongcheng.Resource-sche-duling-waiting-aware Virtual Machine Consolidation［J］.Journal of Software,2014,25(7):1388-1402. ［61］Beloglazov A,Buyya R.Open Stack Neat:A Framework for Dynamic and Energy-efficient Consolidation of Virtual Machines in Open Stack Clouds［J］.Con-currency and Computation:Practice and Experience,2015,27(5):1310-1333. ［62］Calheiros R N,Ranjan R,Beloglazov A,et al.CloudSim:A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms［J］.Software:Practice and Experience,2011,41(1):23-50. ［63］Xen［EB/OL］.［2015-10-16］.http://www.citrix.com/. ［64］Openstack［EB/OL］.［2015-10-16］.http://www.openstack.org/. ［65］Cloudstack［EB/OL］.［2015-10-16］.http://cloudstack.apache.org/. ［66］Vmware［EB/OL］.［2015-10-16］.http://www.vmware.com/. ［67］Eucalyptus［EB/OL］.［2015-10-16］.http://eucalyptus.cs.ucsb.edu/. ［68］Mann Z A.Rigorous Results on the Effectiveness of Some Heuristics for the Consolidation of Virtual Machines in a Cloud Data Center［J］.Future Generation Computer Systems,2015,51(10):1-6. ［69］Ye Deshi,Chen Jianhai.Non-cooperative Games on Multidimensional Resource Allocation［J］.Future Gen-eration Computer Systems,2013,29(6):1345-1352. 编辑索书志

[1]	张冠莹, 伊鹏, 李丹, 朱棣, 毛明. 面向大规模网络的服务功能链部署方法[J]. 计算机工程, 2023, 49(8): 122-129.
[2]	刘志彬, 黄秋兰, 胡庆宝, 程耀东, 胡誉, 田浩来. Kubernetes异构资源细粒度调度策略的设计与实现[J]. 计算机工程, 2023, 49(2): 31-36,45.
[3]	臧迪, 杨志刚, 王晶, 姚治成, 张伟功. 基于网卡虚拟化的高性能容器网络设计[J]. 计算机工程, 2022, 48(7): 214-219.
[4]	奚智雯, 蔡晶晶, 阳文敏, 柴志雷. 基于微服务架构FPGA云平台的并发请求调度机制[J]. 计算机工程, 2022, 48(7): 206-213.
[5]	贺小伟, 徐靖杰, 王宾, 吴昊, 张博文. 基于GRU-LSTM组合模型的云计算资源负载预测研究[J]. 计算机工程, 2022, 48(5): 11-17,34.
[6]	张青青, 汤红波, 游伟, 普黎明. 基于演化博弈的NFV拟态防御架构动态调度策略[J]. 计算机工程, 2022, 48(4): 30-38,49.
[7]	刘雅丽, 史久根. 基于成本的服务链组成与部署联合优化策略[J]. 计算机工程, 2022, 48(4): 106-112.
[8]	都繁杰, 李静, 郭志勇, 任颖文, 尹晓宇, 董小菱. 基于瓶颈感知的多级反馈队列Coflow调度机制[J]. 计算机工程, 2022, 48(10): 193-201,211.
[9]	赵季红, 张文娟, 乔琳琳, 张梦雪. 服务功能链中基于机器学习的QoE评估与预测[J]. 计算机工程, 2022, 48(1): 163-169.
[10]	赵宇峰, 雷晟, 张国钢, 耿英三. 基于容器技术的电力设备仿真云平台设计与开发[J]. 计算机工程, 2021, 47(9): 171-177,184.
[11]	左攀, 束永安. DCN中基于前馈神经网络的动态多路径负载均衡方法[J]. 计算机工程, 2021, 47(9): 113-119.
[12]	钱声攀, 于洋, 翟天一, 张徐东, 常彦博. 基于深度学习的主机负载在线预测模型研究[J]. 计算机工程, 2021, 47(9): 84-89.
[13]	施凌鹏, 朱征, 周俊松, 李鑫, 李静. 面向微服务架构的云系统负载均衡机制[J]. 计算机工程, 2021, 47(9): 44-50,58.
[14]	倪思源, 扈红超, 刘文彦, 梁浩. 基于轮换策略的异构云资源分配算法[J]. 计算机工程, 2021, 47(6): 44-51,67.
[15]	潘成胜, 梁芷铭, 石怀峰, 孔志翔. 面向并发业务的卫星网络服务功能链优化算法[J]. 计算机工程, 2021, 47(3): 196-201.

选择文件类型/文献管理软件名称

选择包含的内容