面向微服务架构的云系统负载均衡机制

doi:10.19678/j.issn.1000-3428.0058747

计算机工程 ›› 2021, Vol. 47 ›› Issue (9): 44-50,58. doi: 10.19678/j.issn.1000-3428.0058747

面向微服务架构的云系统负载均衡机制

施凌鹏¹, 朱征², 周俊松³, 李鑫³, 李静³

1. 国网上海市电力公司信息通信公司, 上海 200072;
2. 国网上海市电力公司电力科学研究院, 上海 200437;
3. 南京航空航天大学计算机科学与技术学院, 南京 210023

收稿日期:2020-06-24 修回日期:2020-08-26 发布日期:2020-09-27
作者简介:施凌鹏(1974-),男,高级工程师、硕士,主研方向为信息通信技术;朱征,工程师;周俊松,硕士研究生;李鑫、李静,副教授。
基金资助:
国家电网有限公司科技项目“云环境下的容灾备份恢复与业务连续性管理关键技术研究与示范应用”（SGSHXT00JFJS1900093）。

Load Balancing Mechanism for Microservice Architecture in Cloud-based Systems

SHI Lingpeng¹, ZHU Zheng², ZHOU Junsong³, LI Xin³, LI Jing³

1. Information and Communication Company, State Grid Shanghai Electric Power Company, Shanghai 200072, China;
2. Electric Power Research Institute, State Grid Shanghai Electric Power Company, Shanghai 200437, China;
3. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 210023, China

Received:2020-06-24 Revised:2020-08-26 Published:2020-09-27

摘要/Abstract

摘要： 针对微服务架构的请求响应延迟上升问题，提出一种微服务链感知的请求负载均衡算法。从负载均衡器入手，将微服务链上的平均请求延迟和主机负载情况作为衡量指标，形式化微服务环境和请求延迟，在此基础上研究微服务链调用中存在的共享微服务竞争问题。模拟实验结果表明，与RR算法相比，该算法在复杂的微服务链环境下能够有效降低请求延迟，且在实例分布不均匀的环境中保持较好的负载性能，均衡不同主机之间的负载。在更接近真实应用环境的高频请求测试中，算法能有效降低系统的综合响应时间。

关键词: 微服务架构, 云计算, 负载均衡, 微服务链, 容器化平台

Abstract: In order to solve the rising delay in responding to requests in Microservices Architecture(MSA), a load balancing algorithm for requests is proposed based on microservice chain awareness.To formalize the request delay and microservice environment, the algorithm takes the average request delay and the host loads as the evaluation indicators. On this basis, the competition for shared microservices in microservice chain calling is studied.The simulation results show that compared with the RR algorithm, the proposed algorithm can significantly reduce the delay in requests in complex microservice chain environment.In addition, it keeps excellent loading performance in an environment with unevenly distributed instances, and balances the loads of different hosts.In the more realistic tests of high-frequency requests, the proposed algorithm can significantly reduce the overall response time of the system.

Key words: Microservices Architecure(MSA), cloud computing, load balancing, microservice chain, container platform

中图分类号:

TP391

施凌鹏, 朱征, 周俊松, 李鑫, 李静. 面向微服务架构的云系统负载均衡机制[J]. 计算机工程, 2021, 47(9): 44-50,58.

SHI Lingpeng, ZHU Zheng, ZHOU Junsong, LI Xin, LI Jing. Load Balancing Mechanism for Microservice Architecture in Cloud-based Systems[J]. Computer Engineering, 2021, 47(9): 44-50,58.

https://www.ecice06.com/CN/Y2021/V47/I9/44

图/表 15

20210917185604

20210917185608

20210917185612

20210917185616

20210917185619

20210917185623

20210917185626

20210917185630

20210917185633

20210917185637

20210917185641

20210917185645

20210917185649

20210917185653

20210917185656

参考文献

[1] THONES J.Microservices[J].IEEE Software, 2015, 32(1):116-126.
[2] HASSELBRING W, STEINACKER G.Microservice architectures for scalability, agility and reliability in e-commerce[C]//Proceedings of IEEE International Conference on Software Architecture.Washington D.C., USA:IEEE Press, 2017:243-246.
[3] FOWLER M, LEWIS J.Microservices[EB/OL].(2014-03-25).[2020-05-20].http://martinfowler.com/arti-cles/microservices.html.
[4] ZIMMERMANN O.Microservices tenets[J].Computer Science-Research and Development, 2017, 32(3/4):301-310.
[5] 毕小红, 刘渊, 陈飞.微服务应用平台的网络性能研究与优化[J].计算机工程, 2018, 44(5):53-59. BI X H, LIU Y, CHEN F.Research and optimization of network performance for micro-service application platform[J].Computer Engineering, 2018, 44(5):53-59.(in Chinese)
[6] NWEMAN S.Building microservices[M].[S.1.]:O'Reilly Media, Inc., 2015.
[7] JIANG S H, KIM T Y.The study of genetic algorithm-based task scheduling for cloud computing[J].International Journal of Control and Automation, 2012, 5(4):157-162.
[8] FERRIS J M.Load balancing in cloud-based networks[S].USA Patent:8, 849, 971, 2014-11-30.
[9] 郑俊褒, 沈林强.基于服务网格的微服务架构服务治理研究[J].计算机系统应用, 2019, 28(2):55-61. ZHENG J B, SHEN L Q.Research on service governance of microservice architecture based on service mesh[J] Computer Systems and Applications, 2019, 28(2):55-61.(in Chinese)
[10] BRONDOLIN R, FERRONI M, SANTAMBROGIO M.Performance-aware load shedding for monitoring events in container based environments[C]//Proceedings of ACM SIGBEDʼ19.New York, USA:ACM Press, 2019:27-32.
[11] LLOYD W.Serverless computing:an investigation of factors influencing microservice performance[C]//Proceedings of IEEE International Conference on Cloud Engineering.Washington D.C., USA:IEEE Press, 2018:159-169.
[12] JINDAL A, PODOLSKIY V, GERNDT M.Performance modeling for cloud microservice applications[C]//Proceedings of ACM/SPEC International Conference on Performance Engineering.New York, USA:ACM Press, 2019:25-32.
[13] NIU Y P, LIU F M, LI Z P.Load balancing across microservices[C]//Proceedings of IEEE International Conference on Computer Communications.Washington D.C., USA:IEEE Press, 2018:198-206.
[14] FAZIO M.Open issues in scheduling microservices in the cloud[J].IEEE Cloud Computing, 2016, 3(5):81-88.
[15] MA W J, LIU Y, TANG X G.A dynamic programming approach for optimal signal priority control upon multiple high-frequency bus requests[J].Journal of Intelligent Transportation Systems, 2013, 17(4):282-293.
[16] NIKOLAOS A, HJALMTYSSON G.System, method and apparatus for network service load and reliability management[S].USA Patent:6, 760, 775, 2004-06-06.
[17] BIRRELL A D, NELSON B J.Implementing remote procedure calls[J].ACM Transactions on Computer Systems, 1984, 2(1):39-59.
[18] DUSIA A, YANG Y, TAUFER M.Network quality of service in docker containers[C]//Proceedings of IEEE International Conference on Cluster Computing.Washington D.C., USA:IEEE Press, 2015:527-528.
[19] RAJKUMAR B, RAJIV R, CALHEIROS R N.Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit:challenges and opportunities[C]//Proceedings of International Conference on High Performance Computing & Simulation.Leipzig, Germany:[s.n.], 2009:1-11.
[20] VICTOR M.Adaptive application scheduling under interference in kubernetes[C]//Proceedings of the 9th IEEE/ACM International Conference on Utility and Cloud Computing.Washington D.C., USA:IEEE Press, 2016:426-427.

选择文件类型/文献管理软件名称

选择包含的内容

面向微服务架构的云系统负载均衡机制

Load Balancing Mechanism for Microservice Architecture in Cloud-based Systems

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 15

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	孙毅, 王会梅, 鲜明, 向航. Kubeflow异构算力调度策略研究[J]. 计算机工程, 2024, 50(2): 25-32.
[2]	李浩阳, 贺小伟, 王宾, 吴昊, 尤琪. 基于改进Informer的云计算资源负载预测[J]. 计算机工程, 2024, 50(2): 43-50.
[3]	彭世明, 林士飏, 贾硕, 杨苗会. 基于负载预测的多目标优化任务卸载策略[J]. 计算机工程, 2024, 50(1): 206-215.
[4]	刘向举, 赵犇, 方贤进, 徐杨洋. SDN中基于过程优化的动态负载均衡策略[J]. 计算机工程, 2023, 49(8): 137-145.
[5]	刘志彬, 黄秋兰, 胡庆宝, 程耀东, 胡誉, 田浩来. Kubernetes异构资源细粒度调度策略的设计与实现[J]. 计算机工程, 2023, 49(2): 31-36,45.
[6]	王恩旭, 王晓红, 张坤, 张冬雯. 基于双重注意力机制的云计算负载预测模型[J]. 计算机工程, 2023, 49(11): 40-48, 69.
[7]	奚智雯, 蔡晶晶, 阳文敏, 柴志雷. 基于微服务架构FPGA云平台的并发请求调度机制[J]. 计算机工程, 2022, 48(7): 206-213.
[8]	贺小伟, 徐靖杰, 王宾, 吴昊, 张博文. 基于GRU-LSTM组合模型的云计算资源负载预测研究[J]. 计算机工程, 2022, 48(5): 11-17,34.
[9]	王奎宇, 宋晓勤, 缪娟娟, 张昕婷, 雷磊. 基于SDN的高性能QoS保障低轨道卫星星间路由算法[J]. 计算机工程, 2022, 48(5): 185-190,199.
[10]	贺鹏飞, 范鹏飞, 尹千慧, 王中训, 张桐敬, 梁大伟. 基于负载均衡算法的Hyperledger Fabric共识机制研究[J]. 计算机工程, 2022, 48(11): 170-176.
[11]	李亚朋, 庞建民, 徐金龙, 聂凯. 一种针对线性循环结构的非线性静态调度策略[J]. 计算机工程, 2022, 48(1): 155-162.
[12]	左攀, 束永安. DCN中基于前馈神经网络的动态多路径负载均衡方法[J]. 计算机工程, 2021, 47(9): 113-119.
[13]	赵宇峰, 雷晟, 张国钢, 耿英三. 基于容器技术的电力设备仿真云平台设计与开发[J]. 计算机工程, 2021, 47(9): 171-177,184.
[14]	杨海竹, 孙长印, 吴维超, 徐文军. 毫米波微波网络基于匹配算法的小区关联方法[J]. 计算机工程, 2021, 47(8): 210-215,223.
[15]	曹志鹏, 刘勤让, 刘冬培, 张霞. 面向时间敏感网络的流量调度方法[J]. 计算机工程, 2021, 47(7): 168-175,182.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

面向微服务架构的云系统负载均衡机制

Load Balancing Mechanism for Microservice Architecture in Cloud-based Systems

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 15

参考文献

相关文章 15

编辑推荐

Metrics

本文评价