一种在线实时微服务调用链异常检测方法

doi:10.19678/j.issn.1000-3428.0063817

计算机工程 ›› 2022, Vol. 48 ›› Issue (11): 161-169. doi: 10.19678/j.issn.1000-3428.0063817

一种在线实时微服务调用链异常检测方法

张攀¹, 高丰², 周逸¹, 饶涵宇³, 毛冬³, 李静²

1. 国家电网有限公司信息通信分公司, 北京 100031;
2. 南京航空航天大学计算机科学与技术学院, 南京 211106;
3. 国网浙江省电力有限公司信息通信分公司, 杭州 310016

收稿日期:2022-01-23 修回日期:2022-04-24 发布日期:2022-06-29
作者简介:张攀(1989—),男,高级工程师、博士,主研方向为电力信息通信;高丰,硕士研究生;周逸,硕士;饶涵宇、毛冬,工程师、硕士;李静(通信作者),副教授、博士。
基金资助:
国家电网有限公司科技项目“业务应用改造上云与全链路运行分析技术研究”（5700-202152169A-0-0-00）。

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

ZHANG Pan¹, GAO Feng², ZHOU Yi¹, RAO Hanyu³, MAO Dong³, LI Jing²

1. State Grid Information & Telecommunication Branch, Beijing 100031, China;
2. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;
3. Information & Telecommunication Branch, State Grid Zhejiang Electric Power Co., Ltd., Hangzhou 310016, China

Received:2022-01-23 Revised:2022-04-24 Published:2022-06-29

摘要/Abstract

摘要： 微服务架构逐渐成为大规模云应用的主流设计架构，微服务可靠性是云服务商亟须处理的关键问题。精确检测并定位微服务应用故障可有效保障应用的可靠性与稳定性，基于微服务调用链的异常检测可在系统发生故障时及时发现系统异常行为并触发告警。针对当前主流检测方法无法保证异常告警的实时性和准确性问题，提出一种基于自然语言处理与双向长短期记忆（BiLSTM）网络的微服务调用链异常检测方法MicroTrace。对调用链中记录的事件进行解析，将事件表示为语义序列与响应时间序列，利用词汇嵌入式表示算法提取事件的向量化表示，通过基于注意力机制的BiLSTM同时检测微服务实例的调用路径与性能异常。在真实微服务调用链数据集上的实验结果表明，该方法的查准率和查全率均可达96%以上，F1度量值相比于多模态-LSTM方法至少提升了6.8%。

关键词: 微服务, 调用链, 深度学习, 异常检测, 数据挖掘

Abstract: The microservice architecture is gradually becoming the mainstream design architecture for large-scale cloud applications, and the reliability of systems based on microservices is a key issue that must be addressed by cloud service providers.Accurately and effectively detecting and locating the faults in microservice applications is crucial for ensuring the reliability and stability of applications.Anomalies in microservice call chains are detected to identify abnormal behaviors in the system in a timely manner and trigger an alarm when the system fails.However, the real-time performance of alarms indicating abnormal behaviors cannot be guaranteed by using current mainstream methods, which require the establishment of a knowledge base by augmenting data from the microservice call chain.Therefore, an anomaly detection method for microservice call chains based on natural language processing and a Bi-directional Long Short-Term Memory(BiLSTM) network is proposed herein.First, events are extracted into semantic sequences and response time sequences.Second, Word2vec is used to extract the vectorized representation of the event, detect the call path anomalies in call chains, and identify the performance anomalies of microservice instances caused by BiLSTM based on the attention mechanism.Finally, the proposed method is verified on an actual microservice call chain dataset.The experimental results show that the precision and recall of the proposed method can exceed 96% and that the detection accuracy improves by at least 6.8% compared with that of the Multimodal-LSTM method.

Key words: microservice, call chain, deep learning, anomaly detection, data mining

中图分类号:

TP391

张攀, 高丰, 周逸, 饶涵宇, 毛冬, 李静. 一种在线实时微服务调用链异常检测方法[J]. 计算机工程, 2022, 48(11): 161-169.

ZHANG Pan, GAO Feng, ZHOU Yi, RAO Hanyu, MAO Dong, LI Jing. An Online Real-Time Anomaly Detection Method for Microservice Call Chains[J]. Computer Engineering, 2022, 48(11): 161-169.

http://www.ecice06.com/CN/Y2022/V48/I11/161

图/表 10

20230221174714

20230221174718

20230221174721

20230221174724

20230221174727

20230221174731

20230221174734

20230221174738

20230221174742

20230221174745

参考文献

[1] KRATZKE N, QUINT P C.Understanding cloud-native applications after 10 years of cloud computing-a systematic mapping study[J].Journal of Systems and Software, 2017, 126:1-16.
[2] 施凌鹏, 朱征, 周俊松, 等.面向微服务架构的云系统负载均衡机制[J].计算机工程, 2021, 47(9):44-50, 58. SHI L P, ZHU Z, ZHOU J S, et al.Load balancing mechanism for microservice architecture in cloud-based systems[J].Computer Engineering, 2021, 47(9):44-50, 58.(in Chinese)
[3] DMITRY N, MANFRED S S.On micro-services architecture[J].International Journal of Open Information Technologies, 2014, 2(9):24-27.
[4] SOLDANI J, TAMBURRI D A, VAN DEN HEUVEL W J.The pains and gains of microservices:a systematic grey literature review[J].Journal of Systems and Software, 2018, 146:215-232.
[5] SOLDANI J, BROGI A.Anomaly detection and failure root cause analysis in (micro) service-based cloud applications:a survey[J].ACM Computing Surveys, 2023, 55(3):59.
[6] WENG J P, WANG J H, YANG J H, et al.Root cause analysis of anomalies of multitier services in public clouds[J].IEEE/ACM Transactions on Networking, 2018, 26(4):1646-1659.
[7] KIM M, SUMBALY R, SHAH S.Root cause detection in a service-oriented architecture[J].ACM SIGMETRICS Performance Evaluation Review, 2013, 41(1):93-104.
[8] LIU P, XU H W, OUYANG Q Y, et al.Unsupervised detection of microservice trace anomalies through service-level deep Bayesian networks[C]//Proceedings of the 31st International Symposium on Software Reliability Engineering.Washington D.C., USA:IEEE Press, 2020:48-58.
[9] XU H W, CHEN W X, ZHAO N W, et al.Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in Web applications[C]//Proceedings of 2018 World Wide Web Conference.Washington D.C., USA:IEEE Press, 2018:187-196.
[10] DU M, LI F F, ZHENG G N, et al.DeepLog:anomaly detection and diagnosis from system logs through deep learning[C]//Proceedings of 2017 ACM SIGSAC Conference on Computer and Communications Security.New York, USA:ACM Press, 2017:1285-1298.
[11] SIGELMAN B, BARROSO L, BURROWS M, et al.Dapper, a large-scale distributed systems tracing infrastructure[EB/OL].[2021-12-05].https://www.researchgate.net/publication/239595848_Dapper_a_Large-Scale_Distributed_Systems_Tracing_Infrastructure.
[12] MENG L, JI F, SUN Y, et al.Detecting anomalies in microservices with execution trace comparison[J].Future Generation Computer Systems, 2021, 116:291-301.
[13] JIN M X, LÜ A R, ZHU Y P, et al.An anomaly detection algorithm for microservice architecture based on robust principal component analysis[J].IEEE Access, 2020, 8:226397-226408.
[14] ZHOU X, PENG X, XIE T, et al.Latent error prediction and fault localization for microservice applications by learning from system trace logs[C]//Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering.New York, USA:ACM Press, 2019:683-694.
[15] WANG T, ZHANG W B, XU J W, et al.Workflow-aware automatic fault diagnosis for microservice-based applications with statistics[J].IEEE Transactions on Network and Service Management, 2020, 17(4):2350-2363.
[16] BOGATINOVSKI J, NEDELKOSKI S.Multi-source anomaly detection in distributed it systems[C]//Proceedings of International Conference on Service-Oriented Computing.Berlin, Germany:Springer, 2020:201-213.
[17] ZUO Y, WU Y L, MIN G Y, et al.An intelligent anomaly detection scheme for micro-services architectures with temporal and spatial data analysis[J].IEEE Transactions on Cognitive Communications and Networking, 2020, 6(2):548-561.
[18] MENG W, LIU Y, ZHU Y, et al.LogAnomaly:unsupervised detection of sequential and quantitative anomalies in unstructured logs[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.New York, USA:ACM Press, 2019:4739-4745.
[19] ZHANG X, XU Y, LIN Q W, et al.Robust log-based anomaly detection on unstable log data[C]//Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering.New York, USA:ACM Press, 2019:807-817.
[20] YANG L, CHEN J J, WANG Z, et al.PLELog:semi-supervised log-based anomaly detection via probabilistic label estimation[C]//Proceedings of the 43rd International Conference on Software Engineering.Washington D.C., USA:IEEE Press, 2021:230-231.
[21] REIS D C, GOLGHER P B, SILVA A S, et al.Automatic Web news extraction using tree edit distance[C]//Proceedings of the 13th International Conference on World Wide Web.Washington D.C., USA:IEEE Press, 2004:502-511.
[22] CHEN H Y, CHEN P F, YU G B.A framework of virtual war room and matrix sketch-based streaming anomaly detection for microservice systems[J].IEEE Access, 2020, 8:43413-43426.
[23] NEDELKOSKI S, CARDOSO J, KAO O.Anomaly detection and classification using distributed tracing and deep learning[C]//Proceedings of the 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.Washington D.C., USA:IEEE Press, 2019:241-250.
[24] BOGATINOVSKI J, NEDELKOSKI S, CARDOSO J, et al.Self-supervised anomaly detection from distributed traces[C]//Proceedings of IEEE/ACM 13th International Conference on Utility and Cloud Computing.Washington D.C., USA:IEEE Press, 2020:342-347.
[25] NEDELKOSKI S, CARDOSO J, KAO O.Anomaly detection from system tracing data using multimodal deep learning[C]//Proceedings of the 12th International Conference on Cloud Computing.Washington D.C., USA:IEEE Press, 2019:179-186.
[26] 喻靖民, 向凌云, 曾道建.基于Word2Vec的自然语言隐写分析方法[J].计算机工程, 2019, 45(3):309-314. YU J M, XIANG L Y, ZENG D J.Natural language steganalysis method based on Word2Vec[J].Computer Engineering, 2019, 45(3):309-314.(in Chinese)
[27] TIELEMAN T, HINTON G.Lecture 6.5-rmsprop:divide the gradient by a running average of its recent magnitude[J].Neural Networks for Machine Learning, 2012, 4(2):26-31.

选择文件类型/文献管理软件名称

选择包含的内容

一种在线实时微服务调用链异常检测方法

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	江雨燕, 陶承凤, 李平. 数据增强和自适应自步学习的深度子空间聚类算法[J]. 计算机工程, 2023, 49(8): 96-103, 110.
[2]	李泽水, 冀俊忠, 杨翠翠. 基于边权重信息深度网络嵌入的PPIN功能模块检测[J]. 计算机工程, 2023, 49(8): 69-76.
[3]	王可铮, 徐玉芬, 周尚波. 结合对比感知损失和融合注意力的图像去雾模型[J]. 计算机工程, 2023, 49(8): 207-214.
[4]	刘俊豪, 王美林, 谢兴, 宋烨兴, 许莉花. 基于改进YOLOv5的皮革瑕疵检测算法[J]. 计算机工程, 2023, 49(8): 240-249.
[5]	闫兴亚, 匡娅茜, 白光睿, 李月. 基于深度学习的学生课堂行为识别方法[J]. 计算机工程, 2023, 49(7): 251-258.
[6]	李军侠, 王星驰, 殷梓, 石德硕. 边缘深度挖掘的弱监督显著性目标检测[J]. 计算机工程, 2023, 49(7): 169-178.
[7]	吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程, 2023, 49(7): 179-188.
[8]	席建锐, 唐红梅, 梁春阳, 刘鑫. 基于改进隐函数的点云物体重建[J]. 计算机工程, 2023, 49(7): 214-222.
[9]	齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.
[10]	谌雨章, 黄逸姿, 张钧涵. 基于多速率空洞卷积的多尺度水下小目标检测[J]. 计算机工程, 2023, 49(6): 257-264.
[11]	张博旭, 蒲智, 程曦. 基于提示学习的维吾尔语文本分类研究[J]. 计算机工程, 2023, 49(6): 292-299,313.
[12]	于海洋, 景鹏, 张文涛, 谢赛飞, 滑志华, 宋草原. 基于残差与注意力机制的道路裂缝检测U-Net改进模型[J]. 计算机工程, 2023, 49(6): 265-273.
[13]	陈仲磊, 伊鹏, 陈祥, 胡涛. 基于集成学习的系统调用实时异常检测框架[J]. 计算机工程, 2023, 49(6): 162-169,179.
[14]	王爱玲, 马文臻, 邹自明, 钟佳. 基于领域自适应的卫星工程参数异常检测[J]. 计算机工程, 2023, 49(5): 29-37,47.
[15]	宋羽凯, 谢江. 基于多任务学习的轻量级语音情感识别模型[J]. 计算机工程, 2023, 49(5): 122-128.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

一种在线实时微服务调用链异常检测方法

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献

相关文章 15

编辑推荐

Metrics

本文评价