一种在线实时微服务调用链异常检测方法

doi:10.19678/j.issn.1000-3428.0063817

计算机工程 ›› 2022, Vol. 48 ›› Issue (11): 161-169. doi: 10.19678/j.issn.1000-3428.0063817

一种在线实时微服务调用链异常检测方法

张攀¹, 高丰², 周逸¹, 饶涵宇³, 毛冬³, 李静²

1. 国家电网有限公司信息通信分公司, 北京 100031;
2. 南京航空航天大学计算机科学与技术学院, 南京 211106;
3. 国网浙江省电力有限公司信息通信分公司, 杭州 310016

收稿日期:2022-01-23 修回日期:2022-04-24 发布日期:2022-06-29
作者简介:张攀(1989—),男,高级工程师、博士,主研方向为电力信息通信;高丰,硕士研究生;周逸,硕士;饶涵宇、毛冬,工程师、硕士;李静(通信作者),副教授、博士。
基金资助:
国家电网有限公司科技项目“业务应用改造上云与全链路运行分析技术研究”（5700-202152169A-0-0-00）。

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

ZHANG Pan¹, GAO Feng², ZHOU Yi¹, RAO Hanyu³, MAO Dong³, LI Jing²

1. State Grid Information & Telecommunication Branch, Beijing 100031, China;
2. College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;
3. Information & Telecommunication Branch, State Grid Zhejiang Electric Power Co., Ltd., Hangzhou 310016, China

Received:2022-01-23 Revised:2022-04-24 Published:2022-06-29

摘要/Abstract

摘要： 微服务架构逐渐成为大规模云应用的主流设计架构，微服务可靠性是云服务商亟须处理的关键问题。精确检测并定位微服务应用故障可有效保障应用的可靠性与稳定性，基于微服务调用链的异常检测可在系统发生故障时及时发现系统异常行为并触发告警。针对当前主流检测方法无法保证异常告警的实时性和准确性问题，提出一种基于自然语言处理与双向长短期记忆（BiLSTM）网络的微服务调用链异常检测方法MicroTrace。对调用链中记录的事件进行解析，将事件表示为语义序列与响应时间序列，利用词汇嵌入式表示算法提取事件的向量化表示，通过基于注意力机制的BiLSTM同时检测微服务实例的调用路径与性能异常。在真实微服务调用链数据集上的实验结果表明，该方法的查准率和查全率均可达96%以上，F1度量值相比于多模态-LSTM方法至少提升了6.8%。

关键词: 微服务, 调用链, 深度学习, 异常检测, 数据挖掘

Abstract: The microservice architecture is gradually becoming the mainstream design architecture for large-scale cloud applications, and the reliability of systems based on microservices is a key issue that must be addressed by cloud service providers.Accurately and effectively detecting and locating the faults in microservice applications is crucial for ensuring the reliability and stability of applications.Anomalies in microservice call chains are detected to identify abnormal behaviors in the system in a timely manner and trigger an alarm when the system fails.However, the real-time performance of alarms indicating abnormal behaviors cannot be guaranteed by using current mainstream methods, which require the establishment of a knowledge base by augmenting data from the microservice call chain.Therefore, an anomaly detection method for microservice call chains based on natural language processing and a Bi-directional Long Short-Term Memory(BiLSTM) network is proposed herein.First, events are extracted into semantic sequences and response time sequences.Second, Word2vec is used to extract the vectorized representation of the event, detect the call path anomalies in call chains, and identify the performance anomalies of microservice instances caused by BiLSTM based on the attention mechanism.Finally, the proposed method is verified on an actual microservice call chain dataset.The experimental results show that the precision and recall of the proposed method can exceed 96% and that the detection accuracy improves by at least 6.8% compared with that of the Multimodal-LSTM method.

Key words: microservice, call chain, deep learning, anomaly detection, data mining

中图分类号:

TP391

张攀, 高丰, 周逸, 饶涵宇, 毛冬, 李静. 一种在线实时微服务调用链异常检测方法[J]. 计算机工程, 2022, 48(11): 161-169.

ZHANG Pan, GAO Feng, ZHOU Yi, RAO Hanyu, MAO Dong, LI Jing. An Online Real-Time Anomaly Detection Method for Microservice Call Chains[J]. Computer Engineering, 2022, 48(11): 161-169.

https://www.ecice06.com/CN/Y2022/V48/I11/161

图/表 10

20230221174714

20230221174718

20230221174721

20230221174724

20230221174727

20230221174731

20230221174734

20230221174738

20230221174742

20230221174745

参考文献

[1] KRATZKE N, QUINT P C.Understanding cloud-native applications after 10 years of cloud computing-a systematic mapping study[J].Journal of Systems and Software, 2017, 126:1-16.
[2] 施凌鹏, 朱征, 周俊松, 等.面向微服务架构的云系统负载均衡机制[J].计算机工程, 2021, 47(9):44-50, 58. SHI L P, ZHU Z, ZHOU J S, et al.Load balancing mechanism for microservice architecture in cloud-based systems[J].Computer Engineering, 2021, 47(9):44-50, 58.(in Chinese)
[3] DMITRY N, MANFRED S S.On micro-services architecture[J].International Journal of Open Information Technologies, 2014, 2(9):24-27.
[4] SOLDANI J, TAMBURRI D A, VAN DEN HEUVEL W J.The pains and gains of microservices:a systematic grey literature review[J].Journal of Systems and Software, 2018, 146:215-232.
[5] SOLDANI J, BROGI A.Anomaly detection and failure root cause analysis in (micro) service-based cloud applications:a survey[J].ACM Computing Surveys, 2023, 55(3):59.
[6] WENG J P, WANG J H, YANG J H, et al.Root cause analysis of anomalies of multitier services in public clouds[J].IEEE/ACM Transactions on Networking, 2018, 26(4):1646-1659.
[7] KIM M, SUMBALY R, SHAH S.Root cause detection in a service-oriented architecture[J].ACM SIGMETRICS Performance Evaluation Review, 2013, 41(1):93-104.
[8] LIU P, XU H W, OUYANG Q Y, et al.Unsupervised detection of microservice trace anomalies through service-level deep Bayesian networks[C]//Proceedings of the 31st International Symposium on Software Reliability Engineering.Washington D.C., USA:IEEE Press, 2020:48-58.
[9] XU H W, CHEN W X, ZHAO N W, et al.Unsupervised anomaly detection via variational auto-encoder for seasonal KPIs in Web applications[C]//Proceedings of 2018 World Wide Web Conference.Washington D.C., USA:IEEE Press, 2018:187-196.
[10] DU M, LI F F, ZHENG G N, et al.DeepLog:anomaly detection and diagnosis from system logs through deep learning[C]//Proceedings of 2017 ACM SIGSAC Conference on Computer and Communications Security.New York, USA:ACM Press, 2017:1285-1298.
[11] SIGELMAN B, BARROSO L, BURROWS M, et al.Dapper, a large-scale distributed systems tracing infrastructure[EB/OL].[2021-12-05].https://www.researchgate.net/publication/239595848_Dapper_a_Large-Scale_Distributed_Systems_Tracing_Infrastructure.
[12] MENG L, JI F, SUN Y, et al.Detecting anomalies in microservices with execution trace comparison[J].Future Generation Computer Systems, 2021, 116:291-301.
[13] JIN M X, LÜ A R, ZHU Y P, et al.An anomaly detection algorithm for microservice architecture based on robust principal component analysis[J].IEEE Access, 2020, 8:226397-226408.
[14] ZHOU X, PENG X, XIE T, et al.Latent error prediction and fault localization for microservice applications by learning from system trace logs[C]//Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering.New York, USA:ACM Press, 2019:683-694.
[15] WANG T, ZHANG W B, XU J W, et al.Workflow-aware automatic fault diagnosis for microservice-based applications with statistics[J].IEEE Transactions on Network and Service Management, 2020, 17(4):2350-2363.
[16] BOGATINOVSKI J, NEDELKOSKI S.Multi-source anomaly detection in distributed it systems[C]//Proceedings of International Conference on Service-Oriented Computing.Berlin, Germany:Springer, 2020:201-213.
[17] ZUO Y, WU Y L, MIN G Y, et al.An intelligent anomaly detection scheme for micro-services architectures with temporal and spatial data analysis[J].IEEE Transactions on Cognitive Communications and Networking, 2020, 6(2):548-561.
[18] MENG W, LIU Y, ZHU Y, et al.LogAnomaly:unsupervised detection of sequential and quantitative anomalies in unstructured logs[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.New York, USA:ACM Press, 2019:4739-4745.
[19] ZHANG X, XU Y, LIN Q W, et al.Robust log-based anomaly detection on unstable log data[C]//Proceedings of the 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering.New York, USA:ACM Press, 2019:807-817.
[20] YANG L, CHEN J J, WANG Z, et al.PLELog:semi-supervised log-based anomaly detection via probabilistic label estimation[C]//Proceedings of the 43rd International Conference on Software Engineering.Washington D.C., USA:IEEE Press, 2021:230-231.
[21] REIS D C, GOLGHER P B, SILVA A S, et al.Automatic Web news extraction using tree edit distance[C]//Proceedings of the 13th International Conference on World Wide Web.Washington D.C., USA:IEEE Press, 2004:502-511.
[22] CHEN H Y, CHEN P F, YU G B.A framework of virtual war room and matrix sketch-based streaming anomaly detection for microservice systems[J].IEEE Access, 2020, 8:43413-43426.
[23] NEDELKOSKI S, CARDOSO J, KAO O.Anomaly detection and classification using distributed tracing and deep learning[C]//Proceedings of the 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.Washington D.C., USA:IEEE Press, 2019:241-250.
[24] BOGATINOVSKI J, NEDELKOSKI S, CARDOSO J, et al.Self-supervised anomaly detection from distributed traces[C]//Proceedings of IEEE/ACM 13th International Conference on Utility and Cloud Computing.Washington D.C., USA:IEEE Press, 2020:342-347.
[25] NEDELKOSKI S, CARDOSO J, KAO O.Anomaly detection from system tracing data using multimodal deep learning[C]//Proceedings of the 12th International Conference on Cloud Computing.Washington D.C., USA:IEEE Press, 2019:179-186.
[26] 喻靖民, 向凌云, 曾道建.基于Word2Vec的自然语言隐写分析方法[J].计算机工程, 2019, 45(3):309-314. YU J M, XIANG L Y, ZENG D J.Natural language steganalysis method based on Word2Vec[J].Computer Engineering, 2019, 45(3):309-314.(in Chinese)
[27] TIELEMAN T, HINTON G.Lecture 6.5-rmsprop:divide the gradient by a running average of its recent magnitude[J].Neural Networks for Machine Learning, 2012, 4(2):26-31.

选择文件类型/文献管理软件名称

选择包含的内容

一种在线实时微服务调用链异常检测方法

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	魏嵬, 丁香香, 郭梦星, 杨钊, 刘辉. 文本相似度计算方法综述[J]. 计算机工程, 2024, 50(9): 18-32.
[2]	朱凯, 李理, 张彤, 江晟, 别一鸣. 基于Transformer的多阶段运动模糊图像修复网络[J]. 计算机工程, 2024, 50(9): 276-285.
[3]	张天鹏, 韩晶, 吕学强. 基于多任务学习的超分辨率辅助小目标检测[J]. 计算机工程, 2024, 50(9): 304-312.
[4]	高煜宝, 文志诚. 基于注意力机制的双路解码器图像去噪方法[J]. 计算机工程, 2024, 50(9): 324-332.
[5]	张华青, 夏张涛, 陆晓庆, 童基均. 基于字形特征的血管外科命名实体识别[J]. 计算机工程, 2024, 50(8): 13-21.
[6]	张亚洲, 和玉, 戎璐, 王祥凯. 基于上下文知识增强型Transformer网络的抑郁检测[J]. 计算机工程, 2024, 50(8): 75-85.
[7]	高伟, 李帅龙, 茆琳, 王磊, 李颖颖, 韩林. 一种基于TVM的算子生成加速策略[J]. 计算机工程, 2024, 50(8): 353-362.
[8]	王宇, 祁琦, 王纯, 许才. 储能变流器信号高精度故障诊断方法[J]. 计算机工程, 2024, 50(8): 389-396.
[9]	周炫余, 吴莲华, 郑勤华, 肖天星, 王紫璇, 张思敏. 联合语义提示和记忆增强的弱监督跳绳视频异常检测方法[J]. 计算机工程, 2024, 50(7): 87-95.
[10]	牛瑞婷, 严天峰, 高锐, 王映植. 低信噪比下基于深度学习TCNN-MobileNet的调制识别[J]. 计算机工程, 2024, 50(7): 204-215.
[11]	肖慈, 徐杨, 张永丹, 冯明文, 黄易仟. 结合注意力和低光增强的夜间语义分割[J]. 计算机工程, 2024, 50(7): 271-281.
[12]	张诗婧, 莫绪涛, 赵行, 董杨林. 基于球面折反射成像和YOLOv7的内螺纹缺陷检测[J]. 计算机工程, 2024, 50(7): 282-292.
[13]	徐明亮, 李芳媛, 马浩然, 何飞. 大规模神经记录的峰电位聚类算法(特邀)[J]. 计算机工程, 2024, 50(6): 1-34.
[14]	魏琢艺, 罗迈, 李文兵, 曾远松, 余伟江, 杨跃东. 基于多源域适应的单细胞智能分类[J]. 计算机工程, 2024, 50(6): 48-55.
[15]	李子杰, 周菊香, 韩晓瑜, 甘健侯, 鹿泽光, 王俊. 序列特征与学习过程融合的知识追踪模型[J]. 计算机工程, 2024, 50(6): 77-85.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

一种在线实时微服务调用链异常检测方法

An Online Real-Time Anomaly Detection Method for Microservice Call Chains

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 10

参考文献

相关文章 15

编辑推荐

Metrics

本文评价