High Precision Program Log Paring Technology  Based on Static Analysis

doi:10.3969/j.issn.1000-3428.2013.10.014

Abstract

Abstract: Aiming at the problem of low precision in the state of program log parsing technology, a new log parsing technology is proposed. This approach conducts interprocedural method analysis on the abstract syntax tree of the program, while applying Java string analyzer for intraprocedural data flow analysis. The work combines the results and builds an automaton for each log point to do the mapping against the console log. Experimental result shows that compared with existing technology, the new approach significantly improves the precision of log parsing.

Key words: console log, log parsing, static analysis, abstract syntax tree, string analysis, automaton

摘要： 针对现有的程序日志解析技术准确率较低的问题，提出一种新的日志解析技术。该技术结合过程间和过程内程序分析，在程序的抽象语法树上进行过程间的方法调用分析，同时利用Java字符串分析技术进行过程内的数据流分析，将两者结合为程序源代码中的日志点构造自动机，并以自动机来匹配程序日志。实验结果表明，与现有的日志解析技术相比，该方法能够明显提高日志解析的精度。

关键词: 控制台日志, 日志解析, 静态分析, 抽象语法树, 字符串分析, 自动机

CLC Number:

TP311

FAN Jing, ZHANG Cheng. High Precision Program Log Paring Technology Based on Static Analysis[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2013.10.014.

范惊，章程. 基于静态分析的高精度程序日志解析技术[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2013.10.014.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2013.10.014

http://www.ecice06.com/EN/Y2013/V39/I10/68

References

参考文献 [1] Xu Wei, Huang Ling, Fox A, et al. Detecting Large-scale System Problems by Mining Console Logs[C]//Proceedings of the 22nd ACM SIGOPS Symposium on Operating Systems Principles. New York, USA: ACM Press, 2009: 117-132. [2] Yuan Ding, Mai Haohui, Xiong Weiwei, et al. Sherlog: Error Diagnosis by Connecting Clues from Run-time Logs[C]// Proceedings of the 15th Architectural Support for Programming Languages and Operating Systems. New York, USA: ACM Press, 2010: 143-154. (下转第75页) (上接第71页) [3] Yuan Ding, Zheng Jing, Park S, et al. Improving Software Diagnosability via Log Enhancement[C]//Proceedings of the 16th International Conference on Architectural Support for Programming Languages and Operating Systems. New York, USA: ACM Press, 2011: 3-14. [4] Beschastnikh I, Brun Y, Schneider S. Leveraging Existing Instrumentation to Automatically Infer Invariant-constrained Models[C]//Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering. New York, USA: ACM Press, 2011: 267-277. [5] 张俊峰, 冯巧娟, 张晓丽. 基于文本策略和SMCS的海量日志分析方法[J]. 计算机工程, 2012, 38(3): 43-45. [6] 阳小兰, 钱程, 赵海廷. Web日志分析系统研究[J]. 计算机技术与发展, 2011, 21(9): 211-215. [7] Christensen A S, Moller A, Michael I. Precise Analysis of String Expressions[C]//Proceedings of the 10th International Conference on Static Analysis. Berlin, Germany: Springer- Verlag, 2003: 1-18. [8] Feldthaus A, Moller A. The Big Manual for the Java String Analyzer[M]. [S. 1.]: Aarhus University Press, 2009. [9] Vallee-Rai R, Hendren L, Sundaresan V, et al. Soot: A Java Optimization Framework[C]//Proceedings of ICAS’99. [S. 1.]: IBM Press, 1999. [10] Blackburn S M, Garner R, Hoffmann C, et al. The DaCapo Benchmarks: Java Benchmarking Development and Analysis[C]// Proceedings of the 21st Annual ACM SIGPLAN Conference on Object-oriented Programing, Systems, Languages, and Applications. Portland, USA: ACM Press, 2006: 169-190. 编辑索书志

[1]	LIU Jinshuo, HUANG Shuo, DENG Juan. Automatic Two-level Parallel Translation Method for PMVS Algorithm [J]. Computer Engineering, 2022, 48(12): 16-23.
[2]	HUANG Xiaowei, FAN Guisheng, YU Huiqun, YANG Xingguang. Software Defect Prediction via Heavy Son Node-based Abstract Syntax Tree [J]. Computer Engineering, 2021, 47(12): 230-235,248.
[3]	LI Feng, SHU Fei, LI Mingxuan, WANG Bin, YANG Huiting. Detection of Remote Access Trojan in Linux Based on Deep Learning [J]. Computer Engineering, 2020, 46(7): 159-164.
[4]	XU Shaofeng, PAN Wentao, XIONG Yun, ZHU Yangyong. Code Annotation Automatic Generation Based on Structure Aware Dual Encoder [J]. Computer Engineering, 2020, 46(2): 304-308,314.
[5]	WANG Xiang,LU Yuhai,MA Wei,LIU Yanbing. A Regular Expression Matching Method for DFA State Explosion [J]. Computer Engineering, 2019, 45(4): 148-156.
[6]	MA Futian,QIAN Xuezhong,SONG Wei. An Automated Cross-site Scripting Loopholes Discovery Model [J]. Computer Engineering, 2018, 44(8): 167-173.
[7]	FENG Huanhuan,DENG Jianhua. Numerical Simulation of Exhaust Emission Regularity Coupled with Cellular Automaton [J]. Computer Engineering, 2018, 44(6): 311-315.
[8]	XIE Jiayun,FU Xiao,LUO Bin. Research Progress of Android Protection Technology [J]. Computer Engineering, 2018, 44(2): 163-170,176.
[9]	WANG Xiuchao,MIAO Weikai,WANG Yisong,BAO Danzhu,YANG Jing. A Requirements Analysis Method for On-board Train Control Software [J]. Computer Engineering, 2017, 43(7): 48-53.
[10]	MAO Qianren,WANG Chaobin,BAO Xiao’an,LI Yanmei. Research on Guidance Mechanism of Internet Public Opinion Based on Cellular Automaton Model [J]. Computer Engineering, 2017, 43(6): 105-110,117.
[11]	SUN He,WU Lifa,HONG Zheng,YAN Huiying,ZHANG Yafeng. A Function Call Graph Extraction Method Combining Static and Dynamic Analysis [J]. Computer Engineering, 2017, 43(3): 154-162.
[12]	XIAO Kejun,YU Haibo,CHEN Yuting,ZHONG Hao. Seeker:Flow-sensitive Demand-driven Points-to Analysis [J]. Computer Engineering, 2016, 42(11): 70-75.
[13]	WU Tong,CHEN Yu-ting. JavaScript Code Recommendation Based on Dynamic Analysis [J]. Computer Engineering, 2014, 40(10): 66-70.
[14]	JI Ming-yu, WANG Hai-tao, CHEN Zhi-yuan. Verification Method of Probabilistic Computation Tree Logic Based on Automaton [J]. Computer Engineering, 2013, 39(12): 285-289.
[15]	SHU Chang-Qing, ZHANG Bei. Effect of Lane Changing Probability on Two-dimensional Cellular Automaton Traffic Flow [J]. Computer Engineering, 2012, 38(22): 137-140.

Please choose a citation manager

Content to export