Improvement of the Log Pattern Extracting Algorithm Using Text Similarity
2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)(2018)
摘要
Log processing and analysis are key jobs that can obtain information about system status and alerts, and log classification is the fundamental step. We have previously proposed the LARGE system and the algorithm of log pattern extraction to transfer system logs into a set of log pattern to help system maintainers find messages hidden in logs. But the proposed algorithm has the limitation that it cannot deal with log length differences. In this paper we will introduce the way of improving log pattern extracting algorithm by involving the idea of text similarity. Experiment results prove that the new algorithm shows obvious improvement than the original one. We also illustrate a modified log comparing model that fits real time log processing systems.
更多查看译文
关键词
log processing,big data analysis,text similarity,high-performance computing environment
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络