DivLog: Log Parsing with Prompt Enhanced In-Context Learning
METADATA ONLY
Loading...
Author / Producer
Date
2024
Publication Type
Conference Paper
ETH Bibliography
yes
METADATA ONLY
Data
Rights / License
Abstract
Log parsing, which involves log template extraction from semi-structured logs to produce structured logs, is the first and the most critical step in automated log analysis. However, current log parsers suffer from limited effectiveness for two reasons. First, traditional data-driven log parsers solely rely on heuristics or handcrafted features designed by domain experts, which may not consistently perform well on logs from diverse systems. Second, existing supervised log parsers require model tuning, which is often limited to fixed training samples and causes sub-optimal performance across the entire log source. To address this limitation, we propose DivLog, an effective log parsing framework based on the in-context learning (ICL) ability of large language models (LLMs). Specifically, before log parsing, DivLog samples a small amount of offline logs as candidates by maximizing their diversity. Then, during log parsing, DivLog selects five appropriate labeled candidates as examples for each target log and constructs them into a prompt. By mining the semantics of examples in the prompt, DivLog generates a target log template in a training-free manner. In addition, we design a straightforward yet effective prompt format to extract the output and enhance the quality of the generated log templates. We conducted experiments on 16 widely-used public datasets. The results show that DivLog achieves (1) 98.1% Parsing Accuracy, (2) 92.1% Precision Template Accuracy, and (3) 92.9% Recall Template Accuracy on average, exhibiting state-of-the-art performance.
Permanent link
Publication status
published
External links
Editor
Book title
ICSE '24: Proceedings of the IEEE/ACM 46th International Conference on Software Engineering
Journal / series
Volume
Pages / Article No.
2457 - 2468
Publisher
Association for Computing Machinery
Event
46th International Conference on Software Engineering (ICSE 2024)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Log Parsing; Large Language Model; In-Context Learning