Making Sense of Failure Logs in an Industrial DevOps EnvironmentShow others and affiliations
2023 (English)In: Advances in Intelligent Systems and Computing book series (AISC,volume 1445): 20th International Conference on Information Technology New Generations, Springer International Publishing , 2023, Vol. 1445, p. 217-226Conference paper, Published paper (Refereed)
Abstract [en]
Processing and reviewing nightly test execution failure logs for large industrial systems is a tedious activity. Furthermore, multiple failures might share one root/common cause during test execution sessions, and the review might therefore require redundant efforts. This paper presents the LogGrouper approach for automated grouping of failure logs to aid root/common cause analysis and for enabling the processing of each log group as a batch. LogGrouper uses state-of-art natural language processing and clustering approaches to achieve meaningful log grouping. The approach is evaluated in an industrial setting in both a qualitative and quantitative manner. Results show that LogGrouper produces good quality groupings in terms of our two evaluation metrics (Silhouette Coefficient and Calinski-Harabasz Index) for clustering quality. The qualitative evaluation shows that experts perceive the groups as useful, and the groups are seen as an initial pointer for root cause analysis and failure assignment.
Place, publisher, year, edition, pages
Springer International Publishing , 2023. Vol. 1445, p. 217-226
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:ri:diva-67432OAI: oai:DiVA.org:ri-67432DiVA, id: diva2:1800981
Conference
20th International Conference on Information Technology New Generations
2023-09-282023-09-282023-10-04Bibliographically approved