Context <p>Logging is a crucial practice in software engineering, aiding developers in debugging applications when errors occur. While existing research has explored logging challenges from an academic perspective through literature reviews and source code analysis, a comprehensive study from the practitioners’ perspective remains lacking.</p> Objective <p>This paper aims to bridge this knowledge gap by presenting an in-depth analysis of trends, topics, and challenges in logging based on a dataset of 216,094 posts from Stack Overflow (SO), a popular Q&amp;A platform for developers, and complemented by a practitioner survey to validate the industrial relevance and difficulty of the identified topics.</p> Method <p>We analyzed longitudinal trends by examining metadata related to users, questions, and tags associated with logging discussions. To identify prevalent discussion topics, we employed a Large Language Model (LLM)based classification approach, based on a manually validated ground-truth sample. Topic popularity was assessed through average scores and views, while difficulty was measured using three community-driven metrics: the proportion of questions without accepted answers, the proportion of unanswered questions, and the median time to receive an accepted answer. To complement these findings, we conducted an industry-oriented survey in which 12 senior developers assessed the relevance, perceived difficulty, and engineering effort associated with the identified topic.</p> Results <p>Our analysis identifies 11 distinct topics, with the top three (General Logging Practices, Error Handling and Debugging, and Logging Levels and Output) accounting for over 70% of all logging-related discussions. Notably, <i>Logging in Containerized Environments</i> emerged as the most difficult topic: 64.9% of its questions lack an accepted answer, and its median resolution time is among the highest. Survey results corroborate these findings, indicating that topics involving containerization, CI pipelines, and custom logging infrastructures are perceived by practitioners as particularly challenging in industrial settings. These findings highlight enduring practitioner struggles with logging in Docker or other containerized environments and the integration of logging pipelines into orchestrators such as Kubernetes and cloud environments.</p> Conclusion <p>This study sheds light on the practical challenges of logging and provides actionable insights for developers, framework vendors, researchers, and educators.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An empirical study on logging evolution on stack overflow: trends, topics, and challenges

  • Patrick Loic Foalem,
  • Andre Nguimbous,
  • Foutse Khomh,
  • Heng Li,
  • Ettore Merlo

摘要

Context

Logging is a crucial practice in software engineering, aiding developers in debugging applications when errors occur. While existing research has explored logging challenges from an academic perspective through literature reviews and source code analysis, a comprehensive study from the practitioners’ perspective remains lacking.

Objective

This paper aims to bridge this knowledge gap by presenting an in-depth analysis of trends, topics, and challenges in logging based on a dataset of 216,094 posts from Stack Overflow (SO), a popular Q&A platform for developers, and complemented by a practitioner survey to validate the industrial relevance and difficulty of the identified topics.

Method

We analyzed longitudinal trends by examining metadata related to users, questions, and tags associated with logging discussions. To identify prevalent discussion topics, we employed a Large Language Model (LLM)based classification approach, based on a manually validated ground-truth sample. Topic popularity was assessed through average scores and views, while difficulty was measured using three community-driven metrics: the proportion of questions without accepted answers, the proportion of unanswered questions, and the median time to receive an accepted answer. To complement these findings, we conducted an industry-oriented survey in which 12 senior developers assessed the relevance, perceived difficulty, and engineering effort associated with the identified topic.

Results

Our analysis identifies 11 distinct topics, with the top three (General Logging Practices, Error Handling and Debugging, and Logging Levels and Output) accounting for over 70% of all logging-related discussions. Notably, Logging in Containerized Environments emerged as the most difficult topic: 64.9% of its questions lack an accepted answer, and its median resolution time is among the highest. Survey results corroborate these findings, indicating that topics involving containerization, CI pipelines, and custom logging infrastructures are perceived by practitioners as particularly challenging in industrial settings. These findings highlight enduring practitioner struggles with logging in Docker or other containerized environments and the integration of logging pipelines into orchestrators such as Kubernetes and cloud environments.

Conclusion

This study sheds light on the practical challenges of logging and provides actionable insights for developers, framework vendors, researchers, and educators.