Leveraging Large Language Models for Software Defect Detection
摘要
This paper evaluates Large Language Models (LLMs) for static code analysis and defect detection across test sets of increasing complexity. Our findings show LLMs excel with smaller code fragments but deteriorate with increasing complexity. While inconsistent with larger codebases, LLMs provide valuable insights on readability, security, and maintainability that traditional tools miss. We identify key advantages and limitations, concluding that LLMs serve best as complementary solutions to conventional tools, with unique strengths in understanding developer intent and providing contextual recommendations for smaller code units.