Large Language Models (LLMs) demonstrate impressive in-context reasoning capabilities; however, generating structured outputs remains challenging. In this paper, we investigate prompt-based techniques to guide LLMs in producing outputs compliant with a pre-existing domain-specific controlled natural language called Language for Embedded Safety and Security (LESS). Additionally, we evaluate the effectiveness of LLMs in automating test case generation. Our results show that structured prompt engineering significantly enhances the accuracy and consistency of generated requirements, and that using controlled language formats such as LESS as an intermediate representation substantially improves test case generation accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LESS is More: Guiding LLMs for Formal Requirement and Test Case Generation

  • Abhishek Shrestha,
  • Bernd-Holger Schlingloff,
  • Jürgen Großmann

摘要

Large Language Models (LLMs) demonstrate impressive in-context reasoning capabilities; however, generating structured outputs remains challenging. In this paper, we investigate prompt-based techniques to guide LLMs in producing outputs compliant with a pre-existing domain-specific controlled natural language called Language for Embedded Safety and Security (LESS). Additionally, we evaluate the effectiveness of LLMs in automating test case generation. Our results show that structured prompt engineering significantly enhances the accuracy and consistency of generated requirements, and that using controlled language formats such as LESS as an intermediate representation substantially improves test case generation accuracy.