Investigating LLMs Potential in Software Requirements Evaluation
摘要
LLMs have made a big splash on social media by changing how trends catch on and keeping users engaged. LLMs now have the application and understanding of software engineering activities, including requirement engineering, designing, coding, testing and software security. LLMs can help accelerate the process and save cost, time, and enhance security. This paper investigates software engineering activities using LLMs but focuses on requirements evaluation on the generated requirements from different LLMs. The three LLMs used in our work are GPT3.5, through ChatGPT bot; Palm 2, through Poe bot; and Claude 1, through Poe bot. We investigated if LLMs have the understanding and can evaluate the provided requirements according to software quality attributes. We consider the requirements evaluation a main process since all other processes depend on it.