The quality of requirements specification directly affects software quality, but quantitatively assessing the quality of requirements specification is a difficult task. In this study, we propose a framework for quantitatively evaluating requirements specifications that improve TextRank and RoBERTa. Aiming at the problem of redundant information in long texts and the difficulty of accurately calculating the similarity, an adaptive TextRank keyword extraction algorithm incorporating dependency parsing is proposed; to deeply excavate the complex structure and deep semantics of the text, a Siamese-RoBERTa model optimizing the attention pooling layer is proposed to capture the important features of the text more comprehensively; finally, the semantic similarity between texts is calculated by cosine similarity to realize the quantitative evaluation of the requirements specification. The experimental results show that the proposed evaluation framework has good performance, its Spearman coefficient reaches 0.973, and the average absolute error between the model evaluation results and the expert evaluation does not exceed 0.5.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving TextRank and RoBERTa’s Quantitative Evaluation Framework for Requirements Specification

  • Jin Zhang,
  • Ying Li,
  • Sheng Wu,
  • Haowei Huang,
  • Yuanyuan Huang

摘要

The quality of requirements specification directly affects software quality, but quantitatively assessing the quality of requirements specification is a difficult task. In this study, we propose a framework for quantitatively evaluating requirements specifications that improve TextRank and RoBERTa. Aiming at the problem of redundant information in long texts and the difficulty of accurately calculating the similarity, an adaptive TextRank keyword extraction algorithm incorporating dependency parsing is proposed; to deeply excavate the complex structure and deep semantics of the text, a Siamese-RoBERTa model optimizing the attention pooling layer is proposed to capture the important features of the text more comprehensively; finally, the semantic similarity between texts is calculated by cosine similarity to realize the quantitative evaluation of the requirements specification. The experimental results show that the proposed evaluation framework has good performance, its Spearman coefficient reaches 0.973, and the average absolute error between the model evaluation results and the expert evaluation does not exceed 0.5.