Scholarlink

<p>With the rapid advancement of large language models, the demand for intelligent and fine-grained automated essay scoring in educational assessment has increased significantly. However, existing methods still face challenges in maintaining scoring alignment and output consistency, making it difficult to consistently approximate human scoring standards. To address these issues, this paper proposes a unified framework named RACES (Reward-Aligned Consistent Essay Scoring), which integrates LoRA-based parameter-efficient fine-tuning, reward modeling, and proximal policy optimization reinforcement learning. The framework establishes an offline inference–feedback–optimization pipeline, enabling optimization toward proxy preference signals simulated via LLM-generated feedback while constraining policy drift through KL regularization. Experimental results on the ASAP 2.0 dataset show that RACES improves QWK and auxiliary SimCSE metrics compared with the evaluated pretrained and fine-tuned model configurations, achieving rapid convergence with limited training iterations. The framework improves scoring accuracy under the evaluated settings, while consistency is examined through KL-regularized optimization behavior and auxiliary proxy-feedback analysis rather than direct deployment-level robustness tests. These findings suggest the practical potential of RACES for supporting more controlled preliminary essay scoring in educational assessment, particularly as an auxiliary tool for reducing grading workload and improving the reliability of large-scale writing evaluation.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

RACES: reward-aligned consistent essay scoring with large language models

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年6月19日

查看全文
  • Zhenxin Zhang,
  • Ziyu Ding,
  • Mengyun Liu,
  • Haiwei Sang

摘要

With the rapid advancement of large language models, the demand for intelligent and fine-grained automated essay scoring in educational assessment has increased significantly. However, existing methods still face challenges in maintaining scoring alignment and output consistency, making it difficult to consistently approximate human scoring standards. To address these issues, this paper proposes a unified framework named RACES (Reward-Aligned Consistent Essay Scoring), which integrates LoRA-based parameter-efficient fine-tuning, reward modeling, and proximal policy optimization reinforcement learning. The framework establishes an offline inference–feedback–optimization pipeline, enabling optimization toward proxy preference signals simulated via LLM-generated feedback while constraining policy drift through KL regularization. Experimental results on the ASAP 2.0 dataset show that RACES improves QWK and auxiliary SimCSE metrics compared with the evaluated pretrained and fine-tuned model configurations, achieving rapid convergence with limited training iterations. The framework improves scoring accuracy under the evaluated settings, while consistency is examined through KL-regularized optimization behavior and auxiliary proxy-feedback analysis rather than direct deployment-level robustness tests. These findings suggest the practical potential of RACES for supporting more controlled preliminary essay scoring in educational assessment, particularly as an auxiliary tool for reducing grading workload and improving the reliability of large-scale writing evaluation.