Most existing research on automated essay scoring has predominantly focused on developing feature representations to enhance score prediction accuracy. Notably, earlier studies emphasized hand-crafted feature engineering, while more recent advancements have leveraged neural networks to model various structural features. However, both approaches have treated feature extraction and score prediction as separate tasks. This disjunction has resulted in limited interpretability and overlooked the significant relationship between feedback and scores. To address these challenges, we introduce a novel framework, TBERT, which innovatively integrates prompt-based feature extraction, multi-head attention fusion, and curriculum-style loss weighting. This approach effectively aligns regression scoring with feedback generation. TBERT not only enhances scoring accuracy but also delivers interpretable, rubric-aligned, multi-level feedback, thereby advancing the overall evaluation process with improved interpretability and practical relevance. Comprehensive experiments on public datasets validate the effectiveness and interpretability of our proposed method, particularly emphasizing its remarkable adaptability in narrative essays and long-form writings.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TBERT: Bridging Text Generation and Score Regression Through Hierarchical Feature Fusion Based LLM for Automated Essay Scoring

  • Xia Li,
  • Hongxing Zhang,
  • Suiyu Yang,
  • Yuexin Wang,
  • Xingyu Liu,
  • Yongqi Lu

摘要

Most existing research on automated essay scoring has predominantly focused on developing feature representations to enhance score prediction accuracy. Notably, earlier studies emphasized hand-crafted feature engineering, while more recent advancements have leveraged neural networks to model various structural features. However, both approaches have treated feature extraction and score prediction as separate tasks. This disjunction has resulted in limited interpretability and overlooked the significant relationship between feedback and scores. To address these challenges, we introduce a novel framework, TBERT, which innovatively integrates prompt-based feature extraction, multi-head attention fusion, and curriculum-style loss weighting. This approach effectively aligns regression scoring with feedback generation. TBERT not only enhances scoring accuracy but also delivers interpretable, rubric-aligned, multi-level feedback, thereby advancing the overall evaluation process with improved interpretability and practical relevance. Comprehensive experiments on public datasets validate the effectiveness and interpretability of our proposed method, particularly emphasizing its remarkable adaptability in narrative essays and long-form writings.