Essay writing is a crucial component of middle school Chinese education. The NLPCC 2025 Evaluation of Essay On-Topic Graded Comments (EOTGC) task centers on evaluating primary and secondary school essays. It includes two subtasks: Relevance scoring of essays (Track1) and Generate relevance comments (Track2). This paper proposes a Progressive Augmented-Prompt Fusion framework (PAPF) based on Large Language Models (LLMs), which integrates multiple prompt enhancement techniques including role-playing, task decomposition, Chain-of-Thought, and In-Context Learning into structured prompt templates. The framework progressively guides the model to conduct more accurate essay writing evaluation through a hierarchical, step-by-step approach. Based on this framework, we carefully designed detailed prompt words for Track1 and Track2 respectively according to the actual evaluation requirements, and significantly improved the model’s performance without fine-tuning with training data. Our approach achieves the highest overall score across all leaderboards. Extensive comparative and ablation experiments have confirmed the effectiveness and universality of our method.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Optimizing Automated Essay On-Topic Graded Comments via LLM-Based Prompt Augmentation

  • Zhongtian Hua,
  • Mengyuan Wang,
  • Meijia Yu,
  • Yi Luo,
  • Kunli Zhang,
  • Yingjie Han

摘要

Essay writing is a crucial component of middle school Chinese education. The NLPCC 2025 Evaluation of Essay On-Topic Graded Comments (EOTGC) task centers on evaluating primary and secondary school essays. It includes two subtasks: Relevance scoring of essays (Track1) and Generate relevance comments (Track2). This paper proposes a Progressive Augmented-Prompt Fusion framework (PAPF) based on Large Language Models (LLMs), which integrates multiple prompt enhancement techniques including role-playing, task decomposition, Chain-of-Thought, and In-Context Learning into structured prompt templates. The framework progressively guides the model to conduct more accurate essay writing evaluation through a hierarchical, step-by-step approach. Based on this framework, we carefully designed detailed prompt words for Track1 and Track2 respectively according to the actual evaluation requirements, and significantly improved the model’s performance without fine-tuning with training data. Our approach achieves the highest overall score across all leaderboards. Extensive comparative and ablation experiments have confirmed the effectiveness and universality of our method.