While providing feedback is a critical task in education, assessing open-ended responses and crafting personalized feedback for each student is time-consuming and challenging. Large Language Models (LLM) can be used to support this process by leveraging their natural language understanding capabilities to evaluate open-ended answers and generate automated feedback. However, in real-world learning environments, empirical gaps remain regarding: I) How do students perceive LLM-generated feedback compared to teacher-provided feedback? and II) What impact does LLM assistance have on instructor feedback practices? Thus, this paper presents a controlled experiment with 60 secondary school students in Brazil, comparing traditional teacher feedback with LLM-assisted feedback using the Tutoria platform. Results showed no significant difference in students’ perceptions of feedback quality between the two approaches, with 85% unable to distinguish LLM-generated feedback from teacher feedback. Notably, LLM assistance produced feedback messages 2.6 times longer (p < 0.001) without significantly increasing grading time (p = 0.047, ES = 0.09).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Human Teacher vs. LLM-Generated Feedback in Secondary Education: A Comparative Study on Student Perceptions

  • Cleon Xavier,
  • Newarney Torrezão da Costa,
  • Ana Karoline Valdo,
  • Gabriel Alves,
  • Luiz Rodrigues,
  • Luiz Fernando Rodrigues,
  • Matheus Silva,
  • Rodrigues Neto,
  • Taciana Pontual Falcão,
  • Dragan Gasevic,
  • Rafael Ferreira Mello

摘要

While providing feedback is a critical task in education, assessing open-ended responses and crafting personalized feedback for each student is time-consuming and challenging. Large Language Models (LLM) can be used to support this process by leveraging their natural language understanding capabilities to evaluate open-ended answers and generate automated feedback. However, in real-world learning environments, empirical gaps remain regarding: I) How do students perceive LLM-generated feedback compared to teacher-provided feedback? and II) What impact does LLM assistance have on instructor feedback practices? Thus, this paper presents a controlled experiment with 60 secondary school students in Brazil, comparing traditional teacher feedback with LLM-assisted feedback using the Tutoria platform. Results showed no significant difference in students’ perceptions of feedback quality between the two approaches, with 85% unable to distinguish LLM-generated feedback from teacher feedback. Notably, LLM assistance produced feedback messages 2.6 times longer (p < 0.001) without significantly increasing grading time (p = 0.047, ES = 0.09).