This paper explores the role of emotion recognition in improving student learning by monitoring psychological states in real-time. We introduce a multi-face automated emotion recognition system that analyzes the emotions of multiple students simultaneously, evaluated on the Emotion PTIT dataset, which consists of students in a classroom, manually labeled with 1,500 images and 300 videos for face recognition and classroom detection tasks, respectively. To enhance classroom dynamics, we propose a new formula for evaluating engagement based on emotional data. The system, designed for low-power IoT devices, addresses challenges like load balancing and latency, processing live video feeds to assess classroom interactions. Our prototype can detect up to 50 faces at 25 FPS with an accuracy of 88.18%.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Real-Time Multi-face Emotion Recognition in Classroom

  • Uyen Vuong,
  • Hai Nguyen,
  • Hieu Dao,
  • Hung Nguyen,
  • Cong Tran

摘要

This paper explores the role of emotion recognition in improving student learning by monitoring psychological states in real-time. We introduce a multi-face automated emotion recognition system that analyzes the emotions of multiple students simultaneously, evaluated on the Emotion PTIT dataset, which consists of students in a classroom, manually labeled with 1,500 images and 300 videos for face recognition and classroom detection tasks, respectively. To enhance classroom dynamics, we propose a new formula for evaluating engagement based on emotional data. The system, designed for low-power IoT devices, addresses challenges like load balancing and latency, processing live video feeds to assess classroom interactions. Our prototype can detect up to 50 faces at 25 FPS with an accuracy of 88.18%.