Scenario-aware unsupervised classroom video segmentation via multimodal feature fusion
摘要
Automatic segmentation of classroom teaching videos enables efficient access to instructional scenarios for both students and instructors. However, existing methods struggle to capture complex teacher-student interaction patterns. To address this, this paper proposes the SceSeg, a multimodal feature fusion method that integrates the text, video, audio, and speaker information to accurately segment lecture, Q&A, and discussion scenarios.The method adopts a three-stage framework: multimodal feature extraction, hierarchical classification combining rule-based and probabilistic decisions, and temporal smoothing for final segmentation. Experimental results show that SceSeg achieves 71.8%, 93.3%, 81.4%, and 77.2% on ACC, WACC, MOF, and IoU, respectively, outperforming the best baseline.This work improves efficient access to classroom content and supports intelligent analysis of teaching videos.