Robust face classification under pose, lighting, and occlusion challenges: friends as testbed
摘要
This research introduces the Enhanced Face Classification in Dynamic Scenarios - Pose, Lighting, and Occlusion (EFCDS-PLO) framework, designed to tackle the critical challenges of rapid pose variations, inconsistent lighting, and frequent partial occlusions in dynamic video contexts, which significantly complicate face recognition compared to controlled environments. Using the sitcom Friends Season 1 dataset (1,147 frames featuring 6 main characters with partial occlusions, diverse camera angles, and bright, moderate, low-light scenarios) as a representative testbed, the framework integrates multi-scale feature fusion, adaptive histogram equalization, quality-aware filtering, and margin-expanded cropping to enhance robustness. Spatio-temporal trajectory modeling with weighted voting further optimizes classification for dynamic interactions. Experimental results show that EFCDS-PLO achieves a maximum mAP of 0.9965 with MobileNet-SSD and an F1-score of 0.8164 with YOLO, outperforming baselines. Ablation studies validate that quality filtering and margin cropping significantly improve resilience to real-world variations. This work advances dynamic face recognition for complex video scenarios like sitcoms, providing a robust solution for unconstrained environments where traditional methods struggle with pose, lighting, and occlusion challenges.