Enhanced deepfake detection via dynamic data augmentation and spatiotemporal attention
摘要
Recent advancements in Deepfake technology have raised significant concerns regarding the authenticity of online media. Misuse of Deepfakes poses threats to privacy and economic security. To address the generalization issues faced by existing Deepfake detection methods, we propose a novel framework combining forgery-aware Dynamic Data Augmentation (DDA) and Cross-Frame Multi-Head Attention (CMA). DDA generates forgery heatmaps using spatial features extracted by Swin Transformer, guiding region-level data augmentation dynamically. CMA extracts temporal inconsistencies across frames using spatial features. Spatiotemporal features are fused and fed into a Bidirectional GRU (Bi-GRU) to model sequential dependencies. Extensive experiments demonstrate that our framework outperforms state-of-the-art methods in cross-compression and cross-forgery-type evaluations. Our code and datasets are publicly available at https://github.com/luanmianv/DDA-CMA.