In recent years, numerous methods for deepfake detection have emerged, but they often face performance issues when evaluated across different datasets. This paper introduces two components based on the frequency and RGB domains that achieve excellent generalization. Specifically, a Self-Blended Generator Based on Discrete Wavelet Transform is proposed to generate Deepfakes from a frequency perspective, providing indistinguishable training images that enhance the discriminator’s generalization ability. Additionally, a Swin-SRM Dual-Stream Discriminator is presented, which performs multi-stage cross-attention fusion between the RGB and frequency domains. Comprehensive experiments demonstrate that the two components introduced achieve more superior performance than existing models, particularly in terms of robustness and generalization across different datasets.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Wavelet-Based Self-image Blending for More General Face Forgery Detection

  • Majun Zhang

摘要

In recent years, numerous methods for deepfake detection have emerged, but they often face performance issues when evaluated across different datasets. This paper introduces two components based on the frequency and RGB domains that achieve excellent generalization. Specifically, a Self-Blended Generator Based on Discrete Wavelet Transform is proposed to generate Deepfakes from a frequency perspective, providing indistinguishable training images that enhance the discriminator’s generalization ability. Additionally, a Swin-SRM Dual-Stream Discriminator is presented, which performs multi-stage cross-attention fusion between the RGB and frequency domains. Comprehensive experiments demonstrate that the two components introduced achieve more superior performance than existing models, particularly in terms of robustness and generalization across different datasets.