Scholarlink

<p>Facial forgery technology is advancing rapidly, leading to significant social security concerns. In recent years, as forgery technologies and types continue to emerge, many methods struggle to strike a balance between accuracy and robustness. Most existing methods rely on CNN to extract high-quality forged face clues but often overlook inherent forgery traces. Consequently, they may overfit the training dataset and perform poorly on data from diverse sources or be subjected to various post-processing operations. To address this challenge, we propose leveraging multi-scale texture information to expose subtle artifacts in RGB space. To achieve this, we devise a two-stream detection architecture that integrates texture features and RGB features. We analyze forgery traces using global large texture information and local detailed texture information separately. Additionally, we design a feature pyramid to fuse these two texture features and employ an attention mechanism to enhance the features of both streams. By examining forgery traces from multiple perspectives, we have developed an adaptive feature fusion module to facilitate interactive feature fusion between the two streams. We conduct extensive experiments on various benchmark datasets and compare our method with recent state-of-the-art (SOTA) methods to demonstrate its effectiveness. Our code will be provided at <a href="https://github.com/hryyyy/MST">https://github.com/hryyyy/MST</a>.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Robust face forgery detection integrating local texture and global texture information

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年2月10日

查看全文
  • Rongrong Gong,
  • Ruiyi He,
  • Dengyong Zhang,
  • Arun Kumar Sangaiah,
  • Mohammed J. F. Alenazi

摘要

Facial forgery technology is advancing rapidly, leading to significant social security concerns. In recent years, as forgery technologies and types continue to emerge, many methods struggle to strike a balance between accuracy and robustness. Most existing methods rely on CNN to extract high-quality forged face clues but often overlook inherent forgery traces. Consequently, they may overfit the training dataset and perform poorly on data from diverse sources or be subjected to various post-processing operations. To address this challenge, we propose leveraging multi-scale texture information to expose subtle artifacts in RGB space. To achieve this, we devise a two-stream detection architecture that integrates texture features and RGB features. We analyze forgery traces using global large texture information and local detailed texture information separately. Additionally, we design a feature pyramid to fuse these two texture features and employ an attention mechanism to enhance the features of both streams. By examining forgery traces from multiple perspectives, we have developed an adaptive feature fusion module to facilitate interactive feature fusion between the two streams. We conduct extensive experiments on various benchmark datasets and compare our method with recent state-of-the-art (SOTA) methods to demonstrate its effectiveness. Our code will be provided at https://github.com/hryyyy/MST.