This paper introduces BioFusionNet, a groundbreaking deepfake detection framework that cleverly combines spatial, temporal, and physiological features like skin color variations, micro-expressions, involuntary facial muscle movements, blinking patterns, pulse signals through a multi-cue ensemble learning approach. Unlike traditional methods that mainly focus on visual artifacts and timing inconsistencies, BioFusionNet features a specialized function named Physiological Branch (PB) aimed at capturing subtle biological signals that generative models often struggle to mimic. By utilizing an attention-based fusion mechanism, our model skillfully merges the strengths of convolutional neural network (CNN), recurrent neural network (RNN), and long short-term memory (LSTM) branches with these physiological cues, creating a highly effective detection system that excels even with limited training data. Our experimental results show marked improvements in the detection accuracy, precision, recall, and overall robustness of the model, setting the stage for more reliable deep-fake forensic tools in real-world scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

BioFusionNet: A Practical Approach for Deepfake Detection

  • Sayandeepa Biswas,
  • Raja Karmakar,
  • Khandekar Lutful Hassan

摘要

This paper introduces BioFusionNet, a groundbreaking deepfake detection framework that cleverly combines spatial, temporal, and physiological features like skin color variations, micro-expressions, involuntary facial muscle movements, blinking patterns, pulse signals through a multi-cue ensemble learning approach. Unlike traditional methods that mainly focus on visual artifacts and timing inconsistencies, BioFusionNet features a specialized function named Physiological Branch (PB) aimed at capturing subtle biological signals that generative models often struggle to mimic. By utilizing an attention-based fusion mechanism, our model skillfully merges the strengths of convolutional neural network (CNN), recurrent neural network (RNN), and long short-term memory (LSTM) branches with these physiological cues, creating a highly effective detection system that excels even with limited training data. Our experimental results show marked improvements in the detection accuracy, precision, recall, and overall robustness of the model, setting the stage for more reliable deep-fake forensic tools in real-world scenarios.