<p>Video data is vulnerable to inter-frame forgeries using editing tools like Adobe Premiere Pro. These manipulations can distort or conceal events, compromising the integrity of video evidence. Current inter-frame forgery detection methods often struggle to capture all forgery types, video formats and also lack generalisability due to training on self-created data. This work proposes an inter-frame video forgery detection technique that overcomes these challenges through a five-stage process. Firstly, the video frames are preprocessed to remove post-manipulation effects. Secondly, the spatial and temporal features (such as frame edge difference, optical flow and histogram of oriented gradients) are extracted to capture edge, motion and structure. Next, the temporal convolutional network uses these features to capture long-range dependencies and inconsistencies in the temporal domain. Afterwards, the stacking ensemble method is employed which uses random forest, gradient boosting, support vector machine and k-nearest neighbours with a logistic regression meta-classifier. Lastly, wavelet histogram difference followed by Otsu’s thresholding is used to localise the forgery area. The technique identifies and localises frame-insertion, frame-deletion and frame-duplication forgeries in both static and dynamic video content. It also detects multiple inter-frame forgeries and achieves F1-scores of 0.994, 0.975 and 0.940 on the publicly available datasets VFD, TDTVD and VIFFD. These results demonstrate consistent performance across datasets with varied resolutions, frame rates and compression levels. This suggests potential robustness to format and compression differences.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced inter-frame video forgery detection using convolutional network and stacking ensemble

  • Baheesa Fatima,
  • Asim Dilawar Bakhshi,
  • Abdul Ghafoor

摘要

Video data is vulnerable to inter-frame forgeries using editing tools like Adobe Premiere Pro. These manipulations can distort or conceal events, compromising the integrity of video evidence. Current inter-frame forgery detection methods often struggle to capture all forgery types, video formats and also lack generalisability due to training on self-created data. This work proposes an inter-frame video forgery detection technique that overcomes these challenges through a five-stage process. Firstly, the video frames are preprocessed to remove post-manipulation effects. Secondly, the spatial and temporal features (such as frame edge difference, optical flow and histogram of oriented gradients) are extracted to capture edge, motion and structure. Next, the temporal convolutional network uses these features to capture long-range dependencies and inconsistencies in the temporal domain. Afterwards, the stacking ensemble method is employed which uses random forest, gradient boosting, support vector machine and k-nearest neighbours with a logistic regression meta-classifier. Lastly, wavelet histogram difference followed by Otsu’s thresholding is used to localise the forgery area. The technique identifies and localises frame-insertion, frame-deletion and frame-duplication forgeries in both static and dynamic video content. It also detects multiple inter-frame forgeries and achieves F1-scores of 0.994, 0.975 and 0.940 on the publicly available datasets VFD, TDTVD and VIFFD. These results demonstrate consistent performance across datasets with varied resolutions, frame rates and compression levels. This suggests potential robustness to format and compression differences.