A feature selection-aided deep learning based deepfake video detection method
摘要
The rapid advancements in deepfake technology are imposing significant challenges in detecting manipulated media contents. In this work, we have introduced a deepfake detection method that utilizes three pre-trained convolutional neural network models, namely DenseNet-121, EfficientNet-B0, and Xception to extract deep learning features from preprocessed extracted video frames. Next, these features are stacked to generate diverse feature representations, and thus end up with high-dimensional features. After that, a feature selection strategy is employed on the combined features to eliminate redundant and less effective features. The selected features are then fed into the K-nearest neighbors classifier to decide whether a questioned video is a fake video or not. Two widely used deepfake video datasets, namely FaceForensics++ and Celeb-DF (V2) are used to evaluate the performance of the proposed technique following two experimental setups: intra- and inter-datasets. The results show that the model achieves area under curve scores of 98.50% (85.70%) and 97.70% (79.00%) in the intra-dataset (inter-dataset) setups while trained on the FaceForensics++ and Celeb-DF (V2) datasets, respectively. The performance of the proposed model is comparable to that of state-of-the-art methods. Source code of the proposed method can be found at: here.