Dynamic Focal Loss for Imbalanced Learning
摘要
The loss function is the most important guiding factor in optimizing the model parameters when training a Convolutional Neural Networks (CNN). This effect is even more significant for imbalanced datasets, as it can bias the model to classify only the majority class labels. To address this, Cost-sensitive weighting is used, where the weight factor is multiplied by the loss value, allowing the model to focus more on the minority class samples. In this study, we propose a Dynamic Focal Loss that updates the loss contribution dynamically based on the dataset distribution and the predicted probability of input samples. This allows the model to focus more on the hard minority samples by increasing their weight contribution to the overall loss. This approach can be applied directly to various computer vision applications. The experiments on the benchmark datasets from Canadian Institute for Advanced Research (CIFAR) (i.e., CIFAR10 and CIFAR100) yield comparable results in terms of average