Extracting Embeddings for Active Learning Corresponding to Regions of Interest in an Image
摘要
A new data selection criterion for active learning of object detectors based on deep neural networks with feature pyramid network (FPN) architecture is presented. The key innovation of the method is the consideration of the local representation of embeddings of objects of interest at different levels of the pyramidal network. To do this, the RoiAlign region of interest alignment operation is used, which avoids distortions due to scaling and rounding. Local embeddings corresponding to labeled objects of interest are processed using principal component analysis and used to select new data based on cosine distance. The effectiveness of the proposed criterion is confirmed experimentally by iteratively training the YOLOv8 detector on the COCO2017 and Pascal VOC-2017 datasets. Comparative analysis with traditional confidence selection methods showed a stable improvement in detection quality measures. The method can be applied in the problems of filtering pseudolabeled data sets, selecting synthetic data, as well as in related problems such as searching for similar objects, hard negative mining, and evaluating the effectiveness of augmentations.