Identifying related Indicators of Compromise (IoCs), such as malicious IP addresses and associated network services (IP:Ports), is crucial for threat intelligence but challenging due to the scale and heterogeneity of Internet scan data. We propose a novel self-supervised contrastive learning framework to generate meaningful embeddings for IP:Port instances by fusing multimodal features (TLS certificates, banners, web content, metadata). Addressing the critical false negative problem inherent in contrastive learning, especially when combined with Hard Negative Mining (HNM), we introduce Semantic-Consistency HNM (SC-HNM). This technique employs a lightweight, integrated auxiliary network operating on early-stage feature representations to assess semantic similarity between an anchor and potential hard negatives. If the initial similarity exceeds a threshold \(\delta \) , the potentially false negative is dynamically filtered out before computing the main contrastive loss, thus preserving semantic structure without requiring any labels. Our multimodal encoder utilizes attention and gating mechanisms for effective feature fusion. We train the model entirely from scratch on 8 million unlabeled scan records. Experiments show our approach yields highly competitive IoC retrieval performance, significantly outperforming zero-shot baselines (including large pre-trained models like BERT, RoBERTa, BGE-M3, E5). Ablation studies confirm the benefits of multimodality, HNM, and our SC-HNM filter. Furthermore, the resulting model is compact ( 27 million parameters) and efficient, enabling practical deployment for large-scale IoC similarity search and threat discovery.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SC-HNM: Filtering False Negatives for Network Service Embeddings

  • Xuyun Wu,
  • Yinbing Lu,
  • Yong Yuan,
  • Xuying Zhou,
  • Cheng Qian

摘要

Identifying related Indicators of Compromise (IoCs), such as malicious IP addresses and associated network services (IP:Ports), is crucial for threat intelligence but challenging due to the scale and heterogeneity of Internet scan data. We propose a novel self-supervised contrastive learning framework to generate meaningful embeddings for IP:Port instances by fusing multimodal features (TLS certificates, banners, web content, metadata). Addressing the critical false negative problem inherent in contrastive learning, especially when combined with Hard Negative Mining (HNM), we introduce Semantic-Consistency HNM (SC-HNM). This technique employs a lightweight, integrated auxiliary network operating on early-stage feature representations to assess semantic similarity between an anchor and potential hard negatives. If the initial similarity exceeds a threshold \(\delta \) , the potentially false negative is dynamically filtered out before computing the main contrastive loss, thus preserving semantic structure without requiring any labels. Our multimodal encoder utilizes attention and gating mechanisms for effective feature fusion. We train the model entirely from scratch on 8 million unlabeled scan records. Experiments show our approach yields highly competitive IoC retrieval performance, significantly outperforming zero-shot baselines (including large pre-trained models like BERT, RoBERTa, BGE-M3, E5). Ablation studies confirm the benefits of multimodality, HNM, and our SC-HNM filter. Furthermore, the resulting model is compact ( 27 million parameters) and efficient, enabling practical deployment for large-scale IoC similarity search and threat discovery.