Cross-platform heterogeneity creates a persistent domain-shift problem: the same real-world event is described differently across platforms due to distinct content formats, user norms, modality mixes, and temporal dynamics. This chapter presents Self-Supervised Modality Complementation (SSMC), a framework that reduces reliance on platform-specific labels while explicitly handling missing modalities. We first analyze the coupled challenge of heterogeneity and incompleteness and explain why naive platform-invariant training can fail under modality mismatch. We then introduce SSMC with two core components: a Missing Data Complementation module to regularize and impute absent modality cues, and a Multimodal Self-Learning module that aligns representations through self-supervised objectives for cross-platform transfer. Next, we present the Cross-Platform Social Event Detection (CSED) dataset and describe its design goals and curation pipeline to evaluate robustness under realistic platform shifts. Finally, experimental results demonstrate improved transferability, missing-modality resilience, and stability under distribution changes, and we discuss failure modes and practical recommendations for cross-platform monitoring systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Self-Supervised Modality Complementation (SSMC)

  • Zehang Lin,
  • Qing Li

摘要

Cross-platform heterogeneity creates a persistent domain-shift problem: the same real-world event is described differently across platforms due to distinct content formats, user norms, modality mixes, and temporal dynamics. This chapter presents Self-Supervised Modality Complementation (SSMC), a framework that reduces reliance on platform-specific labels while explicitly handling missing modalities. We first analyze the coupled challenge of heterogeneity and incompleteness and explain why naive platform-invariant training can fail under modality mismatch. We then introduce SSMC with two core components: a Missing Data Complementation module to regularize and impute absent modality cues, and a Multimodal Self-Learning module that aligns representations through self-supervised objectives for cross-platform transfer. Next, we present the Cross-Platform Social Event Detection (CSED) dataset and describe its design goals and curation pipeline to evaluate robustness under realistic platform shifts. Finally, experimental results demonstrate improved transferability, missing-modality resilience, and stability under distribution changes, and we discuss failure modes and practical recommendations for cross-platform monitoring systems.