Multimodal Knowledge Graph Completion (MMKGC) enhances knowledge graphs by integrating various data modalities (text, images, audio, etc.) to improve link prediction, entity classification, and fact inference. Current approaches focus on adapting traditional static graph methods and exploring how to incorporate multimodal data effectively. However, these methods lack comprehensiveness, as conventional KG models are not complex enough to capture the rich information in MMKGs and fail to filter out noise from modality diversity. To address these challenges, we propose MMQuat, leveraging the Kolmogorov-Arnold Network (KAN) for efficient multimodal fusion and faster convergence. We then apply Fourier Transform-based feature extraction to eliminate redundant information and enhance entity alignment by filtering modality-specific noise. Operating in quaternion space, MMQuat exploits hyper-complex operations to model intricate relational patterns. Evaluated on three benchmarks against 16 baselines, MMQuat consistently achieves strong performance while maintaining efficiency and generalizability.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advancing Multimodal Knowledge Graphs with KAN Fusion and Quaternion Fourier Transform Filtering

  • Hung Nguyen,
  • Ban Tran,
  • Thanh Le

摘要

Multimodal Knowledge Graph Completion (MMKGC) enhances knowledge graphs by integrating various data modalities (text, images, audio, etc.) to improve link prediction, entity classification, and fact inference. Current approaches focus on adapting traditional static graph methods and exploring how to incorporate multimodal data effectively. However, these methods lack comprehensiveness, as conventional KG models are not complex enough to capture the rich information in MMKGs and fail to filter out noise from modality diversity. To address these challenges, we propose MMQuat, leveraging the Kolmogorov-Arnold Network (KAN) for efficient multimodal fusion and faster convergence. We then apply Fourier Transform-based feature extraction to eliminate redundant information and enhance entity alignment by filtering modality-specific noise. Operating in quaternion space, MMQuat exploits hyper-complex operations to model intricate relational patterns. Evaluated on three benchmarks against 16 baselines, MMQuat consistently achieves strong performance while maintaining efficiency and generalizability.