Existing micro-video recommendation methods are mainly based on graph neural network modeling the complex interaction between users and videos. Although there have been research attempts to introduce multimodal information to enhance the recommendation effect, most of the methods still use simple multimodal feature summation, which lacks the in-depth mining of the association between different modalities; at the same time, the existing micro-video recommendation methods tend to ignore the potential interest features in the user’s multiple interaction behaviors, which leads to the limitation of the recommendation results. In this regard, a micro-video recommendation method (Multi-Modal User Behavior Graph Neural Network, MMUB-GNN) that fuses multimodal data and user’s multi-behavior is proposed to explore a more effective multimodal fusion method to further explore the potential features of the items; then, design a more comprehensive user interest modeling mechanism by combining users’ multiple interaction behaviors; and then better express the connection between users and items to improve the accuracy and diversity of suggestions. Through comprehensive experiments on three public datasets, it is experimentally demonstrated that the proposed model performs considerably better than the leading multimodal micro-video recommendation techniques.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on Micro-videos Recommendation Method Integrating Multimodal Data and User Multi-behavior

  • Wangwang Zhang,
  • Baojun Tian,
  • Tengjiao Wang,
  • Lu Yuan,
  • Meng Jiang

摘要

Existing micro-video recommendation methods are mainly based on graph neural network modeling the complex interaction between users and videos. Although there have been research attempts to introduce multimodal information to enhance the recommendation effect, most of the methods still use simple multimodal feature summation, which lacks the in-depth mining of the association between different modalities; at the same time, the existing micro-video recommendation methods tend to ignore the potential interest features in the user’s multiple interaction behaviors, which leads to the limitation of the recommendation results. In this regard, a micro-video recommendation method (Multi-Modal User Behavior Graph Neural Network, MMUB-GNN) that fuses multimodal data and user’s multi-behavior is proposed to explore a more effective multimodal fusion method to further explore the potential features of the items; then, design a more comprehensive user interest modeling mechanism by combining users’ multiple interaction behaviors; and then better express the connection between users and items to improve the accuracy and diversity of suggestions. Through comprehensive experiments on three public datasets, it is experimentally demonstrated that the proposed model performs considerably better than the leading multimodal micro-video recommendation techniques.