<p>Traditional multimedia classification techniques rely on analyzing either its features or the associated annotated textual information. In this paper, we introduce a technique that leverages deep learning methodologies to extract both low-level visual features and high-level semantic information from the billboard images. We propose a multi-modal hybrid fusion model that integrates text and image features to categorize billboards in video frames into food, sports, and miscellaneous categories. Achieving a 5% accuracy improvement over image-based models and 10% over text-based models, our model demonstrates robust generalization across diverse datasets, benefiting advertising, media, and content creation industries.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-modal fusion for billboard categorization in video frames: A text and image-based approach

  • Sukriti Dhang,
  • Jason Lok,
  • Mimi Zhang,
  • Soumyabrata Dev

摘要

Traditional multimedia classification techniques rely on analyzing either its features or the associated annotated textual information. In this paper, we introduce a technique that leverages deep learning methodologies to extract both low-level visual features and high-level semantic information from the billboard images. We propose a multi-modal hybrid fusion model that integrates text and image features to categorize billboards in video frames into food, sports, and miscellaneous categories. Achieving a 5% accuracy improvement over image-based models and 10% over text-based models, our model demonstrates robust generalization across diverse datasets, benefiting advertising, media, and content creation industries.