In the ever-evolving world of fashion, building the perfect outfit can be a challenge. We propose a fashion recommendation system, which we call Visual Search, that uses computer vision and deep learning to ensure a coordinated set of fashion recommendations. The system allows users to upload a single photo of their outfit, where a pretrained YOLO model, further fine-tuned on a dataset of labeled clothing items, detects and crops the individual clothing pieces. These pieces are then fed into a compatibility model, comprising a Convolutional Neural Network and bidirectional Long Short Term Memory to generate the most compatible chosen/missing piece. To complete the recommendation process, we incorporated a similarity model based on Vision Transformer. This model meticulously compares the generated image to a given catalog of products, selecting the one that most closely matches the generated image in terms of visual features.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A BiLSTM Approach to Outfit Compatibility and Image Similarity

  • Luís Silva,
  • Francisco Oliveira,
  • Ivan Gomes,
  • C. Mendes Araújo,
  • João Oliveira

摘要

In the ever-evolving world of fashion, building the perfect outfit can be a challenge. We propose a fashion recommendation system, which we call Visual Search, that uses computer vision and deep learning to ensure a coordinated set of fashion recommendations. The system allows users to upload a single photo of their outfit, where a pretrained YOLO model, further fine-tuned on a dataset of labeled clothing items, detects and crops the individual clothing pieces. These pieces are then fed into a compatibility model, comprising a Convolutional Neural Network and bidirectional Long Short Term Memory to generate the most compatible chosen/missing piece. To complete the recommendation process, we incorporated a similarity model based on Vision Transformer. This model meticulously compares the generated image to a given catalog of products, selecting the one that most closely matches the generated image in terms of visual features.