Style transfer is a crucial area in image processing, enabling the fusion of content and artistic style from different images to create visually appealing outputs. However, existing approaches often struggle with low semantic consistency and poor stylization quality due to inherent conflicts between content and style, as well as limitations in current style feature extraction techniques. To overcome these challenges, we introduce AMST, an innovative aesthetics-guided multi-scale feature fusion approach for style transfer that captures intricate style patterns while harmonizing content and style. Our method introduces a two-stage aesthetic-aware enhancement (TSAAE) module, which integrates fine-grained style features through an aesthetic discriminator and applies an aesthetic constraint to improve style expression. Additionally, we design a multi-scale feature attention fusion (MSFAF) module to compute a semantic consistency measurement, thus promoting sufficient information exchange between content and style. To further improve stylization quality, we introduce two self-supervised tasks aimed at encouraging the generation of content-clear and vibrant results. Extensive qualitative and quantitative evaluations validate that our approach excels in synthesizing stylized images that are both semantically consistent and aesthetically pleasing.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Aesthetics-Guided Multi-scale Feature Fusion for Style Transfer

  • Ruofan Zhang,
  • Xuezhong Qian,
  • Wei Song

摘要

Style transfer is a crucial area in image processing, enabling the fusion of content and artistic style from different images to create visually appealing outputs. However, existing approaches often struggle with low semantic consistency and poor stylization quality due to inherent conflicts between content and style, as well as limitations in current style feature extraction techniques. To overcome these challenges, we introduce AMST, an innovative aesthetics-guided multi-scale feature fusion approach for style transfer that captures intricate style patterns while harmonizing content and style. Our method introduces a two-stage aesthetic-aware enhancement (TSAAE) module, which integrates fine-grained style features through an aesthetic discriminator and applies an aesthetic constraint to improve style expression. Additionally, we design a multi-scale feature attention fusion (MSFAF) module to compute a semantic consistency measurement, thus promoting sufficient information exchange between content and style. To further improve stylization quality, we introduce two self-supervised tasks aimed at encouraging the generation of content-clear and vibrant results. Extensive qualitative and quantitative evaluations validate that our approach excels in synthesizing stylized images that are both semantically consistent and aesthetically pleasing.