Image aesthetic assessment (IAA) is a highly significant research topic in computational aesthetics, with a wide range of applications in areas such as art creation. However, existing IAA methods ignore the influence of multilevel aesthetic attributes as well as compositional features on the evaluation results. In this paper, we propose an IAA model MFCI-Net that integrates multilevel deep features and composition cognition. The model combines both local and global aesthetic features of an image using ResNet50 and Swin Transformer architectures to receive image information from different receptive fields, enhancing the ability to understand the complex image content. Furthermore, MFCI-Net employs the holistically nested edge detection (HED) algorithm to guide the network to learn the association between spatial structure and aesthetic features, improving its performance on the IAA tasks. Extensive experiments were conducted on three public datasets, namely AADB, PARA, and KonIQ-10K, to evaluate the performance of MFCI-Net. The results demonstrate the superiority of our model in obtaining both multi-level deep features and spatial composition features of an image. Our code will be released at https://github.com/liuxida/MFCI-Net .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MFCI-Net: Image Aesthetic Assessment Integrating Multilevel Deep Features and Composition Cognition

  • Yang Liu,
  • Jingwen Liu,
  • Shuo Zhang,
  • Lingyu Chen,
  • Wanjun Zhang

摘要

Image aesthetic assessment (IAA) is a highly significant research topic in computational aesthetics, with a wide range of applications in areas such as art creation. However, existing IAA methods ignore the influence of multilevel aesthetic attributes as well as compositional features on the evaluation results. In this paper, we propose an IAA model MFCI-Net that integrates multilevel deep features and composition cognition. The model combines both local and global aesthetic features of an image using ResNet50 and Swin Transformer architectures to receive image information from different receptive fields, enhancing the ability to understand the complex image content. Furthermore, MFCI-Net employs the holistically nested edge detection (HED) algorithm to guide the network to learn the association between spatial structure and aesthetic features, improving its performance on the IAA tasks. Extensive experiments were conducted on three public datasets, namely AADB, PARA, and KonIQ-10K, to evaluate the performance of MFCI-Net. The results demonstrate the superiority of our model in obtaining both multi-level deep features and spatial composition features of an image. Our code will be released at https://github.com/liuxida/MFCI-Net .