<p>Art has long been recognized as a central medium of cultural expression, education, and human creativity. However, the rapid enhancements of advanced AI tools such as Stable Diffusion, Midjourney, and DALL·E has introduced large volumes of synthetic images that disguise the boundaries between authentic human artwork and machine-generated creations. This need raises critical challenges for evaluating the clarity and authenticity of digital art, particularly in distinguishing whether a piece is real or artificially generated. Traditional image analysis methods, primarily relying on traditional features or convolutional neural networks (CNN), limitations in capturing both fine-grained textures and global artistic composition. To address this challenge, this study proposes a Memory-Augmented Vision Transformer (MeMViT), an integrated EfficientNet-based mechanism works using hierarchical transformer model enhanced with masked attention and memory tokens to efficiently capture both local and global image dependencies. The model was trained on a balanced dataset of 60,000 images, comprising equal proportions of AI-generated and real artwork. For comparison, several baselines, including CNN, DenseNet, AlexNet, and a standard ViT, were also evaluated. Experimental results demonstrate that the proposed model achieves the highest classification accuracy of 97%, outperforming all baselines. Furthermore, model interpretability was ensured using Grad-CAM visualizations and LIME analysis, providing transparent insights into decision-making for art clarity evaluation which shows the AI’s impact on creative authenticity.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Memory-augmented vision transformers with class activation mapping for authenticity and clarity evaluation in digital art

  • Jiexiao Tang,
  • Qun Pang

摘要

Art has long been recognized as a central medium of cultural expression, education, and human creativity. However, the rapid enhancements of advanced AI tools such as Stable Diffusion, Midjourney, and DALL·E has introduced large volumes of synthetic images that disguise the boundaries between authentic human artwork and machine-generated creations. This need raises critical challenges for evaluating the clarity and authenticity of digital art, particularly in distinguishing whether a piece is real or artificially generated. Traditional image analysis methods, primarily relying on traditional features or convolutional neural networks (CNN), limitations in capturing both fine-grained textures and global artistic composition. To address this challenge, this study proposes a Memory-Augmented Vision Transformer (MeMViT), an integrated EfficientNet-based mechanism works using hierarchical transformer model enhanced with masked attention and memory tokens to efficiently capture both local and global image dependencies. The model was trained on a balanced dataset of 60,000 images, comprising equal proportions of AI-generated and real artwork. For comparison, several baselines, including CNN, DenseNet, AlexNet, and a standard ViT, were also evaluated. Experimental results demonstrate that the proposed model achieves the highest classification accuracy of 97%, outperforming all baselines. Furthermore, model interpretability was ensured using Grad-CAM visualizations and LIME analysis, providing transparent insights into decision-making for art clarity evaluation which shows the AI’s impact on creative authenticity.