<p>As an important cultural heritage of China and a world treasure, the Dunhuang murals have undergone thousands of years of weathering, oxidation, and human interference, resulting in extensive damage such as cracks, peeling, and fading on their surfaces. Additionally, due to their complex colour palette, it is challenging to quickly identify damaged areas, leading to a situation where the rate of damage to the Dunhuang murals far exceeds the rate of restoration. To achieve efficient and precise monitoring of damage to Dunhuang murals and support cultural heritage preservation efforts, this paper proposes an improved lightweight, high-precision method for monitoring the location of damage to Dunhuang murals based on YOLACT. First, addressing the limitation of traditional YOLACT models in extracting fine-grained texture features, a residual self-attention mechanism capable of extracting global features is introduced to enhance the model’s feature extraction capability (mAP50: 79.2064%). Subsequently, by introducing a depth-separable convolutional architecture, the goal of lightweight design is achieved while maintaining high accuracy (parameter count: 715.12 k, floating-point operations: 70.219 M). Based on the above algorithm, we proposed a rapid detection and deployment application method to help Dunhuang mural restoration experts in practical application. Finally, to validate the model’s effectiveness, this paper conducted validation on a public dataset. Experimental results show that, compared to three mainstream models, the proposed method achieves the highest mAP50 and the smallest parameter count and floating-point operations.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Lightweight high-precision monitoring of damage locations in Dunhuang murals based on improved YOLACT

  • Ting Zou,
  • Yiqing Li,
  • Yihan Dong,
  • Jialin An

摘要

As an important cultural heritage of China and a world treasure, the Dunhuang murals have undergone thousands of years of weathering, oxidation, and human interference, resulting in extensive damage such as cracks, peeling, and fading on their surfaces. Additionally, due to their complex colour palette, it is challenging to quickly identify damaged areas, leading to a situation where the rate of damage to the Dunhuang murals far exceeds the rate of restoration. To achieve efficient and precise monitoring of damage to Dunhuang murals and support cultural heritage preservation efforts, this paper proposes an improved lightweight, high-precision method for monitoring the location of damage to Dunhuang murals based on YOLACT. First, addressing the limitation of traditional YOLACT models in extracting fine-grained texture features, a residual self-attention mechanism capable of extracting global features is introduced to enhance the model’s feature extraction capability (mAP50: 79.2064%). Subsequently, by introducing a depth-separable convolutional architecture, the goal of lightweight design is achieved while maintaining high accuracy (parameter count: 715.12 k, floating-point operations: 70.219 M). Based on the above algorithm, we proposed a rapid detection and deployment application method to help Dunhuang mural restoration experts in practical application. Finally, to validate the model’s effectiveness, this paper conducted validation on a public dataset. Experimental results show that, compared to three mainstream models, the proposed method achieves the highest mAP50 and the smallest parameter count and floating-point operations.