Recently, most Thangkas are preserved in the form of digital images. These Thangkas have lost detail and reduced resolution due to oversights in preservation techniques. This paper proposes to apply super-resolution to low-quality Thangkas to retain more semantic information while maintaining image fidelity. Specifically, a high-resolution Thangka dataset is constructed for model training. Subsequently, the semantic information of images are injected in hidden feature based on SinSR, which extracts semantic information from low-resolution images during the original downsampling process, then integrates the semantic masks into the residual blocks of the Unet framework. At the same time, we conducted an in-depth analysis of multiple fusion locations and methods, selecting the most suitable solution. Experiments on the Thangka dataset illustrate that, compared with other models, our method not only strengthens semantic fusion but also preserves finer local details, yielding an 8% improvement in CLIPIQA scores over the original model and a 5% gain in MANIQA scores.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Semantic-Fused Diffusion Model for Thangka Image Super-Resolution Based on Constructed Dataset

  • Yilun Wang,
  • Dondrub Tsering,
  • Yutong Liu,
  • Jin Zhang,
  • Yuqing Cai,
  • Konchok Tsering,
  • Haoliang Wang,
  • Xiangxiang Wang,
  • Yongbin Yu,
  • Nyima Tashi

摘要

Recently, most Thangkas are preserved in the form of digital images. These Thangkas have lost detail and reduced resolution due to oversights in preservation techniques. This paper proposes to apply super-resolution to low-quality Thangkas to retain more semantic information while maintaining image fidelity. Specifically, a high-resolution Thangka dataset is constructed for model training. Subsequently, the semantic information of images are injected in hidden feature based on SinSR, which extracts semantic information from low-resolution images during the original downsampling process, then integrates the semantic masks into the residual blocks of the Unet framework. At the same time, we conducted an in-depth analysis of multiple fusion locations and methods, selecting the most suitable solution. Experiments on the Thangka dataset illustrate that, compared with other models, our method not only strengthens semantic fusion but also preserves finer local details, yielding an 8% improvement in CLIPIQA scores over the original model and a 5% gain in MANIQA scores.