Digital text images, due to their information-bearing characteristics, are especially vulnerable to manipulation by adversaries using editing tools, hence undermining their authenticity and trustworthiness. Current research predominantly emphasizes the detection of manipulated regions, while investigations into trustworthy recovery remain relatively limited. To overcome these limitations, we present a recovery framework for tampered regions of text images, which includes two essential modules: watermark ID embedding and tampered region recovery, aimed at enhancing the reliability of text images. The watermark embedding module employs optical character recognition and BCH coding to embed error-correctable watermarks, guaranteeing semantic traceability even in cases of significant tampering. The recovery module concurrently incorporates a diffusion-based inpainting technique with large language model reasoning for the first time, enabling high-fidelity recovery of manipulated text. Experimental results showed that the proposed framework achieves enhanced recovery accuracy and demonstrates considerable potential for practical applications in maintaining the integrity and reliability of real-world text images.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Towards Trustworthy Text Image Recovery: Semantic Traceability with Watermark Indexing and Diffusion Inpainting

  • Qingwen Zhu,
  • Li Dong,
  • Haoxuan Han

摘要

Digital text images, due to their information-bearing characteristics, are especially vulnerable to manipulation by adversaries using editing tools, hence undermining their authenticity and trustworthiness. Current research predominantly emphasizes the detection of manipulated regions, while investigations into trustworthy recovery remain relatively limited. To overcome these limitations, we present a recovery framework for tampered regions of text images, which includes two essential modules: watermark ID embedding and tampered region recovery, aimed at enhancing the reliability of text images. The watermark embedding module employs optical character recognition and BCH coding to embed error-correctable watermarks, guaranteeing semantic traceability even in cases of significant tampering. The recovery module concurrently incorporates a diffusion-based inpainting technique with large language model reasoning for the first time, enabling high-fidelity recovery of manipulated text. Experimental results showed that the proposed framework achieves enhanced recovery accuracy and demonstrates considerable potential for practical applications in maintaining the integrity and reliability of real-world text images.