Abstract <p>Existing zero-shot industrial anomaly detection methods commonly rely on deterministically designed text prompts and lack geometric adjustment of the prompt semantic centers, which makes it difficult to capture the semantics of discrete states and continuous contexts, thereby limiting generalization to unseen categories. To address this issue, we propose GPGA, a text prompt framework with mixture of Gaussian prompt geometric adjustment (GPGA). The proposed GPGA employs a mixture of Gaussian expert prompt distribution to embed the semantics of discrete states and continuous contexts from images into a unified prompt space, thereby improving the capacity of text prompts to capture complex semantic structures. It further develops a prompt semantic geometric adjustment method that applies nonlinear geometric adjustment to the prompt semantic centers, enabling the text prompts to better respond to nonlinear semantic shifts in the current image, thus enhancing generalization in zero-shot industrial anomaly detection. Experimental results on seven representative industrial anomaly detection datasets show that GPGA achieves average Image-AUROC (area under the receiver operating characteristic curve)=<InlineEquation ID="IEq1"><EquationSource Format="TEX">\(91.2\pm 0.3\)</EquationSource><EquationSource Format="MATHML"><math><mrow><mn>91.2</mn><mo>±</mo><mn>0.3</mn></mrow></math></EquationSource></InlineEquation> , Image-AP (average precision)=<InlineEquation ID="IEq2"><EquationSource Format="TEX">\(91.5\pm 0.2\)</EquationSource><EquationSource Format="MATHML"><math><mrow><mn>91.5</mn><mo>±</mo><mn>0.2</mn></mrow></math></EquationSource></InlineEquation>, Pixel-AUROC=<InlineEquation ID="IEq3"><EquationSource Format="TEX">\(95.0\pm 0.3\)</EquationSource><EquationSource Format="MATHML"><math><mrow><mn>95.0</mn><mo>±</mo><mn>0.3</mn></mrow></math></EquationSource></InlineEquation>, and Pixel-F<InlineEquation ID="IEq4"><EquationSource Format="TEX">\(_1\)</EquationSource><EquationSource Format="MATHML"><math><mmultiscripts><mrow /><mn>1</mn><mrow /></mmultiscripts></math></EquationSource></InlineEquation>-max (maximum F<InlineEquation ID="IEq5"><EquationSource Format="TEX">\(_1\)</EquationSource><EquationSource Format="MATHML"><math><mmultiscripts><mrow /><mn>1</mn><mrow /></mmultiscripts></math></EquationSource></InlineEquation>-score)=<InlineEquation ID="IEq6"><EquationSource Format="TEX">\(5\text{0 }.2\pm 0.3\)</EquationSource><EquationSource Format="MATHML"><math><mrow><mn>5</mn><mtext>0</mtext><mspace width="0.333333em" /><mo>.</mo><mn>2</mn><mo>±</mo><mn>0.3</mn></mrow></math></EquationSource></InlineEquation>, outperforming advanced methods by 1.11%, 1.78%, 0.53%, and 4.37%, respectively. Moreover, GPGA demonstrates strong capability in accurately detecting diverse anomaly types in complex industrial scenarios. The code is available at <a href="https://github.com/kassiedu999/GPGA">https://github.com/kassiedu999/GPGA</a>.</p> Graphical abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GPGA: Mixture of gaussian prompt geometric adjustment for zero-shot industrial anomaly detection

  • Yipu Yan,
  • Guixiong Liu,
  • Jing Xu

摘要

Abstract

Existing zero-shot industrial anomaly detection methods commonly rely on deterministically designed text prompts and lack geometric adjustment of the prompt semantic centers, which makes it difficult to capture the semantics of discrete states and continuous contexts, thereby limiting generalization to unseen categories. To address this issue, we propose GPGA, a text prompt framework with mixture of Gaussian prompt geometric adjustment (GPGA). The proposed GPGA employs a mixture of Gaussian expert prompt distribution to embed the semantics of discrete states and continuous contexts from images into a unified prompt space, thereby improving the capacity of text prompts to capture complex semantic structures. It further develops a prompt semantic geometric adjustment method that applies nonlinear geometric adjustment to the prompt semantic centers, enabling the text prompts to better respond to nonlinear semantic shifts in the current image, thus enhancing generalization in zero-shot industrial anomaly detection. Experimental results on seven representative industrial anomaly detection datasets show that GPGA achieves average Image-AUROC (area under the receiver operating characteristic curve)=\(91.2\pm 0.3\)91.2±0.3 , Image-AP (average precision)=\(91.5\pm 0.2\)91.5±0.2, Pixel-AUROC=\(95.0\pm 0.3\)95.0±0.3, and Pixel-F\(_1\)1-max (maximum F\(_1\)1-score)=\(5\text{0 }.2\pm 0.3\)50.2±0.3, outperforming advanced methods by 1.11%, 1.78%, 0.53%, and 4.37%, respectively. Moreover, GPGA demonstrates strong capability in accurately detecting diverse anomaly types in complex industrial scenarios. The code is available at https://github.com/kassiedu999/GPGA.

Graphical abstract