Convolutional neural networks have been used for low-light image enhancement (LLIE), but cannot effectively capture global context relationships. Transformers are good at capturing long-range dependencies, but involve the costly computation of the attention map. In addition, existing transformers-based  LLIE methods pay less attention to frequency-domain components, and neglect the role of multi-modal information in image enhancement. To overcome these issues, we propose a new LLIE network based on Two-stage Frequency-domain Decomposition with Text Guidance (TFDTG-Net). Specifically, we decompose the LLIE task into two stages and separately handle the amplitude and phase information  in the frequency domain. In both stages, we embed a frequency-domain attention module to efficiently estimate the attention map of transformers for global context modeling. Meanwhile, we introduce a text guidance module to leverage the vision-language model to extract semantic information for image enhancement. As such, we comprehensively consider spatial-frequency features, local-global context relationships and semantic information in our TFDTG-Net. The experimental results quantitatively and qualitatively demonstrate that TFDTG-Net is effective for LLIE compared with other methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

TFDTG-Net: Exploring Two-Stage Frequency-Domain Decomposition with Text Guidance for Low-Light Image Enhancement

  • Tiecheng Song,
  • Tao He,
  • Yaokang Liu,
  • Yongkang Cao,
  • Guoyang Cao,
  • Huaiyi Sun

摘要

Convolutional neural networks have been used for low-light image enhancement (LLIE), but cannot effectively capture global context relationships. Transformers are good at capturing long-range dependencies, but involve the costly computation of the attention map. In addition, existing transformers-based  LLIE methods pay less attention to frequency-domain components, and neglect the role of multi-modal information in image enhancement. To overcome these issues, we propose a new LLIE network based on Two-stage Frequency-domain Decomposition with Text Guidance (TFDTG-Net). Specifically, we decompose the LLIE task into two stages and separately handle the amplitude and phase information  in the frequency domain. In both stages, we embed a frequency-domain attention module to efficiently estimate the attention map of transformers for global context modeling. Meanwhile, we introduce a text guidance module to leverage the vision-language model to extract semantic information for image enhancement. As such, we comprehensively consider spatial-frequency features, local-global context relationships and semantic information in our TFDTG-Net. The experimental results quantitatively and qualitatively demonstrate that TFDTG-Net is effective for LLIE compared with other methods.