Learning content and style representation for NIR-II fluorescence image translation
摘要
The second near-infrared (NIR-II) fluorescence imaging is a new biomedical imaging method. Compared with the NIR-IIa window (1000–1300 nm), the NIR-IIb window (1500–1700 nm) produces clearer images and better imaging effects. Due to technical limitations, no NIR-IIb molecular probes are used in clinic. In order to get the NIR-IIb images, we translate the given NIR-IIa images into the NIR-IIb images through artificial intelligence. We propose a generative model to complete the above translation process, which is based on the encoder–decoder structure. The decoder is a pre-trained StyleGAN trained only in the NIR-IIb domain. NIR-II images are usually unpaired. In order to achieve unsupervised image translation, we separate the latent code of StyleGAN into two parts: style–content and style–style. The encoder encodes the images into the latent space, and by learning the content representation and style representation in the latent space, the generated images can inherit the content of the NIR-IIa images and the style of the NIR-IIb images. Experiment results show that the proposed model can generate high quality NIR-IIb fluorescence images compared with multiple existing methods.