<p>In recent years, the pyramid-based encoder-decoder network architecture has become a popular solution to the problem of large deformation image registration due to its excellent multi-scale deformation field prediction ability. However, there are two main limitations in existing research: one is that it over-focuses on the fusion of multi-layer deformation sub-fields on the decoding path, while ignoring the impact of feature encoders on network performance; the other is the lack of specialized design for the characteristics of feature maps at different scales. To this end, we propose an innovative hybrid Transformer and convolution iteratively optimized pyramid network for large deformation brain image registration. Specifically, four encoder variants are designed to study the impact of different structures on the performance of the pyramid registration network. Secondly, the Swin-Transformer module is combined with the convolution iterative strategy, and each layer of the decoder is carefully designed according to the semantic information characteristics of different decoding layers. Extensive experimental results on three public brain magnetic resonance imaging datasets show that our method has the highest registration accuracy compared with 9 cutting-edge registration methods, which fully verifies the effectiveness and application potential of our model design.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hybrid transformer and convolution iteratively optimized pyramid network for brain large deformation image registration

  • Xinxin Cui,
  • Yuee Zhou,
  • Caihong Wei,
  • Guodong Suo,
  • Fengqing Jin,
  • Jianlan Yang

摘要

In recent years, the pyramid-based encoder-decoder network architecture has become a popular solution to the problem of large deformation image registration due to its excellent multi-scale deformation field prediction ability. However, there are two main limitations in existing research: one is that it over-focuses on the fusion of multi-layer deformation sub-fields on the decoding path, while ignoring the impact of feature encoders on network performance; the other is the lack of specialized design for the characteristics of feature maps at different scales. To this end, we propose an innovative hybrid Transformer and convolution iteratively optimized pyramid network for large deformation brain image registration. Specifically, four encoder variants are designed to study the impact of different structures on the performance of the pyramid registration network. Secondly, the Swin-Transformer module is combined with the convolution iterative strategy, and each layer of the decoder is carefully designed according to the semantic information characteristics of different decoding layers. Extensive experimental results on three public brain magnetic resonance imaging datasets show that our method has the highest registration accuracy compared with 9 cutting-edge registration methods, which fully verifies the effectiveness and application potential of our model design.