Precise nuclei segmentation is crucial in histopathology but remains challenging due to variable tissue types, staining protocols, and imaging conditions. Traditional deep neural networks often perform inconsistently when presented with data distributions not seen during training. Existing approaches typically process multi-scale features sequentially but lack mechanisms to explicitly enforce robustness against distribution shifts. To address this, we propose a novel framework that integrates hierarchical feature learning with associative memory to enhance model adaptability. First, we extract multi-layer embeddings from an image encoder, then process them in reverse layer order (from deepest to shallowest) using Liquid Neural Network (LNN). This design allows the model to capture global features initially and then refine them with increasingly localized information. The image encoding and the LNN encoding is then concatenated in hidden space and passed through Hopfield layer that stabilizes and stores relevant patterns. This effectively enhances domain-invariant representations by filtering out spurious correlations. Our OOD experiments on nuclei segmentation benchmark datasets show that our approach achieves average improvement of 16.35% over baseline models. Our code will be released at https://github.com/CVPR-KIT/OOD-Nuclei-Segmentation-via-LNNs-with-MHN .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Out-of-Distribution Nuclei Segmentation in Histology Imaging via Liquid Neural Networks with Modern Hopfield Layer

  • Bishal Ranjan Swain,
  • Kyung Joo Cheoi,
  • Jaepil Ko

摘要

Precise nuclei segmentation is crucial in histopathology but remains challenging due to variable tissue types, staining protocols, and imaging conditions. Traditional deep neural networks often perform inconsistently when presented with data distributions not seen during training. Existing approaches typically process multi-scale features sequentially but lack mechanisms to explicitly enforce robustness against distribution shifts. To address this, we propose a novel framework that integrates hierarchical feature learning with associative memory to enhance model adaptability. First, we extract multi-layer embeddings from an image encoder, then process them in reverse layer order (from deepest to shallowest) using Liquid Neural Network (LNN). This design allows the model to capture global features initially and then refine them with increasingly localized information. The image encoding and the LNN encoding is then concatenated in hidden space and passed through Hopfield layer that stabilizes and stores relevant patterns. This effectively enhances domain-invariant representations by filtering out spurious correlations. Our OOD experiments on nuclei segmentation benchmark datasets show that our approach achieves average improvement of 16.35% over baseline models. Our code will be released at https://github.com/CVPR-KIT/OOD-Nuclei-Segmentation-via-LNNs-with-MHN .