ViT-KANMoE: a vision transformer enhanced with a pure Kolmogorov–Arnold network-based mixture-of-experts for malaria blood smear image classification
摘要
Early and accurate identification of malaria parasites in high-resolution microscopic blood smear images is critical for timely clinical intervention and effective disease control, especially in resource-constrained healthcare environments. This study presents a novel hybrid classification framework, Vision Transformer with Kolmogorov–Arnold Network-based Mixture of Experts (ViT-KANMoE), that strategically integrates self-attention-based global feature extraction, functional decomposition via learnable B-spline activations, and adaptive expert learning to enhance diagnostic precision. The Vision Transformer (ViT) component captures global spatial dependencies and contextual features from blood smear images, effectively encoding variations in cell morphology and parasite distribution. The Kolmogorov–Arnold Network (KAN) module is implemented as a Pure KAN formulation, in which all nonlinear transformations are performed exclusively through learnable cubic B-spline basis functions along network edges, with no fixed activation functions such as ReLU, GELU, or Mish. This design grounds the nonlinear transformations directly in the Kolmogorov–Arnold representation theorem, providing adaptive feature refinement through learnable B-spline edge functions. Subsequently, a Mixture of Experts (MoE) layer employs multiple specialized expert subnetworks, each a Pure KAN, that process the ViT features in parallel and map them directly to class logits, with outputs combined through uniform aggregation. A key finding of this work is that uniform expert aggregation, where all experts contribute equally, consistently outperforms attention-based gating (