<p>This study proposes a dual-branch framework for precise classification of breast tumor cellularity via histopathological images where it integrates two distinct branches: the Embedding Extraction Branch (embedding-driven) and the Vision Classification Branch (vision-based). The Embedding Extraction Branch uses the Virchow2 transformation to generate dense, structured embeddings, whereas the Vision Classification Branch employs Nomic AI Embedded Vision v1.5 to process image patches and produce classification logits. Both branches’ outputs are combined to form the final classification. The framework also suggests Knowledge Block with fully connected layers, batch normalization, and dropout to improve feature extraction and reduce overfitting. The proposed approach reports high performance metrics, with an accuracy of <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(97.86\%\)</EquationSource> </InlineEquation>, specificity of <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(99.29\%\)</EquationSource> </InlineEquation>, and sensitivity, precision, and F1 score of <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(97.86\%\)</EquationSource> </InlineEquation>. Also, ablation studies show the mandatory role of the embedding extraction branch; as its removal drastically reduces accuracy to <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(25\%\)</EquationSource> </InlineEquation>. Furthermore, the Vision Classification Branch contributes significantly and its removal aims to a smaller decrease in the accuracy performance (<InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(95.75\%\)</EquationSource> </InlineEquation>). Additionally, data augmentation improves model performance and its exclusion results in a notable decline in accuracy performance (<InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(89.37\%\)</EquationSource> </InlineEquation>). The approach’s robustness is validated through statistical analysis that reports low variance and high consistency across multiple performance metrics.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Embedding-driven dual-branch approach for accurate breast tumor cellularity classification

  • Hossam Magdy Balaha,
  • Ali Mahmoud,
  • Khadiga M. Ali,
  • Mohammed Ghazal,
  • Norah Saleh Alghamdi,
  • Ashraf Khalil,
  • Ayman El-Baz

摘要

This study proposes a dual-branch framework for precise classification of breast tumor cellularity via histopathological images where it integrates two distinct branches: the Embedding Extraction Branch (embedding-driven) and the Vision Classification Branch (vision-based). The Embedding Extraction Branch uses the Virchow2 transformation to generate dense, structured embeddings, whereas the Vision Classification Branch employs Nomic AI Embedded Vision v1.5 to process image patches and produce classification logits. Both branches’ outputs are combined to form the final classification. The framework also suggests Knowledge Block with fully connected layers, batch normalization, and dropout to improve feature extraction and reduce overfitting. The proposed approach reports high performance metrics, with an accuracy of \(97.86\%\) , specificity of \(99.29\%\) , and sensitivity, precision, and F1 score of \(97.86\%\) . Also, ablation studies show the mandatory role of the embedding extraction branch; as its removal drastically reduces accuracy to \(25\%\) . Furthermore, the Vision Classification Branch contributes significantly and its removal aims to a smaller decrease in the accuracy performance ( \(95.75\%\) ). Additionally, data augmentation improves model performance and its exclusion results in a notable decline in accuracy performance ( \(89.37\%\) ). The approach’s robustness is validated through statistical analysis that reports low variance and high consistency across multiple performance metrics.