Conventional error-tolerant strategies for neural networks often rely on redundancy or invasive modifications to normal operation, making them unsuitable for large-scale machine learning (ML) systems composed of complex networks. This paper proposes two complementary perturbation-based solutions that reuse the inference process for cost-effective reliability: Perturbation-Based Error Detection and Correction (PBEDC), which monitors a small set of intermediate “check nodes” and can correct single-bit flips when combined with parity codes, and Concurrent Classifier Error Detection (CCED), which employs a lightweight auxiliary classifier to detect faults in real-time. Evaluations on a Contrastive Language-Image Pre-training (CLIP) model show that PBEDC achieves detection rates exceeding 95% with minimal hardware overhead and scales effectively with network size, while CCED similarly identifies most errors under modest re-computation budgets and imposes negligible runtime cost. These techniques offer a scalable and low-cost framework for dependable operation in contemporary large-scale ML systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Perturbation-Based Error Tolerance for Large-Scale Networks

  • Ziheng Wang,
  • Pedro Reviriego,
  • Shanshan Liu,
  • Farzad Niknia,
  • Álvaro Alonso,
  • Zhen Gao,
  • Fabrizio Lombardi

摘要

Conventional error-tolerant strategies for neural networks often rely on redundancy or invasive modifications to normal operation, making them unsuitable for large-scale machine learning (ML) systems composed of complex networks. This paper proposes two complementary perturbation-based solutions that reuse the inference process for cost-effective reliability: Perturbation-Based Error Detection and Correction (PBEDC), which monitors a small set of intermediate “check nodes” and can correct single-bit flips when combined with parity codes, and Concurrent Classifier Error Detection (CCED), which employs a lightweight auxiliary classifier to detect faults in real-time. Evaluations on a Contrastive Language-Image Pre-training (CLIP) model show that PBEDC achieves detection rates exceeding 95% with minimal hardware overhead and scales effectively with network size, while CCED similarly identifies most errors under modest re-computation budgets and imposes negligible runtime cost. These techniques offer a scalable and low-cost framework for dependable operation in contemporary large-scale ML systems.