Quantization-Aided Cost-Efficient Reliability of CNN Accelerators for Edge AI
摘要
The main research and engineering challenges for the dependability of edge AI chips stem from the limited computing and energy resources of these devices. The chapter presents techniques for cost-efficient enhancement of reliability in deep learning accelerators. First, we study the potential of homogeneous quantization of CNNs for enabling a negative-memory overhead fault tolerance. Further, we explore a layer vulnerability-aware heterogeneous quantization and dynamic input-aware quantization to adapt precision on the fly during runtime. The released computation resources are allocated for fault tolerance through duplication and triplication.