On the Potentials of Input Repetition in CNN Networks for Reducing Multiplications
摘要
Convolutional Neural Networks (CNN) are composed of hundreds of millions of dot operations, leading to the emergence of new algorithms to reduce the high computational complexity. This paper introduces input repetition: a new solution to reduce the number of operations of previous quantized CNN models without degrading the accuracy. The input repetition occurs when several identical elements are found in a group of input activations, allowing the reduction of the number of multipliers required to perform the dot operation needed in the convolutional layers. This paper analyzes several strategies to find repetition in the convolution input using quantized state-of-the-art CNN: YoloV3, MobileNET and ResNet50. Results show that input repetition can reduce multiplications by a factor of 2.4x without any performance impact.