Edge AI has emerged recently as the industry tries to overcome the limitations of cloud-based AI, such as network latency, data security, and related costs. Enabling intelligence through processing directly at the data source will provide faster and more efficient industrial applications. However, embedded devices at the edge have less computing power and energy sources than servers in the cloud. For this reason, hardware accelerators for edge AI have been developed to provide additional computing power with low energy consumption. This article compares the performance and energy consumption of two commercially available AI accelerators with the embedded GPU, and factors affecting their performance are discussed.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Energy Consumption and Performance of AI Accelerators for Edge Devices

  • Minseon Kang,
  • Moonju Park

摘要

Edge AI has emerged recently as the industry tries to overcome the limitations of cloud-based AI, such as network latency, data security, and related costs. Enabling intelligence through processing directly at the data source will provide faster and more efficient industrial applications. However, embedded devices at the edge have less computing power and energy sources than servers in the cloud. For this reason, hardware accelerators for edge AI have been developed to provide additional computing power with low energy consumption. This article compares the performance and energy consumption of two commercially available AI accelerators with the embedded GPU, and factors affecting their performance are discussed.