Deploying efficient machine learning models, particularly deep neural networks, is critical for edge-ready AI applications, e.g., for detecting persons in office rooms, which is a relevant task in building automation. These models aim to achieve a trade-off between complexity and performance. We apply and evaluate three key approaches to achieve this balance: neural network architecture search, post-training quantization methods, and mixed precision training for deep neural network models. In addition, we compare the outcome of these methods with classical machine learning techniques, such as Support Vector Machines and Random Forest. The results demonstrate that mixed-precision training balances model accuracy and complexity well. In contrast, post-training quantization methods significantly reduce model complexity but at the cost of decreased model accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Evaluation of Efficient AI for the Edge: Insights from Deep Neural Networks Model Compression Techniques Applied to Occupancy Detection

  • Mina Basirat,
  • Franz Wotawa

摘要

Deploying efficient machine learning models, particularly deep neural networks, is critical for edge-ready AI applications, e.g., for detecting persons in office rooms, which is a relevant task in building automation. These models aim to achieve a trade-off between complexity and performance. We apply and evaluate three key approaches to achieve this balance: neural network architecture search, post-training quantization methods, and mixed precision training for deep neural network models. In addition, we compare the outcome of these methods with classical machine learning techniques, such as Support Vector Machines and Random Forest. The results demonstrate that mixed-precision training balances model accuracy and complexity well. In contrast, post-training quantization methods significantly reduce model complexity but at the cost of decreased model accuracy.