Supporting in-Sensor Computing with Hardware-Aware Neural Architecture Search
摘要
Hardware-aware neural architecture search (HW-NAS) is a powerful tool for the automatic design of tiny neural architectures able to fit the tight memory constraints of commodity electronics, like microcontroller units (MCU). However, new sensors equipped with neural processing units (NPUs) are reaching the market. In contrast to common MCUs, NPUs often do not feature the traditional division of the memory constraint between RAM and Flash usage. This is an issue for state-of-the-art HW-NAS, which are designed to fit the two constraints distinctly. This work proposes a novel HW-NAS for designing tiny Convolutional Neural Networks (CNNs) that can effectively deal with NPUs, achieving state-of-the-art results in just 5 h and 48 min on the Visual Wake Words dataset, a tinyML benchmark.