Evolutionary neural architecture search based on a modified particle swarm optimization
摘要
In recent years, the emergence of neural architecture search (NAS) has brought a series of breakthroughs to the field of computer vision. However, existing NAS methods either overly focus on optimizing for classification accuracy, resulting in complex networks with excessive parameters and computational requirements, or use fixed search parameters, limiting search performance. To effectively evolve neural networks, this paper proposed a lightweight search algorithm (GS-NAS). Firstly, we introduced a novel search space based on MobileBlocks and ShuffleBlocks and we employed multi-objective optimization considering classification accuracy, parameters, and FLOPs (floating-point operations per second) during the search process. Secondly, we utilized particle swarm optimization (PSO) as the search strategy, and to enhance the global search capability of the particle swarm, we integrated concepts from Grey Wolf Optimization and cosine annealing into the PSO algorithm, introducing a series of improvements to the particle update rules. Validation on standard datasets demonstrated that the improved PSO exhibited stronger global search capabilities, achieving Pareto optimality in three-objective optimization compared to various state-of-the-art algorithms. Finally, to showcase the efficiency of the obtained networks, we utilized the searched network as the backbone to design an industrial defect detection network, which achieved a leading mean Average Precision (mAP) of 79.2