<p>It is well-known that appropriately determining the solution space and initializations is crucial for obtaining high-quality optimal solutions for optimization problems, considering both gradient-based and gradient-free techniques. However, the general framework for adaptively dealing with a particular optimization problem is commonly overlooked and thus still hidden in the literature. To overcome this limitation, a new approach assisted by the neural network (NN) is proposed for solving high-dimensional optimization issues. By restructuring the search space to optimize the objective function via a nonlinear mapping constructed by an autoencoder (AE), the surrogate solution space is constructed by a network training process and dynamically oriented to the optimal solution of the optimization issue. To enhance the optimization efficiency and address non-smooth problems, the classical metaheuristic grey wolf optimizer (GWO) and the adaptive moment estimation (Adam) are sequentially employed to complement the disadvantages of the constituted models. The effectiveness of the proposed approach is validated by solving a set of mathematical functions with 1 000-dimensional and three large-scale truss design optimization problems. Several numerical experiments show that the solution space is reduced in terms of both size and complexity based on the restructuring procedure, in which the global optimal solution is still conserved, leading to better optimization efficiency when solving optimization problems with complex search domains with large dimensions. In addition, the hybrid optimizer has also been proven to be more effective when combined with the restructuring technique owing to the use of the Adam algorithm in the second phase.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Solving high-dimensional global optimization problems via solution space restructuring with neural network

  • N. Vo,
  • T. Le-Duc,
  • H. Tang,
  • H. Nguyen-Xuan,
  • S. H. Lee,
  • J. H. Lee

摘要

It is well-known that appropriately determining the solution space and initializations is crucial for obtaining high-quality optimal solutions for optimization problems, considering both gradient-based and gradient-free techniques. However, the general framework for adaptively dealing with a particular optimization problem is commonly overlooked and thus still hidden in the literature. To overcome this limitation, a new approach assisted by the neural network (NN) is proposed for solving high-dimensional optimization issues. By restructuring the search space to optimize the objective function via a nonlinear mapping constructed by an autoencoder (AE), the surrogate solution space is constructed by a network training process and dynamically oriented to the optimal solution of the optimization issue. To enhance the optimization efficiency and address non-smooth problems, the classical metaheuristic grey wolf optimizer (GWO) and the adaptive moment estimation (Adam) are sequentially employed to complement the disadvantages of the constituted models. The effectiveness of the proposed approach is validated by solving a set of mathematical functions with 1 000-dimensional and three large-scale truss design optimization problems. Several numerical experiments show that the solution space is reduced in terms of both size and complexity based on the restructuring procedure, in which the global optimal solution is still conserved, leading to better optimization efficiency when solving optimization problems with complex search domains with large dimensions. In addition, the hybrid optimizer has also been proven to be more effective when combined with the restructuring technique owing to the use of the Adam algorithm in the second phase.