<p>In this paper, we consider the composite optimization problem, where the objective function integrates a continuously differentiable loss function with a nonsmooth regularization term. Moreover, only the function values for the differentiable part of the objective function are available in solving that composite optimization problem. To efficiently solve this composite optimization problem, we propose a preconditioned zeroth-order proximal gradient (ZOPG) method in which the gradients and preconditioners are estimated by finite-difference schemes based on the function values at the same trial points. We establish the global convergence and worst-case complexity for our proposed method. Numerical experiments exhibit the advantage of our developed method.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Inexact Preconditioned Zeroth-Order Proximal Method for Composite Optimization

  • Shang-Lin Liu,
  • Lei Wang,
  • Na-Chuan Xiao,
  • Xin Liu

摘要

In this paper, we consider the composite optimization problem, where the objective function integrates a continuously differentiable loss function with a nonsmooth regularization term. Moreover, only the function values for the differentiable part of the objective function are available in solving that composite optimization problem. To efficiently solve this composite optimization problem, we propose a preconditioned zeroth-order proximal gradient (ZOPG) method in which the gradients and preconditioners are estimated by finite-difference schemes based on the function values at the same trial points. We establish the global convergence and worst-case complexity for our proposed method. Numerical experiments exhibit the advantage of our developed method.