<p>We propose two nonmonotone retraction-based proximal gradient methods for solving a class of nonconvex nonsmooth optimization problems over the Stiefel manifold. The proposed methods are equipped with the descent direction obtained by a proximal mapping restricted in tangent space of the manifold and the Barzilai-Borwein stepsizes determined by two recent iteration points and the corresponding descent directions. By employing, respectively, the Grippo-Lampariello-Lucidi nonmonotone line search strategy and the Dai-Fletcher nonmonotone line search strategy, our proposed methods are proved to be globally convergent. Analysis on the iteration complexity for obtaining an ϵ-stationary solution is provided. Numerical results on the sparse principle component analysis problems demonstrate the efficiency of our methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Two Nonmonotone Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold

  • Jin-chao Zhang,
  • Juan Gao,
  • Ya-kui Huang,
  • Xin-wei Liu

摘要

We propose two nonmonotone retraction-based proximal gradient methods for solving a class of nonconvex nonsmooth optimization problems over the Stiefel manifold. The proposed methods are equipped with the descent direction obtained by a proximal mapping restricted in tangent space of the manifold and the Barzilai-Borwein stepsizes determined by two recent iteration points and the corresponding descent directions. By employing, respectively, the Grippo-Lampariello-Lucidi nonmonotone line search strategy and the Dai-Fletcher nonmonotone line search strategy, our proposed methods are proved to be globally convergent. Analysis on the iteration complexity for obtaining an ϵ-stationary solution is provided. Numerical results on the sparse principle component analysis problems demonstrate the efficiency of our methods.