<p>In this paper, we study a class of constrained group sparse <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\ell _0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation> regularized optimization problems, where the loss function is convex but nonsmooth and the feasible set is defined by box constraints. First, we propose a smoothing proximal gradient block-coordinate (SPGBC) algorithm, which is a novel combination of the proximal gradient block-coordinate algorithm and the smoothing method. We prove that any accumulation point of the iterates generated by it is a local minimizer of the considered problem and its zero entries can be identified in finite iterations. Moreover, we show that the proposed SPGBC algorithm achieves a local convergence rate of <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(\mathcal {O}(k^{-(1-\nu )})\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="script">O</mi> <mo stretchy="false">(</mo> <msup> <mi>k</mi> <mrow> <mo>-</mo> <mo stretchy="false">(</mo> <mn>1</mn> <mo>-</mo> <mi>ν</mi> <mo stretchy="false">)</mo> </mrow> </msup> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> on the objective function value, where <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(\nu \in (\frac{1}{2},1)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi>ν</mi> <mo>∈</mo> <mo stretchy="false">(</mo> <mfrac> <mn>1</mn> <mn>2</mn> </mfrac> <mo>,</mo> <mn>1</mn> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> comes from the decay exponent of the smoothing parameter. Second, we consider a randomized variant of the SPGBC algorithm, the R-SPGBC algorithm, and obtain that the iterates generated by it converge to a subset of local minimizers of the original problem with probability 1. In addition, we establish that the R-SPGBC algorithm attains a sublinear convergence rate in expectation. Finally, some numerical examples are performed to show the efficiency of the proposed algorithms.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Smoothing Proximal Gradient Block-coordinate Algorithms for Group Sparse \(\ell _0\) Regularized Nonsmooth Convex Regression Problem

  • Xue Li,
  • Wei Bian

摘要

In this paper, we study a class of constrained group sparse \(\ell _0\) 0 regularized optimization problems, where the loss function is convex but nonsmooth and the feasible set is defined by box constraints. First, we propose a smoothing proximal gradient block-coordinate (SPGBC) algorithm, which is a novel combination of the proximal gradient block-coordinate algorithm and the smoothing method. We prove that any accumulation point of the iterates generated by it is a local minimizer of the considered problem and its zero entries can be identified in finite iterations. Moreover, we show that the proposed SPGBC algorithm achieves a local convergence rate of \(\mathcal {O}(k^{-(1-\nu )})\) O ( k - ( 1 - ν ) ) on the objective function value, where \(\nu \in (\frac{1}{2},1)\) ν ( 1 2 , 1 ) comes from the decay exponent of the smoothing parameter. Second, we consider a randomized variant of the SPGBC algorithm, the R-SPGBC algorithm, and obtain that the iterates generated by it converge to a subset of local minimizers of the original problem with probability 1. In addition, we establish that the R-SPGBC algorithm attains a sublinear convergence rate in expectation. Finally, some numerical examples are performed to show the efficiency of the proposed algorithms.