<p>The fused lasso method has emerged as crucial for variable selection in high-dimensional linear regression. It can effectively deal with the case where adjacent variables exhibit strong correlation and gain sparse solutions under the Gaussian noise. However, it exhibits poor robustness in scenarios involving non-Gaussian noise, especially in heavy-tail distributions. Moreover, comparing to use a convex relaxation with the <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>-norm, the near unbiasedness of sparse solutions can be enhanced by employing appropriate nonconvex regularization. In this paper, we preserve the structural features of the fused lasso by proposing a robust fused lasso model with <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\ell _1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>ℓ</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation>-norm loss function and doubly nonconvex regularizers. Furthermore, we develop a customized three-block Bregman alternating direction method of multipliers (ADMM) to effectively solve the proposed model, and provide the convergence analysis for the developed algorithm under some mild conditions. Theoretically, we present a smoothing technique for nonconvex regularizers to expand the choice space. This approach aims to ensure the convergence guarantees of the three-block Bregman ADMM. Extensive experiments demonstrate both the robustness of the proposed model and the effectiveness of the developed algorithm.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Bregman ADMM for Robust Fused Lasso Estimation with Doubly Nonconvex Regularizers

  • Yibao Fan,
  • Zheng-Fen Jin,
  • Youlin Shang,
  • Deren Han

摘要

The fused lasso method has emerged as crucial for variable selection in high-dimensional linear regression. It can effectively deal with the case where adjacent variables exhibit strong correlation and gain sparse solutions under the Gaussian noise. However, it exhibits poor robustness in scenarios involving non-Gaussian noise, especially in heavy-tail distributions. Moreover, comparing to use a convex relaxation with the \(\ell _1\) 1 -norm, the near unbiasedness of sparse solutions can be enhanced by employing appropriate nonconvex regularization. In this paper, we preserve the structural features of the fused lasso by proposing a robust fused lasso model with \(\ell _1\) 1 -norm loss function and doubly nonconvex regularizers. Furthermore, we develop a customized three-block Bregman alternating direction method of multipliers (ADMM) to effectively solve the proposed model, and provide the convergence analysis for the developed algorithm under some mild conditions. Theoretically, we present a smoothing technique for nonconvex regularizers to expand the choice space. This approach aims to ensure the convergence guarantees of the three-block Bregman ADMM. Extensive experiments demonstrate both the robustness of the proposed model and the effectiveness of the developed algorithm.