<p>The linearized alternating direction method of multipliers is a versatile tool for solving a wide range of constrained optimization problems. However, its performance depends strongly on the user-defined linearization parameter. We study the linearized alternating direction method of multipliers which boosts performance by adaptively tuning the linearization parameter to achieve fast convergence without user oversight. We provide theoretical conditions that guarantee convergence of the proposed algorithm under very general circumstances and present a worst-case <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\mathcal {O}(1/k)\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mi mathvariant="script">O</mi> <mo stretchy="false">(</mo> <mn>1</mn> <mo stretchy="false">/</mo> <mi>k</mi> <mo stretchy="false">)</mo> </mrow> </math></EquationSource> </InlineEquation> convergence rate result in both ergodic and non-ergodic senses for the proposed algorithm, where <i>k</i> is the iteration counter. Numerical results on several applications in medical image processing demonstrate its fast practical convergence.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Linearized Alternating Direction Method of Multipliers with Adaptive Stepsize

  • Do Sang Kim,
  • Xinxin Li,
  • Xiaoya Zhang

摘要

The linearized alternating direction method of multipliers is a versatile tool for solving a wide range of constrained optimization problems. However, its performance depends strongly on the user-defined linearization parameter. We study the linearized alternating direction method of multipliers which boosts performance by adaptively tuning the linearization parameter to achieve fast convergence without user oversight. We provide theoretical conditions that guarantee convergence of the proposed algorithm under very general circumstances and present a worst-case \(\mathcal {O}(1/k)\) O ( 1 / k ) convergence rate result in both ergodic and non-ergodic senses for the proposed algorithm, where k is the iteration counter. Numerical results on several applications in medical image processing demonstrate its fast practical convergence.