<p>The sparse linear reconstruction problem is a core problem in signal processing which aims to recover sparse solutions to linear systems. The original problem regularized by the total number of nonzero components (also known as <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(L_0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation> regularization) is well-known to be NP-hard. The relaxation of the <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(L_0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation> regularization by using the <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(L_1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation> norm offers a convex reformulation, but is only exact under certain conditions (e.g., restricted isometry property) which might be NP-hard to verify. To overcome the computational hardness of the <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(L_0\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>0</mn> </msub> </math></EquationSource> </InlineEquation> regularization problem while providing tighter results than the <InlineEquation ID="IEq7"> <EquationSource Format="TEX">\(L_1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation> relaxation, several alternate optimization problems have been proposed to find sparse solutions. One such problem is the <InlineEquation ID="IEq8"> <EquationSource Format="TEX">\(L_1-L_2\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>L</mi> <mn>1</mn> </msub> <mo>-</mo> <msub> <mi>L</mi> <mn>2</mn> </msub> </mrow> </math></EquationSource> </InlineEquation> minimization problem, which is to minimize the difference of the <InlineEquation ID="IEq9"> <EquationSource Format="TEX">\(L_1\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>1</mn> </msub> </math></EquationSource> </InlineEquation> and <InlineEquation ID="IEq10"> <EquationSource Format="TEX">\(L_2\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mn>2</mn> </msub> </math></EquationSource> </InlineEquation> norms subject to linear constraints. This paper proves that solving the <InlineEquation ID="IEq11"> <EquationSource Format="TEX">\(L_1-L_2\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>L</mi> <mn>1</mn> </msub> <mo>-</mo> <msub> <mi>L</mi> <mn>2</mn> </msub> </mrow> </math></EquationSource> </InlineEquation> minimization problem is NP-hard. Specifically, we prove that it is NP-hard to minimize the <InlineEquation ID="IEq12"> <EquationSource Format="TEX">\(L_1-L_2\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>L</mi> <mn>1</mn> </msub> <mo>-</mo> <msub> <mi>L</mi> <mn>2</mn> </msub> </mrow> </math></EquationSource> </InlineEquation> regularization function subject to linear constraints. Moreover, it is also NP-hard to solve the unconstrained formulation that minimizes the sum of a least squares term and the <InlineEquation ID="IEq13"> <EquationSource Format="TEX">\(L_1-L_2\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msub> <mi>L</mi> <mn>1</mn> </msub> <mo>-</mo> <msub> <mi>L</mi> <mn>2</mn> </msub> </mrow> </math></EquationSource> </InlineEquation> regularization function. Furthermore, restricting the feasible set to a smaller one by adding nonnegative constraints does not change the NP-hardness nature of the problems.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

On the Hardness of the \(L_{1}-L_{2}\) Regularization Problem

  • Yuyuan Ouyang,
  • Kyle Yates

摘要

The sparse linear reconstruction problem is a core problem in signal processing which aims to recover sparse solutions to linear systems. The original problem regularized by the total number of nonzero components (also known as \(L_0\) L 0 regularization) is well-known to be NP-hard. The relaxation of the \(L_0\) L 0 regularization by using the \(L_1\) L 1 norm offers a convex reformulation, but is only exact under certain conditions (e.g., restricted isometry property) which might be NP-hard to verify. To overcome the computational hardness of the \(L_0\) L 0 regularization problem while providing tighter results than the \(L_1\) L 1 relaxation, several alternate optimization problems have been proposed to find sparse solutions. One such problem is the \(L_1-L_2\) L 1 - L 2 minimization problem, which is to minimize the difference of the \(L_1\) L 1 and \(L_2\) L 2 norms subject to linear constraints. This paper proves that solving the \(L_1-L_2\) L 1 - L 2 minimization problem is NP-hard. Specifically, we prove that it is NP-hard to minimize the \(L_1-L_2\) L 1 - L 2 regularization function subject to linear constraints. Moreover, it is also NP-hard to solve the unconstrained formulation that minimizes the sum of a least squares term and the \(L_1-L_2\) L 1 - L 2 regularization function. Furthermore, restricting the feasible set to a smaller one by adding nonnegative constraints does not change the NP-hardness nature of the problems.