Optimality conditions for penalized sparse PCA

期刊论文
出版模式：

开放获取
发表日期：

2025年9月19日

查看全文

Rosember Guerra-Urzola,
Juan C. Vera,
Katrijn Van Deun

摘要

This paper establishes the theoretical foundations of an alternating optimization scheme for penalized sparse principal component analysis (PCA) focusing on variance maximization. We provide a theoretical foundation for the optimality of solutions derived from this widely used algorithm, addressing a gap in the current literature where empirical results often lack theoretical support. We show the algorithm’s success when the dataset’s covariance matrix is positive definite. Additionally, we characterize sparsity-inducing penalties and examine the use of various ones, including the $ \ell _1$ $ℓ_{1}$ -norm, SCAD, and $\ell _0$ $ℓ_{0}$ -norm. We conduct numerical experiments to evaluate standard metrics, such as explained variance, number of iterations, and computational time.