A randomized feasible algorithm for optimization with orthogonal constraints
摘要
In this paper, we propose a randomized feasible algorithm for optimization over the Stiefel manifold, where only some randomly chosen columns of the variable matrix are updated at each iteration. It is proved that the sequence of Riemannian gradients generated by the algorithm converges to zero with probability one. Numerical results show that the algorithm is efficient, especially for the problems when the matrices involved are sparse.