Gradient Methods
摘要
We review the basic algorithms using the gradient direction for unconstrained QP problems, discuss their convergence in Euclidean and energy norm, and examine the effect of the steplength on their performance. We pay special attention to the possibility of enhancing the information from the previous step via the steplength (the Barizilai–Borwein method) or momentum (Polyak’s heavy ball method).