Multi-point Directional Minimization for Conjugate Gradient Algorithm
摘要
The conjugate gradient (CG) algorithm is a widely used approach for training neural networks. Its most computationally demanding step is directional minimization. This paper introduces a novel modification of the CG algorithm that accelerates directional minimization, leading to a significant reduction in computation time. The proposed modification was evaluated on selected test cases, and its performance was compared with the classical CG method.