1 code implementation • 30 Jan 2024 • Lianbo Ma, Yuee Zhou, Jianlun Ma, Guo Yu, Qing Li
During the gradient descent learning, a one-step forward search is designed to find the trial gradient of the next-step, which is adopted to adjust the gradient of current step towards the direction of fast convergence.