1 code implementation • 31 Aug 2021 • Maximus Mutschler, Kevin Laube, Andreas Zell
In the experiments conducted, our approach is on par with SGD with Momentum tuned with a piece-wise constant learning rate schedule and often outperforms other line search approaches for Deep Learning across models, datasets, and batch sizes on validation and test accuracy.
