Stochastic Optimization

GeneralOptimization • 62 methods

Stochastic Optimization methods are used to optimize neural networks. We typically take a mini-batch of data, hence 'stochastic', and perform a type of gradient descent with this minibatch. Below you can find a continuously updating list of stochastic optimization algorithms.

Subcategories

Method Year Papers
2014 17132
1951 1732
2018 571
2013 425
2019 177
2011 164
2017 145
1999 141
2016 137
2021 129
2020 91
2014 90
2017 66
2018 58
2019 49
2019 47
2016 41
2020 38
2018 36
2017 30
2021 27
1983 27
2019 25
2020 18
2019 16
2000 15
2012 15
2019 11
2000 10
2016 10
2019 10
2022 9
2021 9
2014 8
2017 6
2019 5
2021 4
2015 4
2018 3
2019 3
2022 2
2021 2
2018 2
1991 2
2020 2
2019 1
2019 1
2023 1
2022 1
2019 1
2019 1
2022 1
2021 1
2017 1
2019 1
2017 1
2018 1
2021 1
2021 1
2018 1
2000 0