A Continuized View on Nesterov Acceleration

11 Feb 2021 Raphaël Berthier Francis Bach Nicolas Flammarion Pierre Gaillard Adrien Taylor

We introduce the "continuized" Nesterov acceleration, a close variant of Nesterov acceleration whose variables are indexed by a continuous time parameter. The two variables continuously mix following a linear ordinary differential equation and take gradient steps at random times... (read more)

PDF Abstract
No code implementations yet. Submit your code now

Categories


  • DISTRIBUTED, PARALLEL, AND CLUSTER COMPUTING
  • OPTIMIZATION AND CONTROL