- Article
A Novel Sine Step Size for Warm-Restart Stochastic Gradient Descent
- Mahsa Soheil Shamaee and
- Sajad Fathi Hafshejani
This paper proposes a novel sine step size for warm-restart stochastic gradient descent (SGD). For the SGD based on the new proposed step size, we establish convergence rates for smooth non-convex functions with and without the Polyak–Łoja...