[D] Nesterov as a special case of PID control? Submitted by cruddybanana1102 t3_zyclre on December 29, 2022 at 6:36 PM in MachineLearning 7 comments 21
resented_ape t1_j26ei9b wrote on December 30, 2022 at 12:02 AM The Quasi-Hyperbolic Momentum paper which attempts to generalize classical and Nesterov momentum discusses this in section 4.2. It references a blog post by Ben Recht. Permalink 5
Viewing a single comment thread. View all comments