Viewing a single comment thread. View all comments

029187 OP t1_iqpigzv wrote on October 2, 2022 at 3:42 AM

Reply to comment by Red-Portal in [Discussion] If we had enough memory to always do full batch gradient descent, would we still need rmsprop/momentum/adam? by 029187

ah cool! do you have any links to papers on the topic? i'd love to read them!

Red-Portal t1_iqpipq6 wrote on October 2, 2022 at 3:45 AM

I think it was this one: https://arxiv.org/abs/2103.17182

029187 OP t1_iqrihvc wrote on October 2, 2022 at 4:01 PM

thanks!!