Viewing a single comment thread. View all comments

limpbizkit4prez t1_itnoeqq wrote

I've always applied an annealing schedule like that to LMs. Imo, it works incredibly well and generalizes great

3