Viewing a single comment thread. View all comments

new_name_who_dis_ t1_j5oix1c wrote

Fine tuning isn’t any different than just training…? You just don’t start with random network, but fine tuning doesn’t really have anything different besides that and the size of the dataset

1

SimonJDPrince OP t1_j5olux3 wrote

That was kind of my impression. And I do discuss this in the chapters on transformers and regularization. Was wondering if there is more to it.

3