Viewing a single comment thread. View all comments

abstract000 t1_jbfcydi wrote

You will not be able to train huge models like ViT or BERT from scratch, but for fine tuning a 4090 is waaaaaaay enough. Even with my 2080Ti I achieve really fine results with a decent amount of time.

Your best friend is Huggingface, because transformer are life with a nice GPU

With your new config here would be my first try:

  • ViT
  • BERT
  • Donut because it's hell of a thing
  • Everything you can find on huggingface and makes you curious
2