Yahentamitsi t1_j9xi4q4 wrote
Reply to comment by FluffyVista in [D] 14.5M-15M is the smallest number of parameters I could find for current pretrained language models. Are there any that are smaller? by Seankala
That's a good question! I'm not sure if there are any pretrained language models with fewer parameters, but you could always try training your own model from scratch and see how small you can get it.
Viewing a single comment thread. View all comments