Submitted by Vegetable-Skill-9700 t3_121a8p4 in MachineLearning
fiftyfourseventeen t1_jdngwum wrote
Reply to comment by wrossmorrow in [D] Do we really need 100B+ parameters in a large language model? by Vegetable-Skill-9700
Eh.... Not really, that's training a low rank representation of the model, not actually making it smaller.
Viewing a single comment thread. View all comments