Viewing a single comment thread. View all comments

CKtalon t1_j16qtog wrote on December 22, 2022 at 1:55 AM

Reply to comment by caedin8 in [D] Running large language models on a home PC? by Zondartul

Training will at minimum need about 10x more resources than what I said (inferencing). And that’s just to fit the model and all its optimisation weights with batch size 1.