learningmoreandmore OP t1_j3l4cu0 wrote on January 9, 2023 at 8:34 AM

Reply to comment by LetterRip in [D] I want to use GPT-J-6B for my story-writing project but I have a few questions about it. by learningmoreandmore

Thanks! Would this be able to scale and handle more computations or is this only for personal use? I wonder why most people wouldn't be using this version if it's so efficient computation-wise

mr_birrd t1_j3l7rjf wrote on January 9, 2023 at 9:21 AM

Cause it is worse metric wise.

LetterRip t1_j3meu7o wrote on January 9, 2023 at 4:08 PM

Same license as the 32 bit version so commercial usage is fine (apache-2.0 - see the page for details) Should give similar results and scaling (according to the link above is 1-10% slower inference).