genuinelySurprised

genuinelySurprised OP t1_j02iznh wrote on December 13, 2022 at 4:54 PM

Reply to comment by justheuristic in [D] Are there any distributed model training services similar to, e.g. Folding@Home? by genuinelySurprised

Thanks for this! I came across Petals, but it looked to be focused on model usage, not training, but didn't see that it used the hivemind library.

genuinelySurprised OP t1_j02iugf wrote on December 13, 2022 at 4:53 PM

Reply to comment by dojoteef in [D] Are there any distributed model training services similar to, e.g. Folding@Home? by genuinelySurprised

I figured there was some technical catch related to scaling. It's a pity there's no way (yet) to put together a truly-open competitor to GPT3 and whatever comes after it.