genuinelySurprised OP t1_j02iznh wrote on December 13, 2022 at 4:54 PM Reply to comment by justheuristic in [D] Are there any distributed model training services similar to, e.g. Folding@Home? by genuinelySurprised Thanks for this! I came across Petals, but it looked to be focused on model usage, not training, but didn't see that it used the hivemind library. Permalink Parent 3
genuinelySurprised OP t1_j02iugf wrote on December 13, 2022 at 4:53 PM Reply to comment by dojoteef in [D] Are there any distributed model training services similar to, e.g. Folding@Home? by genuinelySurprised I figured there was some technical catch related to scaling. It's a pity there's no way (yet) to put together a truly-open competitor to GPT3 and whatever comes after it. Permalink Parent 1
[D] Are there any distributed model training services similar to, e.g. Folding@Home? Submitted by genuinelySurprised t3_zky7ly on December 13, 2022 at 3:18 PM in MachineLearning 9 comments 6
genuinelySurprised OP t1_j02iznh wrote
Reply to comment by justheuristic in [D] Are there any distributed model training services similar to, e.g. Folding@Home? by genuinelySurprised
Thanks for this! I came across Petals, but it looked to be focused on model usage, not training, but didn't see that it used the hivemind library.