TheTerrasque
TheTerrasque t1_j6ybrk0 wrote
Reply to comment by Nhabls in [N] Microsoft integrates GPT 3.5 into Teams by bikeskata
Well, you got deepmind's chinchilla model, and Google's CALM approach that can increase the speed of interference by maybe 3x - in addition to other tricks..
TheTerrasque t1_j5irq12 wrote
Reply to comment by andreichiffa in [D] Couldn't devs of major GPTs have added an invisible but detectable watermark in the models? by scarynut
On a side note, 7b isn't large these days.
GPT3 and BLOOMZ are around 175b parameters.
TheTerrasque t1_j4p9kk7 wrote
There is a project called Petals that have BLOOM running for everyone to use. It's distributing the model over many machines and thus allows it to run on consumer hardware. There is a PoC chat at http://chat.petals.ml/
They just converted BLOOMZ and is currently setting up a network for that. That should be more suited for a chat interface. There's still missing gpu's though, so would be great with some more servers if people got some spare compute.
TheTerrasque t1_jeenw8o wrote
Reply to comment by MrFlufypants in [D][N] LAION Launches Petition to Establish an International Publicly Funded Supercomputing Facility for Open Source Large-scale AI Research and its Safety by stringShuffle
Why do you mix openai into it?