Viewing a single comment thread. View all comments

Cryptizard t1_j8rxlsr wrote

Reply to comment by redditgollum in LLMs are not being used for what they are best at by Scarlet_pot2

But won't it still be pretty impossible for regular people to run? It is not like Stable Diffusion where you can do it on a GPU. The GPT models require hundreds of thousands of dollars worth of hardware.

2

alexiuss t1_j8s2o9g wrote

Nah,

Open assistant being made by stability and volunteers is a smaller model that will likely outcompete Bing due to no censorship. It will run on PCs.

You can run Pygmalion 6b model just fine on your PC or google collab. It's not as clever as Bing yet, but it's being trained. Connecting Pygmalion to a search engine backend will make it more intelligent and interesting.

3