Viewing a single comment thread. View all comments

Nico_ t1_j9jd8d4 wrote

Reply to comment by Ylsid in What. The. ***k. [less than 1B parameter model outperforms GPT 3.5 in science multiple choice questions] by Destiny_Knight

If AIs can be optimzed to run on a single graphics cards there is no controlling this.

28

Ylsid t1_j9jeu7o wrote

I just hope stable diffusion isn't a one off

12

Queue_Bit t1_j9jt52q wrote

All it takes is one smart, slightly motivated person to make a free option that's "good enough"

15

Ylsid t1_j9jtgcg wrote

More than one. It takes a lot of skill, time and money, which are hard to come by if you aren't a megacorp. That isn't to say it can't happen, but that it's much more difficult than you may expect.

3

Queue_Bit t1_j9jtl2t wrote

Yeah In 2023

4

Ylsid t1_j9jzkr4 wrote

Exactly. It's very difficult to get the lead on megacorps is my point.

1

WithoutReason1729 t1_j9jx2u1 wrote

Language models seem to be a way steeper difficulty curve though. The difference between Stable Diffusion and image generators from like a few years before it is big, but the older models are still good enough to often produce viable output. But the difference between a huge language model and a large open-source one is a way bigger gap, because even getting small things wrong can lead to completely unintelligible sentences that were clearly written by a machine.

3

Queue_Bit t1_j9jyddi wrote

Yeah, for sure, but as technology improves it's just going to get easier and easier. And this technology is likely to get so good that to a normal person, the difference between the best and the world and "good enough for everyday life" is likely huge.

1

ToHallowMySleep t1_j9jvphi wrote

It already runs happily on last-gen hardware. I've been running it on my 10GB 3080.

2

walkarund t1_j9k92lw wrote

It doesn't even have to be last-gen. It works well on my 4gb GTX 970 with 8gb of ram, it is very impressive how optimized it is

3

Ylsid t1_j9jzigu wrote

Stable diffusion works on my 6gb 2060RTX, but I am quite sure GPT3 wouldn't

1

rising_pho3nix t1_j9jp2rh wrote

Exactly.. endless possibilities. Something like M3GAN could be real.

2

Slapbox t1_j9kovoy wrote

The first superhuman AGI will likely give its creator an insurmountable lead.

1