Viewing a single comment thread. View all comments

Scarlet_pot2 OP t1_j3937vf wrote

Reply to comment by ChronoPsyche in We need more small groups and individuals trying to build AGI by Scarlet_pot2

Whatever group is made, they can self fund. I'm sure most of us work, and it doesn't cost much to learn and try new approaches. you don't need to train a multi-million dollar model. There's many other ways to contribute

−1

ChronoPsyche t1_j395ifv wrote

But you do need to train a multi-million dollar model. It is extremely expensive to do. That's why the only companies that have produced LLMs worth anything are ones with billions in funding. Google and Microsoft-backed OpenAI.

0

Scarlet_pot2 OP t1_j3961c1 wrote

I'm not talking about LLMs. I'm talking about new, novel approaches. LLMs were started because a small group figured out they could make a program that could guess the next word. small groups trying new things could develop the next program like that, which is something people could try.

You may try new things and make a simple discovery that leads to new advanced AIs a couple years later

0

ChronoPsyche t1_j3978ph wrote

You don't think researchers at Google and OpenAI aren't constantly trying to figure out new, more efficient algorithms? And these are researchers with PhDs in machine learning and billions in funding to carry out experiments, not people who just watched some online Python videos.

While what you say isn't impossible, you're making it sound way easier than it actually is. Sounds more like wishful thinking.

2

Scarlet_pot2 OP t1_j39a7ok wrote

The fact that there are people at these companies trying new approaches shouldn't stop you from trying to. They aren't going to be trying what you are. Even if what you try comes up short, then we know one more path that isn't towards AGI

The goal should be to try as many different approaches as possible so we can identify the ones that show promise. It won't be easy or quick, but I'm sure if we had 100k people with beginner-intermediate base understanding of the subjects related to AI, all trying different approaches and sharing their results, some working together, after a few years we would probably have at least a few new methods worth trying that may lead to a part of AGI.

2

ChronoPsyche t1_j39ccoa wrote

Here's the biggest problem with trying to crowd-source research from beginners, you don't know what you don't know. You get 100k beginners and ask them to try to figure out AGI, they'll come up with a bunch of solutions that have already been tried thinking they're novel, but not realizing that it's been done before due to lack of experience.

I've tried to do something similar myself, not for AGI but for something else in another domain within machine learning. Thought I found gold and was a genius, only to discover I had just reinvented the wheel for an older technique that was abandoned due to not being feasible. As a result, all that happened was I learned firsthand and for myself why that technique was no longer used (and that it was ever used in the first place). It was a great learning experience, but that's all it was.

Depth of experience is invaluable. Research builds on past research, but in order to know what to build on and how to build on it, you gotta be experienced within the field. You gotta truly understand everything else that's already been tried.

I don't think you really appreciate everything that goes into research. It's a common fallacy for people who are beginners, like I said, you don't know what you don't know.

Of course, that shouldn't stop anyone from trying. You're more than welcome to take your advice. As for me, I am focusing more on novel ways to use advanced AI built by others in software applications. OpenAI just creates the tools, but someone's gotta use those tools to create something useful. That's where people with breadth of experience who lack the depth of experience necessary for rigorous research can excel. I'm not going to try and beat giant corporations with teams of PhDs and billions in funding at their own game.

1

BellyDancerUrgot t1_j39l9js wrote

Out of curiosity what was it that u tried?

And I agree most people on this subreddit don’t have any idea what they are talking about lol. It’s just Twitter and social media hype, accompanied by total lack of knowledge ….. or worse having superficial knowledge on the most basic things.

1

metal079 t1_j3ajbbb wrote

>trying different approaches

You realize this takes money? How do we know something works unless you can train a model to test it?

1