Viewing a single comment thread. View all comments

Scarlet_pot2 t1_j5xl0or wrote

could someone educated start an AI company and do something similar at a smaller scale? I would love to run a company that makes open source and paid models.. like stabilityAI.

2

genshiryoku t1_j5y03ci wrote

Problem is that AI benefits from economy of scale and there's an exponential increase in performance with bigger models.

What this means is that it's a "winner-takes-all" situation and you can't compete as a smaller entity without huge capital injection to generate the compute necessary to train large models.

The only alternative I can think of is a distributed computer like Seti@home where people volunteer their GPUs to collectively train large open source AI models.

As cryptocurrency mining has shown us, most people won't do that on volunteer basis so there'd need to be some sort of financial incentive but I wouldn't want to mix a neutral AI open source model with perverse financial incentives like crypto.

So essentially that is not going to happen and even StabilityAI is eventually going to have to incorporate like OpenAI to continue on their path, sadly enough.

8

luisbrudna t1_j60epie wrote

Maybe.. If you manage to get hundreds of billions of content from Internet. This kind of system needs HUGE training data.

1

Scarlet_pot2 t1_j66jo0e wrote

they have open source datasets like LAION-5B, the Common Crawl, the Pile etc.. the main thing is getting a model trained on it. I guess I would need to design the transformer architecture, train the model, then use that as a proof-of-concept to get investors interested.

Or build an app around Stable-Diffusion, post it on app store, make some money, and use that to get investors interested. Probably do this then with the investments and some hired help do what i said in the first paragraph

1