Viewing a single comment thread. View all comments

AvgAIbot t1_j24t0ag wrote

Reply to comment by Foundation12a in For those of you who expect AI progress to slow next year: by Foundation12a

Can you explain the mechanism of action of how that would work? What’s the limiting factor, computing power, algorithms, or what?

2

Utoko t1_j26gb5n wrote

Right now the claim is that the current algorithms carry us way further.

The limiting factor is indeed computing power and good data. The last shift is that you need to grow the labeling of good tokens(desired outcomes) with the data.

There is also a lot of work done on chips, which are only used to train AI models and good data is created on mass. It is all coming together fast because there are also using models for data cleanup labeling.

Of course it is always possible that we hit a wall with the current algorithms soon but it looks very promising.
and the knowledge is walled off. The general principles of how OpenAI and Google archived their level are out there. So we have many companies driving us forward.

2

Ne_Nel t1_j27uvl5 wrote

Basically, memory tech. CPU has improved thousands last decades, but DRAM only 30x in the same period. And train needs tons of it. We are working on several ideas to walk around, but the exponential grow haven't a clean path at all for now.

1