Viewing a single comment thread. View all comments

No_Ninja3309_NoNoYes t1_j7kblef wrote

10K LoC? Sure if someone writes hundreds of supporting toolkits for that first. My friend Fred says that the pseudo code for better LLMs is just a few lines:

  1. Use AI to generate candidate rules like P(People eat sandwiches) >> P(Sandwiches eat people)
  2. Hire lots of humans. Get them to process the data from 1 and produce rules like P(Sandwiches eat people) = 0.
  3. Feed the rules to the AI of rule 1

So let's say that you need one cent for each rule for a total of billion rules. With a thousand workers each producing 100K rules a year... It's doable for a billionaire. And you need seven similar schemes for other types of data. However I think AGI is not feasible in a decade. The hardware, software, data, and algorithms are not ready yet.

1

Northcliff t1_j7km7zr wrote

John Carmack has stated that the instructions for AGI won’t be that complicated, just a few thousand lines of code potentially

4

Nanaki_TV t1_j7kr7ji wrote

Seems like that should be the case as well since the brain doesn't "run on a lot of code" as far as we understand.

4