Viewing a single comment thread. View all comments

MultiverseOfSanity OP t1_j9dwwt7 wrote

Reply to comment by SoylentRox in Whatever happened to quantum computing? by MultiverseOfSanity

Hmm, growing up, I always thought AGI would require quantum computing. Guess I was wrong.

2

SoylentRox t1_j9dx7nz wrote

I thought it would require a lot of things. But here we are.

Open source devs have re-created the core of an LLM like GPT-3 (it's what powers chatGPT and BingChat) in a few thousand lines of code.

It's really not that complicated. https://github.com/EleutherAI/gpt-neox

And yet this one repeated algorithm and a few tricks in training and we can get like 50% of human intelligence right there.

3