Submitted by MultiverseOfSanity t3_117gjyg in singularity
MultiverseOfSanity OP t1_j9dwwt7 wrote
Reply to comment by SoylentRox in Whatever happened to quantum computing? by MultiverseOfSanity
Hmm, growing up, I always thought AGI would require quantum computing. Guess I was wrong.
SoylentRox t1_j9dx7nz wrote
I thought it would require a lot of things. But here we are.
Open source devs have re-created the core of an LLM like GPT-3 (it's what powers chatGPT and BingChat) in a few thousand lines of code.
It's really not that complicated. https://github.com/EleutherAI/gpt-neox
And yet this one repeated algorithm and a few tricks in training and we can get like 50% of human intelligence right there.
Viewing a single comment thread. View all comments