Viewing a single comment thread. View all comments

SoylentRox t1_j9dx7nz wrote

Reply to comment by MultiverseOfSanity in Whatever happened to quantum computing? by MultiverseOfSanity

I thought it would require a lot of things. But here we are.

Open source devs have re-created the core of an LLM like GPT-3 (it's what powers chatGPT and BingChat) in a few thousand lines of code.

It's really not that complicated. https://github.com/EleutherAI/gpt-neox

And yet this one repeated algorithm and a few tricks in training and we can get like 50% of human intelligence right there.

3