Submitted by fangfried t3_11alcys in singularity
nul9090 t1_j9th1xg wrote
Reply to comment by fangfried in What are the big flaws with LLMs right now? by fangfried
Well, at the moment, we can't really have any idea. Quadratic complexity is definitely really bad. It limits how far we can push the architecture. It makes it hard to make it on to consumer hardware. But if we are as close to a breakthrough as some people believe maybe it isn't a problem.
Viewing a single comment thread. View all comments