Viewing a single comment thread. View all comments

dwarfarchist9001 t1_j9w8701 wrote on February 25, 2023 at 12:21 AM

Reply to comment by fangfried in What are the big flaws with LLMs right now? by fangfried

Going from O(n^2) to O(nlog(n)) for context window size let's you have a context window of 1.3 million tokens using the same space needed for GPT-3's 8000 tokens.