qepdibpbfessttrud t1_jduoaem wrote on March 27, 2023 at 9:56 AM

Reply to comment by ArcticWinterZzZ in AI being run locally got me thinking, if an event happened that would knock out the internet, we'd still have the internet's wealth of knowledge in our access. by Anjz

Sure, but LLMs will compress it and even improve upon it

If LLM is trained good enough, u can ask it to write Wiki article on any subject

Ambiwlans t1_jdvk5zy wrote on March 27, 2023 at 2:51 PM

Currently you can store an uncompressed copy of wikipedia in your pocket, so there isn't much advantage to compressing it.

I'd have both. And use GPT to interface with wikipedia if needed.

qepdibpbfessttrud t1_jdzuceg wrote on March 28, 2023 at 12:18 PM

Maybe. I wouldn't be surprised if users of Wiki were 90%+ satisfied with just AI-chat that was trained on it. ~21GB doesn't allow to run the thing in RAM cheaply yet

I'm not advocating for getting rid of Wiki, amassing and preserving training data will likely be important for whole generations of AI. But I wouldn't also be surprised if some version of GPT would be able to generate better in every possible way version of Wiki that the whole mankind managed so far