Ambiwlans t1_jdvk5zy wrote on March 27, 2023 at 2:51 PM

Reply to comment by qepdibpbfessttrud in AI being run locally got me thinking, if an event happened that would knock out the internet, we'd still have the internet's wealth of knowledge in our access. by Anjz

Currently you can store an uncompressed copy of wikipedia in your pocket, so there isn't much advantage to compressing it.

I'd have both. And use GPT to interface with wikipedia if needed.

qepdibpbfessttrud t1_jdzuceg wrote on March 28, 2023 at 12:18 PM

Maybe. I wouldn't be surprised if users of Wiki were 90%+ satisfied with just AI-chat that was trained on it. ~21GB doesn't allow to run the thing in RAM cheaply yet

I'm not advocating for getting rid of Wiki, amassing and preserving training data will likely be important for whole generations of AI. But I wouldn't also be surprised if some version of GPT would be able to generate better in every possible way version of Wiki that the whole mankind managed so far