Viewing a single comment thread. View all comments

Anjz OP t1_jdtycqs wrote

Reply to comment by Kujo17 in AI being run locally got me thinking, if an event happened that would knock out the internet, we'd still have the internet's wealth of knowledge in our access. by Anjz

I think very soon, there will be ASIC(Application-specific integrated circuit) low powered devices that can run powerful language models locally.

It's within our grasp. Might be integrated into our smartphones sooner than later actually.

10

fluffy_assassins t1_jdvgg2n wrote

This is exactly what tensor cores/ppu are... VERY specifically suited to AI. They are bought by the board-full to run AI servers. Basically your graphics card is an AI ASIC.

2