Viewing a single comment thread. View all comments

valdanylchuk OP t1_j1zb36a wrote

Reply to comment by lorepieri in [D] DeepMind has at least half a dozen prototypes for abstract/symbolic reasoning. What are their approaches? by valdanylchuk

> Who knows, maybe the right symbolic architecture has already been proposed 20-30 years ago and nobody took the effort to put into a modern GPU accelerated codebase.

I also half-expect that in ten years, what current LLMs do on racks of GPUs, will fit in a phone chip, because many advances in efficiency come from utilizing old simple techniques like Monte Carlo and nearest neighbors.

10

lorepieri t1_j1zniuo wrote

Exactly, it's not just a matter of software architecture, but also of preexisting optimised libraries, hardware acceleration, economic incentives, funding. Very hard to predict how it will end up.

5