Viewing a single comment thread. View all comments

RiotNrrd2001 t1_j9mddet wrote

I imagine at some point LLMs will be paired with tools that can handle the things they themselves are poor at. Instead of remembering that 3 + 4 = 8 the way it has to today, it will outsource such operations to a calculator which will tell it that the answer is actually 7. That ChatGPT can't do that today and still does as well as it does is actually pretty impressive, but... occasionally you still get an 8 where you really want a solidly dependable 7.

These are the early days. There is still some work to be done.

20

xott t1_j9mkfhv wrote

The addition of a calculator seems so simple and straightforward that I'm amazed there's no calculation subroutine present.

9

CommunismDoesntWork t1_j9ngi4q wrote

It's simple but not interesting from a research perspective. Humans don't need calculators to do math after all. Someone has done it though. They posted about it on the machine learning subreddit a few days ago

−1

xott t1_j9nj194 wrote

Integrating different modules into large language models is extremely interesting from both a research and a usability perspective.

Whether or not people need calculators to find square roots, it's still a useful function to have access to

5

MajesticIngenuity32 t1_j9oft1c wrote

There's still a good reason for which we make 8 year-olds memorize multiplication tables instead of just letting them deduce the answer from the definition of multiplication.

2

SoylentRox t1_j9nuxht wrote

By "some point" you meant 2 weeks ago right? https://arxiv.org/abs/2302.04761

8

RiotNrrd2001 t1_j9orcq7 wrote

Well... now things are happening fast enough that if I predict something that happened two weeks ago, I'm still counting it as a prediction. :-)

3

WarAndGeese t1_j9zohuk wrote

I think that's the natural order of the world. Thoughts and inventions get re-thought and re-invented so many times, and the first many times usually don't get written down. Or they get repeated multiple times in local conversations. Hence I agree that it still counts.

1

SupportstheOP t1_j9nv52l wrote

In many ways, it's how our own brain operates. Our brain carries out different functions that are transferred between the hemispheres. Without the connection, even certain, simple tasks become hard or downright impossible for each hemisphere to do alone.

1