Submitted by RadioFreeAmerika t3_122ilav in singularity
Kolinnor t1_jdr0g2h wrote
Reply to comment by ArcticWinterZzZ in Why is maths so hard for LLMs? by RadioFreeAmerika
I could be wrong on this take, but...
I don't believe this is correct. What about chain of thought prompting ? If you ask it to do multiplication step by step, it does it. The current problem is, I would say, it doesn't know when to take more time to think, but there's probably no intrisic limitation due to time complexity.
Also, none of you actually compute 5x3 = 15. You just know the answer. But you're no parrot because if needed, you can manually do multiplication right ?
But that's because... someone taught you the algorithm when you were a kid. Suddenly sounds less glorious, no ?
Also, can you name one specific simple task that GPT-4 cannot do, and let's see next month...
jloverich t1_jdrgd0p wrote
Tbh, I parrot the value and then add 5 3 times to double check. One of the other things these chatbots aren't doing is double checking what they just spoke otherwise one of their statements would be immediately followed by another, "oh, that was wrong". Instead you need to prompt them that it was wrong.
Kolinnor t1_jdrjbj5 wrote
Yeah, definitely ! Althought I don't think this is an unfixable fundamental flaw, I agree this is a big advantage we still have over them
[deleted] t1_jdsjpyf wrote
You’re not asking it to do multiplication “step by step”.
You’re simplifying the question to the point where text prediction can answer it.
GoldenRain t1_jdr2unm wrote
>Also, can you name one specific simple task that GPT-4 cannot do, and let's see next month...
It cannot read even simple stuff in reverse, like "?uoy era woH"
Kolinnor t1_jdr412t wrote
I just copy-pasted this on GPT-4 and here's the answer :
​
>I am doing well, thank you! As an AI language model, I don't have feelings or emotions like humans do, but I'm here to help you with any questions or information you need. Please let me know how I can assist you.
- What was my sentence saying ?
​
>Your sentence appears to be written backwards. When reversed, it says, "How are you?" You were asking about my well-being.
GoldenRain t1_jdr57k1 wrote
Weird, didnt work when I tried it. Try with a more unique longer sentence in a new prompt and see how it goes.
Kolinnor t1_jdr6m19 wrote
- This is a special puzzle for you. Can you read it ? ! enihcam ,uoy rof drah oot si siht teb I .oot hcnerf ni ,yakO .tset a si sihT .seog ti woh ees dna tpmorp wen a ni ecnetnes regnol euqinu erom a htiw yrT .ti deirt I nehw krow tndid ,drieW
>Of course! The text appears to be reversed. Here's the corrected version:
>
>Weird, didn't work when I tried it. Try with a more unique longer sentence in a new prompt and see how it goes. This is a test. Okay, in french too. I bet this is too hard for you, machine! Can you read it?
It kinda fucked up at the end because it repeated "can you read it", but it got the reversed text correct
skob17 t1_jdrenvs wrote
It's puzzling. It recognized the last sentence as being normal, and did not reverse it
GoldenRain t1_jdr6z8w wrote
Ah great, that's impressive!
BigMemeKing t1_jds2hjp wrote
Yeah, I can read it. And if I can read it why couldn't they? I'm not particularly bright. Why couldn't I believe a machine could do my job better than me?what do you want your job to be says the machine? Live long and prosper, you reply. Ok says the machine. Sweet, im the star in the amazing new movie franchise Fast and the Furbinous, my life's lookin tits right now, I'm gonna go grab some "micheladas" ifykyk. And do what Christ died for me to do. Aint that right buddy?! Now imma drive my fast ass car right down this road and bam I'm wrapped around her finger.
Just snug right on in there. We'll everyone else said I was too young! Oh? Did they now? Everyone else according to who? Like everyone else according to the animals you have dominion over?what did they think when you stomped them out? Used them by the millions, to create new protein sources. Save one cow! Eat a whole bunch of ground up bugs instead!one plus one is relatively ♾️ you see
BigMemeKing t1_jds1225 wrote
So how long ago did you try it? How long fast is it going to be able to narrow down everything? To know exactly what happend? How many times do certain people have to go to confessions and appeal their case to God, or a higher power. Because they're going to take care of it. theyre going to find the time in their schedule to fix my needs you'll see. And God said "Look out for me!" Oh cool, what does that mean? It's something personal. But it's something different to different folks. How much time do you spend on you knees praying to the lord and begging for forgiveness. How much time have others spent on their knees for you? To help you succeed, to become the person you said you would be praying for you, begging their God for you. And how much time did you spend on your knees giving thanks, for all of life's blessings. Weigh it against weather or not, if the option for eternity was on the table who's version of heaven, and whose version of hell would you enter? And what are you weighing it against?
How much do you trust the information you're given? How much do you trust to be real? What could you defend in a court of higher thinking. And what would have to be defended against you. What do you really know? Who do you own? And who owns you? In the grand scheme of things? How much debt do you really owe? And how much do you own? And what truly belongs to you?
BigMemeKing t1_jdrzb61 wrote
Yet. How long until it gets there? At the rate we're going? How long until it hits all the little nooks and crannies that the dark was hiding in? The unknown variables become known variables so we create new variables to vary.
Dwanyelle t1_jdrym2j wrote
I ran into this issue (skipping steps and messing up the answer) when I was learning algebra all the time
ArcticWinterZzZ t1_jdt0dyi wrote
You are correct in that chain of thought prompting does work for this. That's because it gives it more time to run an algorithm to get the answer. I'm specifically talking about "instant" multiplication. Yes, GPT-4 can multiply, so long as it runs the algorithm for it manually. We then run into a small hitch because it will eventually hit its context window, but this can be circumvented. Reflexion and similar methods will also help to circumvent this.
As for SIMPLE specific tasks, I really don't think there's any GPT-4 can't do, not with an introspection step, at least.
Kolinnor t1_jdughns wrote
But I don't understand your point ? Humans don't do instant multiplication. At best, we have some mental tricks that are certainly algorithms too. Or we choose wisely to allocate more effort doing long multiplication if needed.
rhettandlick t1_jebmjp4 wrote
"Also, none of you actually compute 5x3 = 15. You just know the answer."
Yes, you are using a mental hash table, which have an expected access time complexity of O(1). GPT can also do this, it has already memorized a huge amount of data. However, ArcticWinter's statement remains correct: for non-O(1) questions that it has not yet memorized, it is IMPOSSIBLE for the current GPT versions to calculate the answer.
Of course, it can still guess and come pretty close, but it will never be certain of the answer.
Viewing a single comment thread. View all comments