Viewing a single comment thread. View all comments

johntwoods t1_j3ju6o2 wrote

I tried to get chatGPT to write me a quick synopsis of a movie that was exactly 500 words long. It couldn't do it. And I would say, hey, that's 384 words and this needs to be 500. Then the bot would apologize and say "Oh okay here is one that's 500 words!" And it would be 470 or something.

30

wicklowdave t1_j3k08qp wrote

You need to threaten it, like "this better be 500 words or else you're not going to like it". Then it's very careful to do what you ask it to.

17

johntwoods t1_j3k0gjt wrote

I will try that.

I will be right back.

8

joeiudi t1_j3k944q wrote

(If he doesn't come back it's obviously because HAL killed him...)

7

johntwoods t1_j3k9vlq wrote

I asked it for a 100 word synopsis Buffalo '66 and it gave me 91 words. I was aggressive with it, too. Threatening even.

7

NotASuicidalRobot t1_j3jza6v wrote

I mean it's trying to get close...i guess? Maybe it can't double back to check the essay like humans to add and delete random phrasing to get accurate

5

johntwoods t1_j3k0ebm wrote

It is so definitive, though. I tell it, "Hey bro, that's only 387 words and it needs to be 500." And instead of saying, "Oh, ok, I will attempt it again, I am sorry." It states, with authority, "My apologies, here is a version that is 500 words." And then it is 402.

It is like it can't count. Which is fucking hilarious to me.

11

alwaysuseswrongyour t1_j3k3ace wrote

I tried to have it make a meal plan with nutrition facts, 200 grams of protein and 2000 calories and it would do the same, “okay here’s a meal plan with 200 grams of protein and 2000 calories” it had all the nutrition facts but the numbers did not add up to anything close to what they were supposed to. I can’t think of the other time but this was not the first time I used it and it simply could not add, something I would expect an AI to do with ease.

4

johntwoods t1_j3k3snt wrote

That's a good example.

Math/counting... Not AI's strong suit I guess.

2

Syntaxosaurus t1_j3k7xxu wrote

That's a sore spot for chatGPT specifically rather than AI in general. See this thread for more.

1

johntwoods t1_j3k8gyv wrote

Totally. I understand.

I'm not even asking for simple algebra.

I am asking for GPT to simply count the number of words it is outputting.

2

NotASuicidalRobot t1_j3k1b1e wrote

Yeah that's fair. I find it likes repeating the words in your question again more than anything else, it's like a student answering the "write your answers in full sentences" type questions. So it's probably just compulsively doing that

1

yaosio t1_j3kd9jp wrote

Add "think step by step" and it's output magically becomes more accurate.

1

JJJC16 t1_j3kf0zc wrote

Why don’t you try saying something like give me 530 words and then it might you 500?

1

moki69 t1_j3km9t2 wrote

Okay, after fiddling around, I found wording the prompt like “Write an essay about a cat. This should be between 250 and 300 words. Report the word count after producing the essay.” to produce accurate word count responses, typically at the uppermost limit of the ranges I would provide. I’ve also found that you can ask ChatGPT to write out “X” amount of words for a prompt, and after it finishes answering, tell it simply to “continue on with more words” or “continue with another page” and it will simply keep spitting out information.

1

johntwoods t1_j3m87d2 wrote

Excellent work!

I should just be asking you instead of GPT.

Go humans!

1