Viewing a single comment thread. View all comments

Yomiel94 t1_jcb90zx wrote

Reply to comment by blunun in OpenAI releases GPT-4, a multimodal AI that it claims is state-of-the-art by donnygel

GPT isn’t using Google during the test to look things up.

If you want a fair competition, you have a month to read through the internet, then we can see how you perform on all the major standardized tests lol.

1

blunun t1_jcbcjvz wrote

Or if I had all Google search results saved in a database I could access during the test! I’m curious how much of it is just regurgitating information in a way that sounds like natural human language vs true synthesis of information

10

Yomiel94 t1_jcbemtv wrote

>Or if I had all Google search results saved in a database I could access during the test!

You mean like your long-term memory? To be clear, GPT doesn’t have the raw training information available for reference. In a sense, it read it during training, extracted the useful information, and is now using it.

If it’s answering totally novel reasoning questions, that’s a pretty clear indication that it’s gone beyond just modeling syntax and grammar.

1

blunun t1_jcbk8kh wrote

I would say it’s more like it reads it and writes it down and has access to all of that when answering questions. But you’re correct, if it is solving novel questions, then I totally agree. I havent seen that myself yet but have not looked into it that closely. Do you have examples of it solving novel questions? I’d love to see that.

3