Majestic_Food_4190 t1_jdu3fod wrote on March 27, 2023 at 5:06 AM

Reply to comment by cegras in [D] GPT4 and coding problems by enryu42

It amuses me that people always mentions things of this nature. If the answer is simply, yes.... Then it's still doing it far faster than you are. Making it a better developer than most others.

It's like Watson beating the top people at jeopardy. Was it just searching the internet? Pretty much. Did it in turn win jeopardy? Yes.

So does the how matter?

cegras t1_jdw8hde wrote on March 27, 2023 at 5:29 PM

Well,

https://aisnakeoil.substack.com/p/gpt-4-and-professional-benchmarks

> As further evidence for this hypothesis, we tested it on Codeforces problems from different times in 2021. We found that it could regularly solve problems in the easy category before September 5, but none of the problems after September 12.