Dras_Leona t1_iqt3obl wrote on October 2, 2022 at 9:59 PM

Reply to comment by asciimo71 in Self-Programming Artificial Intelligence Using Code-Generating: a self-programming AI implemented using a code generation model can successfully modify its own source code to improve performance and program sub-models to perform auxiliary tasks. by Schneller-als-Licht

“ Applying AI-based code generation to AI itself, we develop and experimentally validate the first practical implementation of a self-programming AI system. “

yaosio t1_iqu95ip wrote on October 3, 2022 at 3:11 AM

They mean is there a way for a third party to prove it. They could be cherry picking or just fabricate their results and with no way to reproduce it we wouldn't know.

duffmanhb t1_iqvbiwm wrote on October 3, 2022 at 11:15 AM

Yes it’s literally a publication up for peer review. The whole point is replication.

yaosio t1_iqvqslz wrote on October 3, 2022 at 1:35 PM

Unless the code is available there's no guarantee it can be replicated. Plenty of people in /r/machinelearning complain about papers that can't be replicated. Sometimes the people writing the paper promise the code and then never provide it and refuse to respond to anybody asking for it.