sparcity_of_time t1_ir2ux0u wrote on October 4, 2022 at 10:39 PM Reply to Large Language Models Can Self-improve by Dr_Singularity self-training has been around for a while (earlier: https://arxiv.org/abs/2204.12639v1), also likely shows up in humans as System 2 -> System 1 compression based on minimizing prediction losses: https://www.youtube.com/watch?v=75d_29QWELk. that said, neat to see. Permalink 1
sparcity_of_time t1_ir2ux0u wrote
Reply to Large Language Models Can Self-improve by Dr_Singularity
self-training has been around for a while (earlier: https://arxiv.org/abs/2204.12639v1), also likely shows up in humans as System 2 -> System 1 compression based on minimizing prediction losses: https://www.youtube.com/watch?v=75d_29QWELk. that said, neat to see.