jimmiebtlr t1_ivy59yw wrote on November 11, 2022 at 2:11 PM Reply to comment by canbooo in [R] ZerO Initialization: Initializing Neural Networks with only Zeros and Ones by hardmaru Haven’t read it yet, but wouldnt symmetry only exist for 2 node if the input and output weights have the same 1s and 0s? Permalink Parent 1
jimmiebtlr t1_ivy59yw wrote
Reply to comment by canbooo in [R] ZerO Initialization: Initializing Neural Networks with only Zeros and Ones by hardmaru
Haven’t read it yet, but wouldnt symmetry only exist for 2 node if the input and output weights have the same 1s and 0s?