Submitted by Matthyou200 t3_zrydfu in deeplearning
Nerveregenerator t1_j16yfnw wrote
Write all the equations out one paper, then do one forward and backward pass on paper as well with a simple mlp. I believe bias can be easily incorporated using an extra 1 in the input and using an extra weight as the bias, so it’s updated the same as any other weight. Also learn the basics of matrix multiplication.
Matthyou200 OP t1_j1wvwxz wrote
thanks for the tip!
Viewing a single comment thread. View all comments