Viewing a single comment thread. View all comments

Nerveregenerator t1_j16yfnw wrote

Write all the equations out one paper, then do one forward and backward pass on paper as well with a simple mlp. I believe bias can be easily incorporated using an extra 1 in the input and using an extra weight as the bias, so it’s updated the same as any other weight. Also learn the basics of matrix multiplication.

3