Viewing a single comment thread. View all comments

arsenyinfo t1_j5r4b5l wrote

Reply to comment by SimonJDPrince in [P] New textbook: Understanding Deep Learning by SimonJDPrince

Random ideas from the top of my head:

  • intro why transfer learning works;
  • old but good https://cs231n.github.io/transfer-learning/;
  • a concept of catastrophic forgetting;
  • some intuition on answering empirical questions like what layers should be frozen, how to adapt LR etc.
2