Viewing a single comment thread. View all comments

shot_a_man_in_reno t1_iwcil08 wrote

Maybe I'm misunderstanding, but is the DenseNet itself frozen? You're only training the one, massive, fully connected layer?

1

Tiny-Mud6713 OP t1_iwcjsgx wrote

Oh no, from the comments i realized that I have explained things in a bad way, I train the FC layer until it early stops while the DenseNet is frozen, then I take that model and retrain the weights with unfreezing 200-ish layers and lowering the learning rate

1