Viewing a single comment thread. View all comments

_Arsenie_Boca_ t1_isnyhtb wrote

You should test if this happens only during training or also when evaluating on the train set afterwards. As others have mentioned, dropout could be a possible factor. But you should also consider that the train accuracy is calculated during the training process, while the model is still learning. I.e. the final weights are not reflected in the average train acc.

1

No_Slide_1942 t1_isnylz0 wrote

It’s also happening without dropout.

1

_Arsenie_Boca_ t1_isnytx5 wrote

If the performance on the train set after training is better than during training, its simply due to the fact that train acc is usually calculated while the model is still learning.

1