Viewing a single comment thread. View all comments

alam-ai t1_ja8czf5 wrote

Maybe it doesn't do the dropout regularization during validation but does only for training? And without the dropout the model does better, sort of like how you see better with both eyes open together than individually with either eye.

Also probably can just switch your training and validation sets and rerun your test to see that the actual data in the splits isn't somehow the issue.

2

Apprehensive_Air8919 OP t1_ja94rat wrote

good analogy! Yes I use model.eval() so dropout is removed when doing the forward pass on the validation set.

1