Submitted by International_Deer27 t3_10qhscf in deeplearning
BlacksmithNo4415 t1_j6uwn1n wrote
Reply to comment by BlacksmithNo4415 in Loss function fluctuating by International_Deer27
i can try to help you though, i worked as a deep learning engineer in computer vision:
- do you mean the dimension of 1 sample is [2000, 5] ? that is a very weird shape for an image. usually they have a shape of [h, w, 3] and [h, w, 4] for video data - a temporal additional dimension is added
- what do you want this model should be classifying ? so far it sounds more trivial - but depending on the object it might be a bit more complex.
- the more complex your task -> more complex your model must be -> a larger data set you will need
- how are the labels distributed in your data set ?
- do you use adversarial attacks for robustness ? don't do that at the beginning.
- are you sure that a cnn is the proper model for signal classification ?
- how do you want to represent your dataset ? what should be the 3rd axes represent as an information ?
- btw dropouts makes it also more difficult for the model to overfit. you use this so the model learns to generalize
- i think the model is way to complex when the task is actually trivial. but i never did any signal classification
- the use of sigmoid can lead to exploding gradients
Viewing a single comment thread. View all comments