Viewing a single comment thread. View all comments

LeN3rd t1_jcislrk wrote

Reply to comment by DreamMidnight in [D] Simple Questions Thread by AutoModerator

I have not heard this before. Where is it from? I know that you should have more datapoints than parameters in classical models.

1

DreamMidnight t1_jcrh53z wrote

Here are some sources:

https://home.csulb.edu/~msaintg/ppa696/696regmx.htm

https://developers.google.com/machine-learning/data-prep/construct/collect/data-size-quality (order of magnitude in this case means 10)

https://stats.stackexchange.com/questions/163055/clarification-on-the-rule-of-10-for-logistic-regression

1

LeN3rd t1_jct6arv wrote

Ok, so all of these are linear ( logistics) regression models, for which it makes sense to have more data points, because the weights aren't as constraint as in a convolutional layer I.e. but it is still a rule of thumb, not exactly a proof.

1