Viewing a single comment thread. View all comments

nucLeaRStarcraft t1_j6nunti wrote

Reply to comment by qalis in [D] Have researchers given up on traditional machine learning methods? by fujidaiti

There's also this survey of DL vs traditional methods for tabular data: https://arxiv.org/pdf/2110.01889.pdf

3

qalis t1_j6o6cou wrote

That's a nice paper. There is also an interesting, but very niche line of using gradient boosting as a classification head for neural networks. Gradient flows through it normally, after all, just tree addition is used instead of gradient descent steps. But sadly I could not find any trustworthy open sourced implementation of this approach. If this works, it could bridge a gap between deep learning and boosting models.

3