incrapnito t1_je9vtgb wrote on March 30, 2023 at 1:58 PM

Not sure what you mean by specific data. Here is a good read - When Does Label Smoothing Help? (https://arxiv.org/pdf/1906.02629.pdf)

HenrAInet OP t1_jea7qof wrote on March 30, 2023 at 3:25 PM

Thank you for suggesting this paper! I have already read it and found it quite informative.

Regarding your question about what I meant by 'specific data', my plan is to use label smoothing only on selected training data, rather than applying (generalized) label smoothing to all training data.

Currently, I'm seeking more knowledge on such 'data-specific' label smoothing. Hope this clears things up!