[Discussion] Can we train with multiple sources of data, some very reliable, others less so? Submitted by DreamyPen t3_yrjjql on November 10, 2022 at 4:08 PM in MachineLearning 33 comments 12
ResponsibilityNo7189 t1_ivtxak2 wrote on November 10, 2022 at 4:12 PM You can maybe use the less reliable data in pretraining, then only use your trusted data for finetuning. Permalink 19 emad_eldeen t1_ivw8m77 wrote on November 11, 2022 at 1:48 AM Also, maybe use both sources for pretraining with a self-supervised method and fine-tune only with the reliable one. Check time-series SSL methods such as TS-TCC or TS2VEC for pretraining. Permalink Parent 3
emad_eldeen t1_ivw8m77 wrote on November 11, 2022 at 1:48 AM Also, maybe use both sources for pretraining with a self-supervised method and fine-tune only with the reliable one. Check time-series SSL methods such as TS-TCC or TS2VEC for pretraining. Permalink Parent 3
Viewing a single comment thread. View all comments