Viewing a single comment thread. View all comments

visarga t1_j65iwit wrote

I am using GPT-3 for this kind of stuff, and fine-tuning small models on the data.

3

TankAttack OP t1_j660efo wrote

How many samples do you use for fine turning?

1

visarga t1_j67sivp wrote

My task uses sentence pairs, and I have an efficient prompt that makes many pairs in one go. So in 5 hours I managed to generate 230K pairs. Cost $10. I plan to generate millions to "exfiltrate" more domain knowledge for the small and efficient models I am training downstream.

1