Viewing a single comment thread. View all comments

TankAttack OP t1_j660efo wrote

Reply to comment by visarga in [D] Best large language model for Named Entity Extraction? by TankAttack

How many samples do you use for fine turning?

1

visarga t1_j67sivp wrote

My task uses sentence pairs, and I have an efficient prompt that makes many pairs in one go. So in 5 hours I managed to generate 230K pairs. Cost $10. I plan to generate millions to "exfiltrate" more domain knowledge for the small and efficient models I am training downstream.

1