Viewing a single comment thread. View all comments

jaxolingo OP t1_je5eunu wrote

Reply to comment by master-leaf in [D] The best way to train an LLM on company data by jaxolingo

From Hugging Face?

7

master-leaf t1_je5hhu6 wrote

I would check the paper, but I think they fine tune a pre trained local LM. They also created their own encodings to account for the structure of tabular data, such as the column headers, entity rows etc.

I will note though, from what I remember the table sizes were pretty small.

12