Please look at sketch and langchain pandas/SQL plugins. I have seen excellent results with both of these approaches. Both of these approaches will require you to send metadata to openAI.
If you would like to do it yourself may be start with GPT-J / LORA and use the same instruction approach/fine tuning like databricks did .
t_minus_1 t1_je7gsc7 wrote
Reply to [D] The best way to train an LLM on company data by jaxolingo
Please look at sketch and langchain pandas/SQL plugins. I have seen excellent results with both of these approaches. Both of these approaches will require you to send metadata to openAI.
If you would like to do it yourself may be start with GPT-J / LORA and use the same instruction approach/fine tuning like databricks did .