Viewing a single comment thread. View all comments

[deleted] t1_jav5pu1 wrote

What dataset did you use to train the model? I'm creating something similar for an app and looking for a dataset.

Edit: NVM, you are using OpenAI API.

34

ginger_beer_m t1_jawngph wrote

OpenAI .. LOL

16

Quazar_omega t1_jax5sju wrote

I swear, sooner or later they'll change name into some dystopian stuff like EthicalAI or something since they aren't much open anymore, but still want to keep a "good" face

4

Sirisian t1_jayfok9 wrote

They bought https://ai.com the other day if you missed that. It directs to ChatGPT for now.

6

ank_itsharma t1_jax7x0s wrote

On a similar context, we can fine tune OpenAI API for a particular set of data, right?

2

DaTaha t1_jawprrx wrote

What options does one have if one wants ChatGPT-like functionality but without actually reaching out to OpenAI or other such online services?

1

crayphor t1_jawrahh wrote

You can use a smaller model like GPT-2. You are not going to get ChatGPT performance without a terabyte of VRAM, but if you want to try something locally, GPT-2 exists.

2

Art10001 t1_jayfgsc wrote

I suggest another model such as OPT or even Flan-T5, because they're much easier to setup than OAI's outdated instructions that use outdated package versions that effectively demand a for-purpose VM or Docker.

3

Pat3418 t1_jbjmcty wrote

Have you done something like this? Any references you can share? Would love to have an offline tool like this…

1

Art10001 t1_jbjv13z wrote

I once setup the smallest model of Pygmalion to act as a chatbot. The UI was premade and Gradio-based.

It worked well. I had tried Flan-T5 first, but the UI did not recognize the model kind (yet.)

1