Viewing a single comment thread. View all comments

pixiegirl417 OP t1_jd04sxc wrote

Reply to comment by timedacorn369 in [P] OpenAssistant is now live on reddit (Open Source ChatGPT alternative) by pixiegirl417

That's right!! Model is here: https://huggingface.co/OpenAssistant/oasst-sft-1-pythia-12b

36

BayesMind t1_jd8ps8g wrote

Is there an example script somewhere for how to run this? All I've seen is the heavy inference server example in the repo.

1

pixiegirl417 OP t1_jd8s4nc wrote

I haven't tried to run it locally since I don't have the hardware requirements, and haven't tried to find a way to do it.

However you can check my GitHub if you want to try the server attached inference API (I know it may not be what you're looking for).

1