timedacorn369
timedacorn369 t1_jczscaf wrote
It's mentioned as open source. So it means I can get the model weights and run it locally if I want to right?
timedacorn369 t1_jcqg4v6 wrote
Reply to comment by simpleuserhere in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere
What is the performance hit with various levels of quantization??
timedacorn369 t1_jd25c76 wrote
Reply to comment by yahma in [P] OpenAssistant is now live on reddit (Open Source ChatGPT alternative) by pixiegirl417
Yeah I hope so. Compared to other chat assistants this seems to have a much better rlhf part but somewhat bad text completion based on my limited analysis of using them . So if they use LlaMa I think the output would substantially improve .