APUsilicon t1_jdaui8z wrote on March 23, 2023 at 1:43 AM Reply to [P] ChatLLaMA - A ChatGPT style chatbot for Facebook's LLaMA by imgonnarelph can we run this locally? Permalink 2
APUsilicon t1_jc0zbtj wrote on March 13, 2023 at 6:27 AM Reply to [P] Discord Chatbot for LLaMA 4-bit quantized that runs 13b in <9 GiB VRAM by Amazing_Painter_7692 oooh, I've been getting trash responses from opt-6.7b hopefully this is better. Permalink 1
APUsilicon t1_jdaui8z wrote
Reply to [P] ChatLLaMA - A ChatGPT style chatbot for Facebook's LLaMA by imgonnarelph
can we run this locally?