to4life4
to4life4 OP t1_jdim3ip wrote
Reply to comment by Llukas88 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
Someone said that Alpaca isn't open source though?
to4life4 OP t1_jdi6ntl wrote
Reply to comment by NoBoysenberry9711 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
Yeah that is sort of the idea, to focus attention (heh) on a specific input, but after being a general pretrained chatbot.
to4life4 OP t1_jdi6cqx wrote
Reply to comment by Latter-Personality-6 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
How does performance compare to SOTA?
to4life4 OP t1_jdfhhup wrote
Reply to comment by wendten in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
"Best" I suppose meaning closest to the latest ChatGPT on the usual benchmarks.
First on my own gpu to test (3080ti), then on a cluster if I can prove out the concept.
Thanks I'll definitely look into Alpaca. It can be customized to work with human ratings of generated output?
to4life4 OP t1_jdin0kc wrote
Reply to comment by Llukas88 in [D] What is the best open source chatbot AI to do transfer learning on? by to4life4
Ah ok cool gotcha. Any benchmarks on Bloom performance vs Alpaca and others?