Viewing a single comment thread. View all comments

Llukas88 t1_jdilkns wrote

There are Alpaca finetuned versions of Bloom or BloomZ on huggingface, maybe try those. Another option would be the Chat version of GPTNeoX from OpenChatKit. Both should be Open Source and free to use.

3

to4life4 OP t1_jdim3ip wrote

Someone said that Alpaca isn't open source though?

2

Llukas88 t1_jdimn2w wrote

The Alpaca model based on LLaMa isnt. The dataset, which is also called Alpaca is. If you train Bloom, which uses a permissive license, on this dataset, the Bloom license is applied to your finetuned model and you should be able to use it commercially.

2

to4life4 OP t1_jdin0kc wrote

Ah ok cool gotcha. Any benchmarks on Bloom performance vs Alpaca and others?

1