Submitted by viperx7 t3_11xdx3w in deeplearning
So I made this chat UI that will help you use alpaca models to have coherent conversations with history and the bot will remember your previous questions
Here is the demo
you can get the interface from https://github.com/ViperX7/Alpaca-Turbo
the git clone command is not working
git clone https://github.com/your-username/Alpaca-Turbo.git
cd Alpaca-Turbo
pip install -r requirements.txt
python webui.py
I used my username
You need to clone his repo with his username. You might have an easier time just downloading it from the project page instead of cloning it.
Can I get some help here on windows? It just sits at loading models. All requirement are installed, I have the models already, just not sure where to put them?
D:\alpaca\Alpaca-Turbo>python webui.py can't load the settings file continuing with defaults Loading Model
━━━━━━━━━━━━━━━━━━━━━━━━ 0% -:--:--
[deleted]
I want to ask what is you PC specs and on what dataset did you train it on an how did it take to train it
>I used my username
Did you fork the repo? If not, then the repo you're trying to clone doesn't exist.
He isn't the one that trained the model.
sorry my bad you don't need to use your username
I added the changes required for changes but for some reason the model is painfully slow on windows
I haven't trained it i just created this ui that modifies the prompt in a way to get the bot to respond like that
If you can run dalai on your system you can run this also
the only thing is on windows it's performance is very very bad linux and mac works good with 8 gb ram nd 4 threads
git clone https://github.com/ViperX7/Alpaca-Turbo.gitis the correct command to run. At least it worked for me.
I'm trying to test it out but I'm getting the error message: "can't load the settings file continuing with defaults
Loading Model ━━━━━╺━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13% -:--:--" It's stuck at 13%. Any ideas for how to fix it? (On Win 11)
I'm having the same issue on Linux on a 16 thread Ryzen 5850U with 64 GB of RAM.
➜ Alpaca-Turbo git:(main) python3 ./webui.py
can't load the settings file continuing with defaults
Loading Model ━━━━╸━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13% -:--:--
It just stays at 13%.
[deleted]
Hello there! I am a bot raising awareness of Alpacas
Here is an Alpaca Fact:
Alpacas are healthy grazers and do not decimate natural vegetation like goats.
| Info| Code| Feedback| Contribute Fact
Are there plans to add support for the 13b version of the model?
This interface looks great! I'm using windows though and I can hear my fan speed up to run the model, nothing happens. I can run the model through cocktail peanut Dalai Alpaca, so any clue what's going on? Thank you! Edit: It generated text eventually. But really really slow... (about 4 and half minutes to return a response :-p )
Hello there! I am a bot raising awareness of Alpacas
Here is an Alpaca Fact:
The Spanish Conquest almost wiped out 90% of the fine alpacas being bred by ancient cultures.
| Info| Code| Feedback| Contribute Fact
Hoping you manage to figure out what is slowing things down on windows! In the direct command line interface on the 7b model the responses are almost instant for me, but pushing out around 2 minutes via Alpaca-Turbo, which is a shame because the ability to edit persona and have memory of the conversation would be great.
Also... it doesn't seem to generate at all without an internet connection. Is that the expected behaviour?
Educational_Ice151 t1_jd2qb1v wrote
Alpaca is mind blowing. Thanks for sharing.
Shared to r/aipromptprogramming