Submitted by viperx7 t3_11xdx3w in deeplearning
GrapplingHobbit t1_jd98i9i wrote
Reply to comment by viperx7 in Alpaca Turbo : A chat interface to interact with alpaca models with history and context by viperx7
Hoping you manage to figure out what is slowing things down on windows! In the direct command line interface on the 7b model the responses are almost instant for me, but pushing out around 2 minutes via Alpaca-Turbo, which is a shame because the ability to edit persona and have memory of the conversation would be great.
Viewing a single comment thread. View all comments