GrapplingHobbit
GrapplingHobbit t1_jd98i9i wrote
Reply to comment by viperx7 in Alpaca Turbo : A chat interface to interact with alpaca models with history and context by viperx7
Hoping you manage to figure out what is slowing things down on windows! In the direct command line interface on the 7b model the responses are almost instant for me, but pushing out around 2 minutes via Alpaca-Turbo, which is a shame because the ability to edit persona and have memory of the conversation would be great.
GrapplingHobbit t1_jd9c32x wrote
Reply to comment by viperx7 in Alpaca Turbo : A chat interface to interact with alpaca models with history and context by viperx7
Also... it doesn't seem to generate at all without an internet connection. Is that the expected behaviour?