Viewing a single comment thread. View all comments

Art10001 t1_jayfgsc wrote

Reply to comment by crayphor in [P] LazyShell - GPT based autocomplete for zsh by rumovoice

I suggest another model such as OPT or even Flan-T5, because they're much easier to setup than OAI's outdated instructions that use outdated package versions that effectively demand a for-purpose VM or Docker.

3

Pat3418 t1_jbjmcty wrote

Have you done something like this? Any references you can share? Would love to have an offline tool like this…

1

Art10001 t1_jbjv13z wrote

I once setup the smallest model of Pygmalion to act as a chatbot. The UI was premade and Gradio-based.

It worked well. I had tried Flan-T5 first, but the UI did not recognize the model kind (yet.)

1