Submitted by ortegaalfredo t3_11kr20f in MachineLearning
ortegaalfredo OP t1_jbaswga wrote
Reply to comment by polawiaczperel in [R] Created a Discord server with LLaMA 13B by ortegaalfredo
Interesting, will research more into that code, its exactly what I need to run 33B.
Currently using a single card it's still too slow to use it as a chatbot.
Viewing a single comment thread. View all comments