[R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM) Submitted by bo_peng t3_11teywc on March 17, 2023 at 2:49 AM in MachineLearning 32 comments 101
LetterRip t1_jcl6axl wrote on March 17, 2023 at 5:03 PM Reply to comment by bo_peng in [R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM) by bo_peng Rocky Permalink Parent 1
Viewing a single comment thread. View all comments