[R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM) Submitted by bo_peng t3_11teywc 2 years ago in MachineLearning 32 comments 101
[deleted] t1_jclws3b wrote 2 years ago Reply to comment by yehiaserag in [R] RWKV 14B ctx8192 is a zero-shot instruction-follower without finetuning, 23 token/s on 3090 after latest optimization (16G VRAM is enough, and you can stream layers to save more VRAM) by bo_peng [deleted] Permalink Parent −3− yehiaserag t1_jcm31zk wrote 2 years ago We say RWKV for short, the rest of the stuff is for a specific version Permalink Parent 6 [deleted] t1_jcs3icv wrote 2 years ago [removed] Permalink Parent 1 [deleted] t1_jcs3lrc wrote 2 years ago [removed] Permalink Parent 1
yehiaserag t1_jcm31zk wrote 2 years ago We say RWKV for short, the rest of the stuff is for a specific version Permalink Parent 6 [deleted] t1_jcs3icv wrote 2 years ago [removed] Permalink Parent 1 [deleted] t1_jcs3lrc wrote 2 years ago [removed] Permalink Parent 1
Viewing a single comment thread. View all comments