Viewing a single comment thread. View all comments

yehiaserag t1_jcj305q wrote on March 17, 2023 at 4:50 AM

How does that version compare to "RWKV-4-Pile-14B-20230228-ctx4096-test663"?

bo_peng OP t1_jcjuinf wrote on March 17, 2023 at 10:58 AM

More ctxlen and slightly better trained :) same speed & vram

[deleted] t1_jclws3b wrote on March 17, 2023 at 7:54 PM

[deleted]

yehiaserag t1_jcm31zk wrote on March 17, 2023 at 8:36 PM

We say RWKV for short, the rest of the stuff is for a specific version

[deleted] t1_jcs3icv wrote on March 19, 2023 at 3:09 AM

[removed]

[deleted] t1_jcs3lrc wrote on March 19, 2023 at 3:10 AM

[removed]