Viewing a single comment thread. View all comments

multiverseportalgun t1_jbr55gh wrote on March 11, 2023 at 1:45 AM

Reply to comment by Hostilis_ in [D] What's the Time and Space Complexity of Transformer Models Inference? by Smooth-Earth-9897

Quadratic 🤢

Hostilis_ t1_jbr5iul wrote on March 11, 2023 at 1:48 AM

Yeah quadratic scaling in context length is a problem lol. Hopefully RWKV will come to the rescue.