Submitted by super_deap t3_11tmpc5 in MachineLearning
hfnuser0000 t1_jcl5akd wrote
Reply to comment by Spiritual-Reply5896 in [D] PyTorch 2.0 Native Flash Attention 32k Context Window by super_deap
How many ways are there to implement memory retrieval? Can someone explain the intuition behind it? Thank you in advance!
felheartx t1_jclij93 wrote
I have no idea about how many other ways there are, but this looks extremely promising: https://arxiv.org/abs/2301.04589#
So there's at least one :P
Viewing a single comment thread. View all comments