Viewing a single comment thread. View all comments

BiryaniSenpai t1_j70x9mq wrote

Maybe have your vectors attend to each other and learnably output your final query vector?

1

mostlyhydrogen OP t1_j723us3 wrote

What does it mean for a vector to attend to another vector?

1

BiryaniSenpai t1_j7249ok wrote

I mean pass your queries through a self attention layer and then some fcns and have it output your final query vector

1