Viewing a single comment thread. View all comments

Agreeable-Run-9152 OP t1_j2px8mz wrote

Reply to comment by bloc97 in [R] On Time Embeddings in Diffusion models by Agreeable-Run-9152

Okay, yeah makes sense. I am currently working in the Context of FNOs. What is the way youd do it there?

1

bloc97 t1_j2pz7r6 wrote

FNO? Are you referring to Fourier Neural Operator?

1

Agreeable-Run-9152 OP t1_j2pz999 wrote

Yep

1

bloc97 t1_j2q0aio wrote

I'm not too familiar with FNOs, but I guess you could start experimenting by adding the time embeddings to the "DC component" of the fourier transform, it would be at least equivalent to adding the time embeddings to the entire feature in a ResNet.

2