Viewing a single comment thread. View all comments

logophobia t1_jch9ow5 wrote on March 16, 2023 at 8:36 PM

Neat concept, compile, but still has some limitations for the models I used them on (complex-valued tensors, pykeops, CUDA kernels). Some pretty great advancements otherwise. Will probably help when training transformers.

programmerChilli t1_jci4fyx wrote on March 17, 2023 at 12:05 AM

I've actually had pretty good success on using torch.compile for some of the stuff that KeOps works well for!