big_dog_2k OP t1_iu7paw3 wrote on October 29, 2022 at 4:51 AM

Reply to comment by sobagood in [D] How to get the fastest PyTorch inference and what is the "best" model serving framework? by big_dog_2k

Thanks. I might need to take a closer look. I was also thinking AMD and arm based cpu. I was surprised at how good the cpu based inference can be for some models these days.

sobagood t1_iu801e4 wrote on October 29, 2022 at 7:14 AM

I dont think they support AMD as they are rival to each other.