harishprab OP t1_iucy9k9 wrote on October 30, 2022 at 11:43 AM

Reply to comment by _Arsenie_Boca_ in [R] Open source inference acceleration library - voltaML by harishprab

Thanks. HF accelerate is basically doing it for intel chips. I haven’t seen them support TensorRT. I could be wrong. Neural Magic is mostly about quantisation aware training and pruning techniques. We focus on post training techniques. We should try Nebullvm. They’re a great library too.