[D] When the GPU is NOT the bottleneck...? Submitted by alexnasla t3_yikumt on October 31, 2022 at 6:45 PM in MachineLearning 12 comments 5
m98789 t1_iujdl6v wrote on October 31, 2022 at 7:44 PM If using an A100, ensure you have enabled AMP, it’s a game changer in training speed up: https://developer.nvidia.com/automatic-mixed-precision Also suggest using a very fast disk, get the fastest you can. Disk IO can surprisingly be a bottleneck. Permalink 2
Viewing a single comment thread. View all comments