Viewing a single comment thread. View all comments

deepestdescent t1_j67iajc wrote on January 28, 2023 at 7:11 AM

I use PyTorch data loaders to load batches into memory in the background. I believe TensorFlow has similar functionality with tf.data. This should make your data loading speed basically negligible if you have a few CPU cores lying around.

Meddhouib10 t1_j67tmqr wrote on January 28, 2023 at 9:48 AM

+1 but I think he already knows that