Viewing a single comment thread. View all comments

zaptrem t1_j2e2lvb wrote on December 31, 2022 at 4:03 PM

You can do pipeline parallelism via FairScale and HF Accelerate on any identical (and sometimes non identical) GPUs.