Viewing a single comment thread. View all comments

pyepyepie t1_j9bbg1b wrote on February 20, 2023 at 5:54 PM

Try to use both GPUs with this one: https://github.com/huggingface/accelerate https://huggingface.co/docs/accelerate/usage_guides/big_modeling https://huggingface.co/blog/accelerate-large-models Maybe it will help (the last link is clearer IMHO).