Viewing a single comment thread. View all comments

No_Goat277 t1_j98oklc wrote

What is cost of cloud total vs running your servers on prem? I need to start a project with 2/4 RTX cards to train my stable diffusion model.

2

I_will_delete_myself OP t1_j98p0vg wrote

I been running the A100 the entire weekend and so far it’s only costing me under 20 bucks. If you need it around an hour and it would probably cost you between 1-3 dollars

I would recommend you plan a budget before you get started and it will almost always be cheaper on a year basis. Try Colab first and see if you will need it longer than 12 hours.

6

No_Goat277 t1_j98pvwn wrote

Thank you. I have scientific team so our PhD is requesting GPU for SD training. Our other team is using Midjourney but there is no API to it, so they happy but we can’t move forward due to lack of API.

2

milleeeee t1_j9cbrxg wrote

Azure has cheap A100 spot instances. Only 1$ per hour per A100. Up until now I have always gotten my instances immediately and I have only been kicked out twice in over 100 training runs (each run lasts a couple hours). So I am very happy with it at the moment and would highly recommend it

3