Submitted by ravik_reddit_007 t3_zzitu1 in technology
Coindiggs t1_j2ekopz wrote
Reply to comment by rslarson147 in There's now an open source alternative to ChatGPT, but good luck running it by ravik_reddit_007
One A100 needs about 200-250w each. This needs 584x250w = 146,000w so approximately 146kwH. Average price of power is like 0.3$/kwh right now so running this will cost ya 43.8$ per hour, 1051.2$ per day or 32,500ish USD per month.
Viewing a single comment thread. View all comments