DarkCeldori t1_j8cz4sg wrote on February 13, 2023 at 11:43 AM

Reply to comment by WithoutReason1729 in This is Revolutionary?! Amazon's 738 Million(!!!) parameter's model outpreforms humans on sience, vision, language and much more tasks. by Ok_Criticism_1414

While on the topic of consumer h/w, ryzen ai xdna seems promising, as itll be able to easily make use of main system memory which will soon be able to easily reach 256GB. That can fit very large models and inference is usually far less computationally intensive than training.

gangstasadvocate t1_j8d43oc wrote on February 13, 2023 at 12:39 PM

Apparently one of my professors well, her husband has a home grade computer system with 2 TB of RAM. I tried searching it up. It only seems like server type size but yeah

DarkCeldori t1_j8dk62j wrote on February 13, 2023 at 2:55 PM

I think some threadripper pro workstations can reach up to 2TB of ram. Will be very good once treadrippers come with ryzen xdna ai built in as that can directly use main memory for ai tasks.

Tiamatium t1_j8i6ien wrote on February 14, 2023 at 2:25 PM

Yeah, 2TB ram is doable with server/workstation hardware. Think Threadripper or Xeon for CPU.