unsteadytrauma t1_j54nqh3 wrote on January 20, 2023 at 10:59 AM

Is it possible to run a model like GPT2 or GPT-J on my own computer and use it to rewrite/rephrase and summarize text? Or would that require too much resources for a personal computer? I'm a noob.

icedrift t1_j571qce wrote on January 20, 2023 at 9:12 PM

I'm pretty sure GPT-J 6B requires a minimum of 24gigs of VRAM so you would need something like a 3090 to run it locally. That said I think you're better off hosting it on something like collab or paperspace.