I'm Northern NJ based. Rural areas like Warren and Sussex county will be cheaper. I'd imagine parts of South Jersey are similar. If you're looking to still have access to some amenities you can look at some of the "bigger" towns like Newton, Sparta, Hackettstown, Washington. They will all be pretty small though.
Dirk_Dingus t1_j144z3y wrote
Reply to comment by sagenumen in Name of affordable towns in NJ? by AMR812
Two great breweries (and a third just up 46) and some excellent dining choices as well.
I'm not sold on that train station though. Very inconsistent service. I'd trade it for a reliable bus to the Dover station.