Harrison might work, it doesn't have a lot going on itself, but the PATH is a quick ride to Newark, JC and NYC, and it's less expensive.

JSQ is fine (I have friends with young kids who walk around and take the train from there all the time), but you're pushing your budget a lot.

Also, I might talk to a realtor who isn't scared of cities.