+1 for milford, although the rent might not be that much cheaper as the land use is mostly single family homes and not too many apartments. Lots of great spots to hang out in town with different vibes and it would probably be best for your fairfield/new haven situation given the metro north line. Some new apartments just went up by the train station but if you need to go out further, there are covered bike lockers.