Guilford and Madison both have the small town New England feel. Both are especially great if you have kids, as the schools are excellent and there is a lot to do. Just know that while the quaint is strong in both towns, it also means you’ll be driving to most big box stores when you need to. They are sleepier in the summer but don’t get the tourist influx that the Old Saybrook area does so it’s not as jarring of a change when summer is over. Honestly I’d consider commute over everything when choosing.