Castleton might be a good fit. It's a college town and has more diversity than some of the other areas. It's right off of 4, a pretty direct route to Killington and about 15 minutes from Rutland so you still get that small VT village feel but you're still close to a "bigger" city