My friend went to grad school and attended there for his undergrad. It wasn’t an issue for him. Must depend on which schools they applied to.

My best childhood friend went there and we grew up in Bennington. Kids from all over the US and world attend there. Bennington college kids do tend to stick out when they’re out and about but that’s not a bad thing. My friend has done quite well in life since attending the school. Good luck to you in your schooling and post education endeavors.