I live in New Haven. My girlfriend is not a driver, and has gotten around fine since 2019. However she’s also a grad student at Yale, so she has access to Yale shuttles that go around the city.

I personally would not want to live here without a car, but it seems possible particularly if you plan where you live well.