Black Rock is nice. Great area, good access to train at Fairfield Metro.

Alternatively, go 10-15 minutes east to Milford. Super nice town and affordable. Plenty of apartments walking distance to train.

Stratford is a good option too. Sort of inbetween Bridgeport and Milford, and not just geographically.