Korbs Bakery was very good and unfortunately long gone along with another nostalgic spot Millers Delicatessen. It's been years since Korbs closed and the last Jewish style bakery in the state, Rainbow Bakery in Cranston, closed a couple of years ago. They made a good rye bread but not quite like the old Korbs. While there is a Jewish community in the Providence area I don't think it has the critical mass required at this point to allow the success of a small and specialized real Jewish bakery. Let me also squeeze in a tearful shout out to the also very much missed Davis Dairy Store where you could buy hand cut slices of smoked salmon and watch it being sliced.

There are a few bakeries in Brookline and Newton which would be about an hour's ride. Locally you can try Bubbie's as already suggested and there is a new bakery at the corner of Cypress and Camp St, Oak Bakeshop, which seems to be more pastry oriented but might do bagels too.