Even if a just, steady-state society was nearly always the end result, all it takes is one single society bent on unending expansion to completely fill up and remake the galaxy within a (cosmically short) few hundred million years.