You could "colonize" our galaxy with robots in a measly 50 million or so years (IIRC, could be whatever).

Even if we managed to colonize another world, I don't think it'd be logistically even remotely possible to uphold any sort of galactic civilization. Imagine trying to decide on policy when it would take hundreds of years to broadcast it anywhere else.