Most of them were. In the center of Rome only a few examples survive. The rest of that city of one million people was torn down to build the medieval city, or the Renaissance city or even the Baroque city. If you know where to look, later Roman buildings are full of scraps pillaged from Ancient Rome (including much of the lime used in the building mortars: made by burning ancient Roman limestone & marble!)