People generally live in flood pains (where rivers meet the ocean). These rivers bring in silt and things eventually get buried over long periods of time. Just like lakes eventually fill up with silt and become land again.

In the end it is just high parts of the Earth (eg mountains) eroding and the silt piles up in the lower places... Making high places lower and lower places higher