Eh, disagree. If anything the Southlands makes slightly more sense than Numenor.

Numenoreans are exclusively descended from one race and keeps the same appearance due to their isolation as an island. They certainly went out and conquered/colonized but they are still all described as 7 foot tall, fair skinned bodybuilders. The Southlands all being connected by land allows much more effortless migration and mixing of populations.