It doesn't have to be like that. It's possible to spread out the weight and yet keep the Center of Mass in the same spot.

If anything, it would make it easier to carry/lift compared to having it all in one spot.