All wormholes suffer from this problem. You are further or closer to the center of gravity wells like the star in the solar system or center of milky way, etc. same thing.

I’m guessing if two points are like on a piece of paper and changing the spacetime so the paper bends and touches at that point - there’s something in that transfer or process that’s not quite so free everything can jump in.