So the crux of why we feel the angst is we recognize ourselves as a conscious piece of the world, and at the same time we realize this world could exist without us even being here, perceiving it?

I suppose there is a kind of cognitive dissonance within us when we desire to be integrated with the world while also striving for an objective perspective of said world.