I think this depends on the situation. Typically, I think people should be able to use stuff if other people are not using it.

Look at all the land that people could farm on but is just neglected by it's careless rich owners.

Or 2-3 empty houses for every homeless person. Its insanity.