I had a similar issue in a smaller scale. Live in a development. My neighbors' kids played in our yard. At first it was just occasionally crossing over, then full on playing in the yard. If they had just said "is that OK" I would have said yes, as they were being respectful. But they acted entitled. Soon enough they were leaving trash in our yard. So we got a fence.