You'll be fine. I've seen the worst parts of the city (I'm a native) and for the most part if you just mind your business ppl won't give you any serious problems. Yes there are a few mean & crazy ppl... but you find that anywhere. But the vast majority of people are chill. At the end of the day richmond is a fast-growing destination for young families for a reason. Just don't be stupid and don't try to be something that you're not... that's usually when bad things start to happen.