I personally wouldn't care. They're his friends, and he had those friends before he met me. If you don't want his girl friends hanging out at his house, break up with him because once you say you're not okay with it, he'll tell his friends and you'll come off as the insecure crazy new gf, if he doesn't dump you first.