You can simply say the truth that when it comes to your time and energy for hanging out with other people all you want to do is squash and pool. Tell him you like the way things are...that it is comfortable and dependable and you don’t feel nice about changing it up. I think honesty is far more respectful than lying to him to spare his feelings.