Wow. He can’t do anything right. You wrongly suspect that he cheated which means you don’t trust him and now because he made an offhand humorous compliment, he only wants you for sex. Poor guy.