There's nothing wrong with you asking! I find their reaction to be strange. Even if you were flirting, their reaction was strange. I wouldn't let it bother you. There's something going on in their relationship/life that would make them react that way. I don't believe it was you.