I would doubt that anyone cares if you're colorblind or not. I'm red-green colorblind and no-one cares. I am irritating sometimes in that I have to ask people "What color is this?" but it's not a big deal.

If I never brought it up again, no-one would notice.