Either get marriage counseling or a divorce. This marriage sounds diseased with open relationship that the wife suggested but she isn't cool with and you're now cool with not being poly while she's has an asexual boyfriend. I not making a judgement on this being an open relationship but rather it's a mess that you two aren't on the same page.