To be fair to you, even if you had adressed it with him, it wouldn't have helped - I noticed my ex got more and more distant and our sex life pretty much nonexistent, I adressed her about it and all I got back was "work is stressful" but it was obvious there was more going on - still don't know if she was cheating or if there was something else going on but in the end we broke up