Go to a new bank. Start a new account. Get your name off the old account. If you want to set up a regular/irregular emergency money transfer to the old account, that might also help the transition. New spouse gets the information, too.

Good luck, and "waytogo!" from some stranger on the internet, for being such a thoughtful person.