I would say move on to the new role. You current employer has had many options to pay you more in the past and didn't.

Definitely don't burn bridges on the way out - you giving 3 weeks notice should show you are being helpful. Simply say that you would like to try something different in your career.