Refinancing doesn't always cost out of pocket money. No cost refinances have been around for ages.

A simple cost benefit analysis will determine if you're better off keeping your rate or refinancing. Math isn't that hard.