It sounds like you should, yeah. I thought the show was excellent from start to finish. There was a decline in the writing in the final season, and the show changes with time, but I thought even at the end it was significantly better than the grand majority of TV shows.

But if you're not enjoying it, why put yourself through it? It doesn't return the same vibes of seasons 1 through 4, so if I were you I'd probably stop watching.