Personally, I have a high tolerance for errousness/imperfection, and I just skim-off the pronounced bits with a putty blade, rough sand, then prime&paint.

I tend to fuel my OCD a bit more when it comes to sanding, so I'm either in, or entirely out ;)