There are times when I have to mentally grab myself and make myself slow down and focus - I find I've skimmed so much I've lost the thread of the story or the tone of the work.

I think that's part of the concern that people have when they say you shouldn't skim - the worry that they'll start doing it too much and ruin the experience of reading.