If it’s consecutive days I usually don’t feel the need to (always stop at chapter breaks).

If I’ve been away from a book for more than a few days/a week, I’ll usually skim the previous page.