I think we actually might do this on the way back. We have Sunday-Tuesday to travel and explore on the way home so we have more time for that.

On the way there we basically will just be driving the bulk of the journey to somewhere and then have an afternoon to explore. Wake up early maybe do breakfast and then finish the trip to Philly. Someone suggested Jim Thorpe and that might be a good place for that short amount of time.