I've found they really only rip paint off walls if a) they were left on for years or b) the wall wasn't primed before painting.

Otherwise they've been a godsend for me