To be fair people don't think they cant achieve a specific, desired outcome by doing something small, and the butterfly effect doesn't contradict this. In time travel stories, the tiniest things could have led to huge outcomes, but those outcomes are unpredictable and sometimes very random.