The problem is that the reasons ChatGPT gives dumb answers are buried deep in the opaque vagaries of its algorithm. Students need to respect that ChatGPT can just screw up, but checking it becomes an exercise in rote fact checking.

What they really need to learn about critical thinking are the myriad ways humans can mislead themselves and others, on purpose or by accident, from the tricks of malicious grifters to subtle biases we all have. ChatGPT isn't great for that, and it unfortunately might discourage the use of tools like long-form essays that are better for learning critical thinking and other essential skills like structuring ideas.