Not entirely disagreeing with you. But these language models are still new to being used for these purposes, and the most popular one rn was trained of information that’s a few years old.

I think with time not only will the training for responses improve, but equally important, people will improve with the prompts they write. It is quite possible to that these language models improve beyond modern day search. Especially since modern day search, seems to have gotten worse over the past decade.