Viewing a single comment thread. View all comments

shanoshamanizum OP t1_j6msy01 wrote

Reply to comment by khrisrino in Why AI can not replace search index by shanoshamanizum

Again its not you choosing them arbitrary.

0

khrisrino t1_j6mx49i wrote

It depends on what the AI optimization function is. The AI has been trained on a large corpus of data (scraped from the internet I guess?). Search engine has also been trained on a large selection of data from the internet. So what’s the difference ultimately? The search engine ranking algorithm also has biases when you go deep into it. There is an infinite variety of queries you can come up with and a rather limited training set of data behind it. Google themselves said that even after all these years 15% of queries are completely new queries. So for those new queries it’s likely you’re just getting some random results which could very well be all wrong. Same issue with Reddit … if you ask some common questions you get great answers. But ask something nontrivial and all you get are random and misinformed answers. The Reddit ranking function is also inherently very susceptible to bias because it depends on people to upvote or downvote without knowledge of whether the people voting actually know anything about the topic.

5

shanoshamanizum OP t1_j6mxesx wrote

>The AI has been trained on a large corpus of data (scraped from the internet I guess?). Search engine has also been trained on a large selection of data from the internet. So what’s the difference ultimately?

One is an index where ultimately you decide what to read while the other one is a crystal ball with no alternative options.

−1

khrisrino t1_j6mzbk0 wrote

You think you’re getting the full set of possible search results from which you then freely choose … but that’s not how it works. They have a ranker behind the scenes that decides what you get the see.

5

shanoshamanizum OP t1_j6mzfcy wrote

We are comparing the concepts not the misbehavior of providers.

0

khrisrino t1_j6n01m9 wrote

Yes conceptually the search engine is better in that way. But we don’t live in a conceptual world. We are very much exposed to the misbehavior of providers so we cannot ignore them in the evaluation.

4

TiredOldLamb t1_j6n2av2 wrote

Then ask for a hundred and pick 4 you like the most. The whole point of AI is to lessen the tedium. If you want multiple results, you ask for them. The search engine also gives you a set of links it deems most relevant to your inquiry. It pre chooses the things you pick from based on its programming.

1

shanoshamanizum OP t1_j6n2rc7 wrote

Putting it this way I can see more clearly the similarity between both and the fact that maybe search engines are already using AI.

2