Viewing a single comment thread. View all comments

t1_ja0b3fz wrote

Sites managers who do not wish their content to be indexed have to update a file present on pretty much every website in existence named robots.txt. They should also decorate their pages with a tag named 'noindex' for the case where a third party site links to your pages. All major web indexes will honor either or both settings.

1