#Robots meta tags

Robots meta tags are instructions placed in a page’s HTML head, or sent as an HTTP header, that tell search engines how to handle that page. The best-known values are noindex, which keeps a page out of search results, and nofollow, which asks crawlers not to follow its links. Other values control previews, such as nosnippet, max-snippet and max-image-preview. They work page by page, unlike robots.txt, which controls crawling across whole sections of a site. A small mistake in these tags can remove important pages from search, so they deserve careful checking after theme or plugin changes. Articles under this tag explain what each directive does and when a blog should use it.