Micro Tools
Advertisement

Robots Tag Generator

Build the exact robots meta tag your page needs. Toggle indexing, link following and snippet controls, then copy the tag plus the matching HTTP header version.

Directives

Generated tags

Advertisement

What each directive does

noindex keeps a page out of search results while nofollow tells crawlers not to pass ranking credit through its links. noarchive blocks cached copies, nosnippet hides text snippets, noimageindex excludes the page's images from image search, and max-snippet / max-image-preview / max-video-preview fine-tune how much of your content can appear in results.

Meta tag vs HTTP header

The meta tag works for HTML pages; the X-Robots-Tag header covers everything else like PDFs and images, set in your server config. The tool outputs both so you can pick the right one. Remember that noindex is a request crawlers honor, not access control: block truly private content with authentication instead.

Related tools

JSON formatterFormat and validate JSON, privately. Regex testerTest regex live with highlighting. Base64 encoderBase64 encode and decode, plus URL encoder and JWT decoder.

Robots Tag Generator FAQs

What is the difference between noindex and disallow in robots.txt?
Disallow stops crawlers from visiting the page at all, which also stops them seeing a noindex tag. Use robots.txt to save crawl budget and noindex to remove already-known pages from the index.
Should I use noindex, nofollow together?
Only if you mean both. They are independent: noindex controls indexing of this page, nofollow controls whether its outbound links pass credit. The tool lets you set each separately.
How long does noindex take to work?
Days to weeks. Google must recrawl the page to see the tag. For urgent removals, use the Removals tool in Search Console instead.
Can I hide a page from search but keep it public?
noindex does exactly that: visitors with the link can still open the page, but it will not appear in search results.
Do I need the HTTP header version?
Only for non-HTML files like PDFs, where you cannot place a meta tag. For normal web pages the meta tag is enough.
Advertisement