Noindex Nofollow Checker
Compare robots meta tags with any HTTP X-Robots-Tag directives returned by a page. This tool helps you identify conflicting instructions for search engine bots.
Your workspace
Browser + optional server checksHow to use Noindex Nofollow Checker
- Paste the HTML source code into the HTML source field or enter a full URL.
- Click the analyze button to process the provided content or fetch the live page headers.
- Review the extracted robots meta tags and HTTP X-Robots-Tag directives displayed in the results.
When this tool is useful
Search engines rely on specific directives to determine whether a page should be indexed or if links should be followed. These instructions often appear in two places: within the HTML head as a robots meta tag, or in the HTTP response headers as an X-Robots-Tag. Discrepancies between these sources can lead to unintended indexing behavior, such as a page being indexed despite a 'noindex' directive or links being crawled when they should be ignored. This tool parses your provided HTML source or fetches a live URL to extract both the meta tag content and the HTTP header directives, allowing you to quickly spot conflicts and verify that your site's crawling rules are configured exactly as you intended for search engine crawlers.
<meta name="robots" content="noindex,nofollow">
Detected Meta Tag: noindex, nofollow. HTTP Header: None found. Status: Directives present in HTML only.
Understanding Conflicting Directives
When a page contains both a robots meta tag and an X-Robots-Tag, search engines must reconcile them. If the meta tag says 'index' but the HTTP header says 'noindex', crawlers typically respect the more restrictive directive. This tool highlights both sources side-by-side so you can identify if your server configuration is overriding your page-level settings. It is common for developers to update the HTML source but forget that a legacy X-Robots-Tag directive is still active on the server level. By checking both, you ensure that your intended indexing strategy is consistent across the entire response, preventing accidental de-indexing or unwanted crawling of private administrative pages.
Limitations of Robots Meta Analysis
While this tool effectively extracts and displays the directives present on a page, it does not simulate how a specific search engine crawler interprets those rules. It cannot verify if a page is currently indexed in Google or Bing, nor does it check your robots.txt file to see if the page is blocked from crawling entirely. The tool focuses strictly on the 'noindex' and 'nofollow' attributes found within the document head or the HTTP response headers. Use this as a diagnostic aid to confirm your site's meta configuration, but remember that actual indexing status depends on many other factors, including canonical tags and external link signals.
Method and limits
Shows supplied or fetched directives. This does not evaluate robots.txt access or prove actual index membership.
Common questions
Does this tool check my robots.txt file?
No, this tool only analyzes robots meta tags found within the HTML head and X-Robots-Tag directives in the HTTP response headers. It does not parse or evaluate your robots.txt file.
What happens if I enter both a URL and HTML source?
The tool prioritizes the provided HTML source input if present. If you wish to fetch a live URL, please leave the HTML source field blank to ensure the tool retrieves the current headers and content from the live server.
Can this tool guarantee my page will be indexed?
No. This tool only reports the directives present on your page. Search engines may still choose not to index a page for other reasons, such as low content quality, duplicate content, or canonicalization issues.
Continue your workflow
Explore more tools in this category for your next step.
Anchor Text Audit
List anchor text and resolved destinations from pasted HTML, including empty and image-only links.
Article Schema Generator
Build Article JSON-LD from the matching content and facts published on your page. This tool formats your metadata into structured data for search engines.
Breadcrumb Schema Generator
Arrange named page URLs into an ordered breadcrumb trail and generate the corresponding BreadcrumbList markup.
Bulk HTTP Status Checker
Check up to five public HTTP or HTTPS URLs and inspect the returned status; private network addresses are not accepted.