Noindex is the correct tool for pages that should exist and be reachable by users but shouldn't appear in search results — thank-you pages, internal search results, staging or duplicate content, certain filtered/faceted URLs, and thin utility pages. A critical, common mistake is blocking a page in robots.txt while also trying to noindex it: if robots.txt prevents a page from being crawled at all, Google never sees the noindex tag in the first place, since it can't fetch the page to read the tag — the page may still get indexed (with limited information, based only on external links pointing to it) rather than being removed as intended. The correct approach for removing an already-indexed page is to allow crawling (don't block in robots.txt) with a noindex tag in place, wait for Google to recrawl and process the removal, then optionally block crawling afterward if desired.
Example
A team blocks a thank-you page in robots.txt and also adds a noindex tag, then is confused when the page remains indexed — the robots.txt block prevented Google from ever seeing the noindex directive in the first place.
Related terms
Related terms
Related Reading
404 Error
A 404 error is the standard HTTP status code returned when a requested page doesn't exist on the server — the classic 'page not found' response.
A/B Testing (SEO)
A/B testing in SEO is the practice of showing two versions of a page element — usually a title tag, meta description, or on-page element — to see which one earns a better click-through rate or ranking outcome.
AI Citation
An AI citation happens when an AI assistant like ChatGPT, Perplexity, Claude, or Gemini references or links to a specific page as the source for part of its answer.
