Indexability is a page’s eligibility to appear in a search engine’s index. It differs from crawlability: an accessible page may still carry a noindex instruction or be treated as a duplicate. Reviewing indexability starts with the intended role of each URL, not a target to index everything.
Eligibility is not a ranking promise
Google’s technical requirements include accessible content and a successful response, but meeting them does not guarantee indexing. Search engines also decide which pages to retain and which version represents duplicated content. An indexable service page still needs a clear purpose and useful information. Conversely, excluding a staff login or confirmation page may be entirely correct. Separate an unexpected exclusion from an intentional one before spending development effort on the report’s total number of non-indexed URLs.
Inspect the whole set of signals
Check the HTTP status code, robots meta tag, X-Robots-Tag header and canonical URL on an affected page. Review robots.txt because a blocked crawler may be unable to see a changed noindex instruction. Compare these findings with Google’s selected canonical and indexed content in URL Inspection. Sample several URLs using the same template to identify whether the problem is isolated or systemic. Record what the page should do, the rule currently preventing it and the expected state after release.
Check any inherited CMS visibility setting before changing individual pages. A global launch setting can override a carefully edited template, so document the source of the instruction as well as its visible output.
Correct an accidental launch restriction
For example, a hypothetical Perth accountant launches updated tax service pages while a staging noindex setting remains enabled. Removing that setting from the intended public templates is a sensible fix, followed by checks on rendered HTML and response headers. The thank-you page can remain excluded. Requesting indexing may help submit a corrected page for consideration, but it cannot force inclusion or a timetable. Monitor the affected URLs over subsequent crawls and confirm that the change survives future template updates.
An SEO audit can distinguish intentional exclusions from accidental template restrictions.
Common questions
Can a sitemap override noindex?
No. A sitemap helps discovery; it does not cancel an indexing directive. Resolve the conflicting instruction on pages intended for search.
Why is an eligible page still absent?
Google may not have processed it, may choose another canonical or may not select the content. Inspect the reported reason before changing settings.
Terms in this guide
- Indexability — Whether a page is eligible to enter a search engine’s index. A crawlable page may still be excluded, for example because of a noindex directive or the engine’s own selection.
- Crawlability — Whether a search engine can discover and request pages and resources. It depends on factors including links, server responses, access restrictions and crawler directives.
- Noindex — A directive asking supporting search engines not to include a page in search results. The crawler generally needs access to the page to discover the directive.
- Canonical URL — The preferred URL for a page when identical or substantially similar content is accessible through multiple addresses. A canonical link communicates a preference rather than forcing a redirect.
Related SEO guides
Apply this to your website
Explore SEO Audits for help planning and implementing the relevant changes, or discuss your website with Refined IT.