Eligible is different from selected
Indexability concerns whether a page can be included in a search engine’s index. For Google, the basic technical requirements include accessible content, a successful response and indexable material. Satisfying the technical requirements does not guarantee that a URL will be selected or shown for a particular query.
This distinction matters when reviewing an SEO report: a page can be technically eligible without having earned a place in the available search results. Google explains its technical eligibility requirements.
Example: a staging setting remains after launch
Imagine a new website launched with good service copy and working navigation, but an old noindex setting remains active. The pages can still load for customers while communicating that they should be excluded from search. Submitting the same sitemap repeatedly does not correct that instruction.
Check the rendered robots directives, relevant response headers and the WordPress visibility settings. Confirm the live environment separately from staging so a fix does not accidentally expose unfinished content. Then inspect a representative URL in Search Console and monitor the result after Google has had an opportunity to revisit it.
A practical order for investigation
Start with the intended purpose of the page. Private accounts and internal search results may be excluded deliberately. For a public service page, check its response, access controls, noindex directives, canonical destination and the content Google can retrieve.
Next, ask whether it substantially duplicates another page or lacks a useful independent answer. A new keyword in the URL alone does not make a duplicate page valuable. Use internal links and the sitemap to support discovery of pages you genuinely want indexed. Keep the diagnosis specific: blocked crawling, explicit exclusion and a search engine choosing another canonical are different conditions.
Common questions about indexability
Does adding a URL to a sitemap guarantee indexing?
No. A sitemap helps discovery and communicates the URLs you consider important. The search engine still evaluates each page and its signals.
Can robots.txt and noindex be used interchangeably?
No. Robots.txt manages crawling, while noindex addresses indexing. A crawler generally needs access to retrieve a page-level noindex directive, so conflicting controls can frustrate the intended result.
Related definitions
- Crawlability — Whether a search engine can discover and request pages and resources. It depends on factors including links, server responses, access restrictions and crawler directives.
- Noindex — A directive asking supporting search engines not to include a page in search results. The crawler generally needs access to the page to discover the directive.
- Canonical URL — The preferred URL for a page when identical or substantially similar content is accessible through multiple addresses. A canonical link communicates a preference rather than forcing a redirect.
- Sitemap — A structured list of relevant site URLs. XML sitemaps support discovery by search engines; an HTML sitemap helps people navigate the site.
Related SEO guides
Accessible pages still need compatible indexing instructions and canonical signals before they can be considered for search results.
For help connecting these decisions with your website, explore our SEO services or start with an SEO audit.
Put it into practice
Explore our technical seo service or talk with Refined IT about applying this to your website or business systems.