Google Search Console · indexing
Google Pages Not Indexed: Diagnose Crawled, Discovered, Canonical and Noindex
Discovered – currently not indexed and Crawled – currently not indexed represent different stages. In the first, Google knows the URL but has not confirmed fetching it. In the second, Google has fetched the URL but has not currently chosen to include it. A generic 'request indexing again' recommendation does not address these distinct states.
01 / 6
Do not confuse discovery with crawling
A Discovered URL is known to the search system but has not necessarily been downloaded. Internal link depth, very large sets of low-value URLs, hosting instability and crawl prioritisation are useful areas to investigate rather than rewriting headings before any known crawl.
A Crawled URL was fetched and may still be excluded for reasons that include duplicate signals, content selection or technical failures. It is not automatically a penalty. Look at the Google-selected canonical, the last downloaded state and comparison with other indexed pages.
Acceptance criteria
- Known GSC status and last crawl recorded.
- Discovered and Crawled have different remediation tracks.
02 / 6
Check the production HTTP response and HTML
Fetch the real canonical URL, follow redirects, check 200, X-Robots-Tag, meta robots and self-canonical. Verify whether title, H1, main content and crawlable links arrive in raw source or only after JavaScript.
A preview screenshot does not establish Google eligibility. A non-existent path should return 404 rather than a universal SPA 200. Where hydration is necessary, test failed network requests and the actual browser-rendered DOM.
Acceptance criteria
- HTTP status and canonical are recorded.
- Main content delivery has been tested on the final domain.
03 / 6
Inspect Google-selected canonicals and duplication
If Search Console says Google selected a different canonical, compare actual redirects, declared canonical, sitemap URLs, hreflang and internal links. A page can publish a canonical hint that Google does not select.
Duplicate URLs from filter parameters require a different treatment from separate articles with thin duplicated text. Consolidate actual equivalents and use exact redirects where appropriate; do not apply noindex to the URL you expect to rank.
Acceptance criteria
- Google-selected URL is known.
- Canonical and internal navigation signals do not contradict one another.
04 / 6
Decide whether the page has independent value
An HTTP 200 does not establish a reason to index. A page with interchangeable local-city text, identical sections or almost no unique task value may need consolidation, stronger source data or a complete rewrite.
For real educational content, publish useful examples, measurements, troubleshooting, original analysis and honest limitations. When several URLs target the same intent, consider a stronger single page rather than another set of keyword variants.
Acceptance criteria
- One clear independent user task per page.
- Overlapping and duplicate content reviewed for consolidation.
05 / 6
Improve internal discovery paths
Sitemaps are discovery hints, not a guarantee of crawling or indexing. Link priority pages from useful hubs and relevant existing articles using regular HTML anchors and descriptive text.
For large Discovered cohorts, analyse the generation of faceted URLs, infinite parameters, crawl responses and verified Googlebot server logs. Setting the User-Agent string to Googlebot during synthetic crawling does not mean Google has visited.
Acceptance criteria
- Important URLs have contextual links.
- Sitemap contains 200 canonical indexable pages only.
06 / 6
Use indexing interfaces honestly
Google URL Inspection API is a read-only interface for Google's known status and cannot invoke the Request Indexing UI button. The separate Indexing API is not for arbitrary articles; its use is restricted to supported job posting and livestream content types.
Manual requests through Search Console have quotas and are not commands to include a URL. IndexNow is a different notification mechanism and should never be represented as submission to Google. Track the fix date and revisit the URL after actual recrawling.
Acceptance criteria
- Submission claims are supported by real UI evidence.
- Next check is scheduled based on Google status, not a crawler simulation.
Are crawl restrictions part of the problem? Test Allow/Disallow rules for your URLs in the robots.txt checker.
Free local diagnostic · works in browser
GSC indexing diagnosis: group URLs and get fixes
Paste CSV with URL and Status/Reason columns, or a list of URLs exported from one issue group. All processing stays in your browser. This classifies your stated issue, not Google's live status.
Preparing interactive analyzer…
A Status column overrides this selection. When exporting one GSC issue group, choose its reason here.
Method: GSC Page Indexing → stated URL reason → diagnostic hypotheses → testable actions. No GSC account access, indexing submissions or ranking guarantee.
Copy and adapt
Google indexing diagnostic worksheet
Record actual Google states next to independently verified HTTP evidence; the sample data is illustrative.
url,google_state,last_google_crawl,google_canonical,http_status,initial_h1,robots,inlinks,root_cause,fix,requested_in_ui,check_date
https://example.com/a,Discovered currently not indexed,,unknown,200,yes,index,0,orphan,add hub inlink,no,2026-10-15
https://example.com/b,Crawled currently not indexed,2026-10-08,unknown,200,no,index,4,verify JS delivery,fix initial content,no,2026-10-15Verify completion
0/12Mark only steps you verified on your own site. These checkboxes reset on reload and do not certify the result.
Common failures and fixes
Crawled yet canonical is present
Cause: Google may prefer a different duplicate or consider the page insufficiently distinct.
Fix: Inspect actual Google-selected canonical and page value, not just a tag.
Sitemap shows every URL but many remain absent
Cause: Sitemap discovery is not guaranteed index selection.
Fix: Segment templates and test real content and internal links.
A service claims to have forcibly indexed thousands of articles
Cause: Synthetic crawling or IndexNow was misrepresented as Google's indexing action.
Fix: Demand actual GSC evidence; ordinary articles cannot use the dedicated Google Indexing API.
Questions people ask
Does Search Console Request Indexing guarantee ranking?
No. It asks Google to reconsider crawling and has usage limits.
Why doesn't Page Indexing change immediately after deployment?
Google updates its reporting after it recrawls and processes the URL, not at your deployment time.
Should I resend my sitemap every day?
Not as a way to force inclusion. Make sure it stays accurate and work on page value and discovery.
Method, limits and source evidence
Reviewed October 15, 2026 using Google Search Central / Search Console concepts. User-facing status names can change.
The example URLs have not been submitted or inspected in Google's systems; this is a reusable workflow.
Extended discussion is in book chapters 5–9 and 32.
Found a factual error? Contact the author.
Read the original book chapters
These subjects are explored in the original SEO 2026 book. Full chapters are freely readable with citations, original tables and figures.