"Discovered" vs "Crawled", not indexed: what to do
Plain-language meaning of the page indexing statuses in Search Console, with the response each one actually calls for.
By Metryn · Updated 16 October 2026 · 4 min read
Short answer: "Discovered" means Google knows the URL exists and hasn't fetched it yet. "Crawled" means it fetched the page and decided not to index it, at least for now. They sound alike and they need different responses.
The statuses people search for
| Status in Search Console | What Google says it means | What to do |
|---|---|---|
| Discovered - currently not indexed | Google found the page but hasn't crawled it yet, and may have rescheduled the crawl to avoid overloading your site | Make sure the page is linked from a known page or listed in a sitemap, and that the server answers quickly |
| Crawled - currently not indexed | Google crawled the page but hasn't indexed it. It may be indexed later | Google says you don't need to resubmit. Improve the page if it's thin or near-identical to others |
| Blocked by robots.txt | Your robots.txt blocks the page, and Google may still index it from links | Unblock it if you want it indexed, or use noindex if you want it out |
| Excluded by 'noindex' tag | Google found a noindex directive and didn't index the page | Nothing, if intended. Remove the tag if it isn't |
| Duplicate without user-selected canonical | The page duplicates another and you didn't declare a preferred one. Google chose a different canonical | Not an error. Mark the right canonical if Google picked the wrong one |
| Soft 404 | The page looks like a 'not found' page but returns a normal status | Return a real 404, or add real content if the page should exist |
| Page with redirect | The URL redirects somewhere else, so it isn't indexed itself | Normal. Check the target URL instead |
If the page is "Discovered"
Give Google a reason and a path. Google says every page you care about should be linked from at least one other page on your site, using normal <a href> links with descriptive anchor text. A sitemap helps discovery too, though Google describes it as a hint with no guarantee.
If the page is "Crawled"
This one is less mechanical. Google doesn't tell you the reason, and its documentation for the status gives no specific fix. What it does publish is a set of questions about content: does the page add original information, does it offer more value than other pages in the results, would a reader need to search elsewhere to finish the job. A page that's a reworded copy of something else, or very little text around a template, answers those poorly.
So the honest workflow is to check the page is actually worth indexing, make it better if it isn't, and make sure internal links point to it. Re-requesting indexing again and again doesn't change that.
Questions people ask
Should I keep clicking 'Request indexing'?
For the 'Crawled' status, Google says you don't need to resubmit the URL. Requests are also subject to daily limits and don't guarantee inclusion. A better use of that time is improving the page and linking to it.
Is 'Duplicate without user-selected canonical' a penalty?
The documentation says it isn't an error. It means Google found a duplicate, you didn't declare a preferred version, and it chose one. If it chose the wrong one, declare the right one with a redirect or a rel="canonical".
Why are some of my pages 'Page with redirect'?
Because they redirect, so the URL itself isn't indexed and the target may be. That's normal for old addresses. What you want to check is the status of the target URL.
Does a bigger sitemap fix 'Discovered'?
A sitemap helps discovery, and Google calls it a hint with no guarantee. For this status the two levers it names are being linked from a known page and being listed in a sitemap.
What to do this week
- Open the page indexing report and sort the not-indexed reasons by number of URLs.
- For the largest group, open three examples with URL Inspection and read the details.
- Add internal links from pages that are already indexed to the ones that aren't.
- For pages that are near-copies of others, merge them, redirect, or make them different on purpose.
Check your own site
Paste your address below. The free scan looks at robots.txt, your sitemap, access for the main AI crawlers and structured data, and shows what it found in seconds. It tells you what a machine can fetch and read. It doesn't predict rankings or citations.
Sources
- Search Console Help: Page indexing report: https://support.google.com/webmasters/answer/7440203
- Google Search Central: Sitemaps overview: https://developers.google.com/search/docs/crawling-indexing/sitemaps/overview
- Google Search Central: Creating helpful, reliable, people-first content: https://developers.google.com/search/docs/fundamentals/creating-helpful-content
- Google Search Central: Link best practices: https://developers.google.com/search/docs/crawling-indexing/links-crawlable
Keep reading
Problems and how to fix them
Why isn't my site showing in ChatGPT or AI search?Problems and how to fix them
robots.txt Disallow vs noindex: which to useProblems and how to fix them
Soft 404s and wrong status codes for crawlers
Want to check one file yourself? Try the free AI crawler robots.txt checker or the llms.txt validator, or read how the score is built.