You open Google Search Console, navigate to Pages, and see dozens — sometimes hundreds — of URLs stuck in the "Discovered — currently not indexed" bucket. Unlike "Crawled — currently not indexed" (where Google visited and then chose not to index), this status means something more fundamental: Google hasn't even crawled the page yet.
It knows the URL exists — probably from your sitemap or an internal link — but it's queued it indefinitely. Here's why that happens and what to do about it.
Discovered vs Crawled Not Indexed: The Critical Difference
These two statuses often get confused, but they indicate completely different problems:
| Status | What it means | Root cause |
|---|---|---|
| Discovered — not indexed | Google found the URL but hasn't fetched it | Crawl budget, server load, low priority |
| Crawled — not indexed | Google fetched the page but rejected it | Thin content, quality signals, duplication |
"Discovered" is a resource problem. "Crawled not indexed" is a quality problem. They require different solutions. If you're dealing with "Crawled — currently not indexed", we cover that in detail in our article on why Google refuses to index your pages.
Cause 1: Crawl Budget Exhaustion
Crawl budget is the number of URLs Googlebot will crawl on your site within a given window. Google allocates budget based on your site's perceived authority and server capacity. A new site with low domain authority might get a budget of 100–200 pages per day. A large e-commerce site with 50,000 pages can exhaust its budget in hours.
When Googlebot discovers more URLs than its budget allows it to crawl, it queues them. Pages discovered late — via a new sitemap submission or recently added internal links — wait in that queue, sometimes for weeks.
Signs of crawl budget exhaustion:
- Large number of "Discovered" pages relative to indexed pages
- New pages taking 2–4+ weeks to get crawled
- Crawl stats in GSC show Googlebot visiting only a fraction of your total pages daily
Cause 2: Low Perceived Authority
Google prioritizes crawling pages it expects to be worth indexing. A new site with few backlinks, low engagement signals, and thin content history gets low crawl priority — even for pages that are technically fine.
This is a chicken-and-egg problem: you can't get traffic until you're indexed, but your crawl priority depends partly on traffic signals. The solution is to actively signal to Google that your pages are worth crawling.
Cause 3: Thin or Duplicate Content Patterns
Google's crawl scheduler is not naive. If it has crawled other pages on your site and found thin or duplicated content, it will deprioritize the remaining uncrawled pages. It essentially says: "This site doesn't have a great content quality record — lower priority queue."
This is why having 50 high-quality articles matters more than having 500 mediocre ones. Clean up your existing content before worrying about getting new pages crawled.
Cause 4: Server Performance Issues
Googlebot is polite — it slows down or stops crawling if your server is responding slowly or throwing errors. If your server is consistently slow (>500ms response time) or intermittently returning 5xx errors, Google will throttle its crawl rate, which means a growing backlog of "Discovered" pages.
Check your crawl stats in GSC (Settings → Crawl Stats) and look for:
- Elevated average response time
- Spikes in server errors (5xx)
- Drop in pages crawled per day
Cause 5: Poor Internal Linking
Pages that are only reachable through a sitemap and have no internal links pointing to them are at the bottom of Google's crawl priority. Googlebot follows links. If a page is 4–5 clicks from your homepage with no direct links from authoritative pages, it will wait a long time to be crawled.
Solutions: What to Actually Do
1. Fix crawl budget waste first
Audit what Googlebot is spending budget on. Use your server logs or Screaming Frog's log analysis mode to see which URLs Googlebot is actually visiting. Common budget wasters:
- URL parameters generating duplicate pages (
?sort=,?page=1) - Faceted navigation creating thousands of filter combinations
- Old redirected URLs still being crawled
- Admin or internal pages accessible to bots
Block these via robots.txt or canonical tags, freeing up budget for your real content.
2. Improve internal linking to the affected pages
Add links to your "Discovered" pages from your most authoritative pages — homepage, category pages, top-ranked articles. Even one strong internal link can dramatically speed up crawling.
3. Use URL Inspection + Request Indexing
For important pages, use GSC's URL Inspection tool to manually request indexing. This bumps them up the queue. Don't do this for hundreds of pages — reserve it for your 10–20 most important URLs.
4. Use the Google Indexing API for priority pages
For sites publishing time-sensitive content (news, events, job listings), the Google Indexing API can bypass the crawl queue entirely for eligible pages. A tool like IndexAI automates this process, sending indexing signals for each URL and tracking the result.
5. Build authority to raise crawl budget
Getting backlinks from authoritative sites increases Google's trust in your domain and expands your crawl budget over time. Focus on 5–10 quality backlinks rather than dozens of low-quality ones.
How Long Does It Take?
With no intervention: weeks to months. With active optimization (internal links + indexing API + crawl budget cleanup): typically 1–2 weeks for most pages to move to "Crawled" status. Some pages in the queue for 6+ months on neglected sites.
Monitor your GSC Page Indexing report weekly and track the ratio of "Discovered" to "Indexed" pages. That number should decrease over time if your fixes are working.
<div class="cta-box">
<p><strong>📞 Stuck with pages that won't get indexed?</strong> We'll diagnose your situation in minutes.</p>
<a href="https://t.me/SEOHotline" target="_blank">Contact us on Telegram</a>
</div>