Analyzing GSC Pages Report
The GSC Pages report is the most diagnostic tool in SEO. Each status code tells a specific story — learn to read all 10 and know exactly what to do about each.
What you'll learn
- Understand how to read the GSC Pages report beyond just "indexed vs. not indexed"
- Know what each of the 10 Not Indexed status codes means and why it occurs
- Determine when a not-indexed status is a problem vs. expected behavior
- Build a prioritized action plan from the Pages report data
- Understand the difference between a crawl decision and an index decision
The Pages Report: Your Indexation Diagnostic Tool
GSC → Indexing → Pages shows not just which pages are indexed, but precisely why pages are or aren't indexed. Each URL in the "Not indexed" section has a specific status code — this is the most detailed diagnostic data Google ever gives you directly.
The first thing to check is the ratio and trend, not just the absolute numbers. A ratio of 60% indexed to 40% not-indexed might be perfectly normal for a large e-commerce site with many filter pages, or a serious problem for a blog where most articles should be ranking.
The 10 "Not Indexed" Status Codes — Complete Reference
1. Discovered — Currently Not Indexed
Google found the URL (via a link or sitemap) but has not visited it yet. The page is in a queue but hasn't been crawled.
When it's a problem: If important commercial or informational pages stay in this status for more than 2-3 weeks, you have a crawl budget issue. Google isn't allocating enough crawl quota to your site to reach these pages.
Fix: Improve internal linking to these pages, remove low-value pages from the sitemap to concentrate crawl budget, check server response times.
2. Crawled — Currently Not Indexed
Googlebot visited the page, read its content, but decided not to add it to the index. This is the most critical status in the report because it's a direct quality signal from Google.
"Crawled — Not Indexed" means Google assessed the page and found it not valuable enough to include in its index. Possible reasons: thin content, content similar to what's already indexed, low E-E-A-T, content worse than competing pages already in the index.
Fix: Analyze the specific URLs in this status. If they're template pages with identical structure (e.g., city pages, parameter pages), consolidate or improve uniqueness. If they're individual articles, the content needs substantive improvement.
3. Duplicate, Google Chose Different Canonical Than User
You specified a canonical URL, but Google overrode your choice and selected a different page as the canonical. Google ignores canonicals when it determines another version is more authoritative.
How to diagnose: Click any URL in this list → GSC shows which URL Google selected as canonical. Compare Google's choice to your specified canonical. Google typically chooses the page that receives more internal links, more backlinks, or has more content.
Fix: Strengthen the page you want to be canonical: add more internal links pointing to it, consolidate content, ensure the preferred version loads faster.
4. Duplicate Without User-Selected Canonical
Multiple pages with similar content exist, but no canonical tag specifies which is the master. Google makes its own choice — which may not be the version you want.
Common cause: URL parameters — /catalog?sort=price, /catalog?color=red, and /catalog may all contain similar content. Without canonicals or robots.txt clean-param, Google sees them as separate pages competing for the same index slot.
Fix: Add canonical tags explicitly, or use clean-param in robots.txt to inform Googlebot which parameters to ignore.
5. Excluded by "noindex" Tag
The page has <meta name="robots" content="noindex"> in its HTML or an X-Robots-Tag: noindex HTTP header. Google is respecting this directive.
When it's expected: Thank-you pages, admin pages, internal search results, checkout pages — these should have noindex.
When it's a problem: Category pages, product pages, blog articles appearing here indicate a template or CMS issue that applied noindex incorrectly.
6. Blocked by robots.txt
Googlebot is disallowed from crawling the page by your robots.txt file. Importantly: being blocked in robots.txt does NOT remove the page from the index if external sites link to it. Google can still learn about the URL from backlinks and show it in results — just without crawling its content.
Fix: Review your robots.txt rules. If pages in this status should be indexed, remove the blocking rule. If they shouldn't be indexed AND you want them out of search results entirely, noindex is more reliable than robots.txt blocking.
7. Page With Redirect
The URL redirects to another page. Redirected URLs themselves are not indexed — the destination URL gets indexed instead.
When it's a problem: If you see important content URLs redirecting to wrong destinations, or redirect chains (A → B → C) wasting crawl budget, these need to be fixed.
8. Not Found (404)
The URL returns a 404 error — the page doesn't exist. Google found a link to this URL but the page returns "not found."
Fix: If the page was deleted intentionally and traffic is negligible, this is acceptable. If the page moved, add a 301 redirect from the old URL to the new location.
9. Soft 404
The page returns HTTP 200 (OK) but its content signals to Google that the page is effectively empty or "not found" — a thin page that says "no results" or "coming soon."
Fix: Either add real content to the page or make it return an actual 404. Soft 404s waste crawl budget and confuse Google's indexation model.
10. Server Error (5xx)
The server returns 500, 502, 503, or similar errors when Googlebot tries to crawl the page. Repeated server errors train Googlebot to crawl your site less frequently, reducing the crawl budget allocated to you.
Fix: This is a hosting/infrastructure issue, not an SEO issue. Escalate to developers. Monitor server error rates in GSC over time.
Building an Action Plan from the Pages Report
After reviewing all statuses, prioritize fixes in this order:
- Crawled — Not Indexed on important pages → content quality improvement
- Blocked by robots.txt incorrectly → immediate robots.txt fix
- Google chose different canonical → strengthen your intended canonical
- Soft 404 and Server Errors → infrastructure fixes
- Discovered — Not Indexed on important pages → crawl budget optimization
Key Takeaways
- "Crawled — Not Indexed" is a direct quality judgment from Google and the highest priority status to investigate
- Google can override your canonical tags — this signals a structural issue that requires strengthening your preferred URL
- robots.txt blocking does not guarantee removal from index; noindex is more reliable for that purpose
- Soft 404s and server errors reduce crawl frequency over time — they are infrastructure problems with SEO consequences
- Build a prioritized action plan by severity: quality issues first, blocking errors second, crawl budget third