Index Bloat

Index bloat is when search engines index far more pages from a site than are useful, often thin, duplicate or auto-generated URLs that nobody would want to find in search. It wastes crawling effort and can dilute how search engines judge the site’s overall quality.

Written by Paul Hoda, SEO consultant since 2005. Last updated 8 November 2026.

What causes index bloat

  • Faceted navigation creating a URL for every combination of filters, such as colour, size and price.
  • URL parameters for sorting, tracking and session IDs.
  • Internal search result pages that can be crawled.
  • CMS archives: tag pages, author pages, date archives and attachment pages, often with one or two posts each.
  • Paginated pages and printer-friendly versions.
  • Old, outdated or empty pages that were never removed.
  • Spam pages created after a site was hacked.

Why it matters for SEO

Every URL search engines can find has to be crawled and judged. When most of those URLs are low value, Googlebot spends time on them instead of on new or important pages, which matters for crawl budget on large sites.

Near-identical pages can also create duplicate content and compete for the same searches. Google has said its systems look at site-wide signals when assessing content quality, so a large volume of unhelpful pages may weigh on a site, though exactly how much is not public.

How to spot index bloat

  1. Compare the number of indexed pages in the Search Console Page indexing report with the number of pages you actually want indexed.
  2. Run a site: search for a rough idea, but treat its numbers as estimates.
  3. Crawl the site and list URL patterns: parameters, archives, filters and thin pages.
  4. Check the Search Console Performance report for indexed pages that get no impressions over many months.
  5. Look for unusual URLs, such as foreign-language spam, that may signal a hack.

How to fix it

  • Remove or merge: delete pages with no value, or combine overlapping ones, through content pruning.
  • Noindex: use a noindex tag for pages users need but searchers do not, such as internal search results.
  • Canonicalise: point duplicate versions to the main URL with a canonical tag.
  • Stop creating them: disable unneeded CMS archives and avoid linking to endless filter combinations.
  • Block crawling where suitable: robots.txt can stop crawlers wasting time on infinite filter spaces, but only after pages have dropped out of the index, since blocked pages cannot show a noindex.
  • Tidy sitemaps: list only canonical, indexable URLs.

A common myth

Having fewer pages is not automatically better. A large site with thousands of genuinely useful pages does not have index bloat. The problem is pages without value, not page count. Equally, deleting pages that bring in traffic or links just to shrink the index can do more harm than good, so check the data before removing anything.

Key Takeaways

  • Index bloat means many low-value pages are indexed from your site.
  • Filters, parameters, archives and internal search are common causes.
  • It wastes crawling and can dilute perceived site quality.
  • Compare indexed pages in Search Console with pages you actually want indexed.
  • Fix it by removing, noindexing or canonicalising, then stop new bloat at the source.

Related Terms

Wondering what to fix first on your site? Get a free check of your site’s SEO, or keep learning in the SEO Encyclopedia.