Duplicate Content

Duplicate content is content that appears at more than one URL, either on your own website or across different websites. It is usually not a penalty issue, but it confuses search engines, wastes crawling and splits ranking signals between several pages.

Types of duplicate content

  • Technical duplicates: the same page reachable at several URLs, such as http and https, www and non-www, with and without trailing slashes, or with tracking parameters.
  • Near-duplicates on your site: pages with almost identical text, such as location pages where only the town name changes, or product variants with the same description.
  • Cross-domain duplicates: your content republished on other sites, or manufacturers’ descriptions copied by many retailers.
  • Scraped content: other sites copying your work without permission.

Is there a duplicate content penalty?

Not for ordinary duplication. Google’s systems simply choose one version to show and filter out the rest. The real problems are:

  • Google may pick the wrong URL as the main version.
  • Links and other signals are split across versions, so none ranks as well as it could.
  • Crawling is wasted on copies instead of new pages.
  • Pages compete with each other, similar to Keyword Cannibalisation.

Deliberately copying content from other sites to manipulate rankings, however, is spam and can lead to manual actions.

How to find duplicate content

  • In Google Search Console, look for “Duplicate without user-selected canonical” and “Duplicate, Google chose different canonical than user” in the Pages report.
  • Crawl your site and look for identical titles, descriptions and content hashes.
  • Search Google for a unique sentence from your page in quotation marks to find copies elsewhere.
  • Use plagiarism tools such as Copyscape for larger checks.

How to fix duplicate content

  1. Choose one preferred version of each page and domain.
  2. Use 301 redirects from duplicates that users do not need, such as http to https.
  3. Add canonical tags to duplicates that must stay live, such as filtered pages.
  4. Merge similar pages into one stronger page and redirect the others.
  5. Rewrite near-duplicate pages so each has genuinely unique, useful content, or noindex them if they have no search value.
  6. Write your own product descriptions instead of using manufacturer text.
  7. Keep internal links consistent, always pointing to the canonical URL.

Location and service pages

Businesses often create many town pages with the same text. These are close to doorway pages and tend to perform poorly. Good Local Landing Pages include unique details for each area: local projects, testimonials, staff, directions and relevant information.

Syndication and guest content

If you republish your article on another site, ask for a canonical tag pointing to your original, or at least a clear link back. If someone scrapes your content and outranks you, you can file a DMCA request with Google.

Duplicate content and AI-written text

Publishing large amounts of similar AI-generated pages creates near-duplicate content at scale and can also count as scaled content abuse. Every page should add something that other pages do not; see Thin Content and Helpful Content.

Key Takeaways

  • Duplicate content splits signals and wastes crawling, but is rarely a penalty.
  • Technical duplicates are fixed with redirects and canonical tags.
  • Merge or rewrite near-duplicate pages so each has unique value.
  • Write your own product and location content.
  • Mass-produced similar pages are treated as low quality.

Related Terms

Wondering what to fix first on your site? Get a free check of your site’s SEO, or keep learning in the SEO Encyclopedia.